[2025-10-09T17:00:01.993174] [INFO ] [MAIN ] Using last completed trading day: 2025-10-09 [2025-10-09T17:00:02.217559] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-09T17:00:02.217971] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-09T17:00:02.434188] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-09T17:00:02.434833] [WARN ] [STATE ] State set to: RUNNING [2025-10-09T17:00:02.434944] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-09T17:00:02.435060] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-09T17:00:02.435238] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-09T17:00:02.435296] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-09T17:00:03.506898] [DEBUG] [SYMBOL ] Found 2425 valid NYSE symbols. [2025-10-09T17:00:03.507064] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-09T17:00:03.507267] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-09T17:00:03.507875] [INFO ] [LOCAL ] Symbols cache updated with 2373 symbols. [2025-10-09T17:00:03.507967] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-09T17:00:03.508021] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-09T17:00:03.508082] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-09T17:00:03.508116] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-09T17:00:03.508144] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-09T17:00:03.508538] [DEBUG] [LOCAL ] Found 2373 symbols in cached list. [2025-10-09T17:00:03.508580] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-09T17:00:03.508758] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-09T17:00:03.508814] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2373 valid symbols. [2025-10-09T17:00:03.508847] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-09T17:00:03.508878] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-09T17:00:03.529954] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-09T17:00:03.551150] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-09T17:00:03.551299] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-09T17:00:03.551337] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-09T17:00:03.551367] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-09T17:00:03.551426] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-09T17:00:03.551814] [DEBUG] [LOCAL ] Found 2373 symbols in cached list. [2025-10-09T17:00:03.551868] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-09T17:00:03.551902] [INFO ] [MAIN ] Starting incremental update for 2373 symbols. [2025-10-09T17:00:03.551930] [INFO ] [MAIN ] Running in parallel mode [2025-10-09T17:00:03.552130] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2373 symbols [2025-10-09T17:00:04.174760] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:04.266635] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:04.285401] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:04.307337] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-09T17:00:04.343719] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-09T17:00:04.370479] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-09T17:00:04.370198] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:04.371798] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-09T17:00:04.371921] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-09T17:00:04.371976] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-09T17:00:04.372206] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-09T17:00:04.372133] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-09T17:00:04.384253] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-09T17:00:04.410679] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-09T17:00:04.461210] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-09T17:00:04.477430] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-09T17:00:04.869987] [DEBUG] [LOCAL ] A: Loaded 50744 existing records from primary storage. [2025-10-09T17:00:04.937758] [DEBUG] [LOCAL ] AA: Loaded 53620 existing records from primary storage. [2025-10-09T17:00:04.990479] [INFO ] [MAIN ] A: Loaded 50744 existing records. [2025-10-09T17:00:05.010770] [INFO ] [MAIN ] AA: Loaded 53620 existing records. [2025-10-09T17:00:05.569189] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:05.600299] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:05.596586] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-09T17:00:05.699853] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-09T17:00:05.704300] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:05.727065] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-09T17:00:05.748142] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-09T17:00:05.751921] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:05.752208] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-09T17:00:05.752280] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-09T17:00:05.752496] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-09T17:00:05.752562] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-09T17:00:05.763665] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-09T17:00:05.775085] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-09T17:00:06.051868] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:00:06.187861] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-09T17:00:06.201561] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-09T17:00:06.249725] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:00:06.262362] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-09T17:00:06.303474] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-09T17:00:06.362887] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:00:06.387128] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-09T17:00:06.421627] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-09T17:00:06.438675] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-09T17:00:06.455912] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-09T17:00:06.522179] [INFO ] [MAIN ] Update Progress: 1/2373 symbols completed. AAMI took 2.8s. Estimated remaining: 1h 57m 25s. Rate: 20.2 symbols/min [2025-10-09T17:00:06.522068] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:06.566049] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-09T17:00:06.606545] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:06.649727] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-09T17:00:06.771465] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:06.767704] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-09T17:00:06.772812] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-09T17:00:06.860687] [DEBUG] [LOCAL ] AAP: Loaded 51882 existing records from primary storage. [2025-10-09T17:00:06.861380] [INFO ] [MAIN ] AAP: Loaded 51882 existing records. [2025-10-09T17:00:07.064490] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:07.064845] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-09T17:00:07.064907] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-09T17:00:07.065182] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-09T17:00:07.065243] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-09T17:00:07.143258] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-09T17:00:07.166433] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-09T17:00:07.431465] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:07.431811] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-09T17:00:07.544547] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-09T17:00:07.545503] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-09T17:00:07.902353] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-09T17:00:07.903400] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-09T17:00:08.232478] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-09T17:00:08.233535] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-09T17:00:08.287215] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T17:00:08.298804] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-09T17:00:08.326460] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:00:08.336939] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-09T17:00:08.472043] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-09T17:00:08.472981] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-09T17:00:09.130596] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T17:00:09.132430] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-09T17:00:09.134286] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T17:00:09.151145] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-09T17:00:09.669310] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:00:09.680044] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-09T17:00:09.829843] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T17:00:09.831204] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-09T17:00:10.127222] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-09T17:00:10.141299] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-09T17:00:10.179758] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T17:00:10.181031] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-09T17:00:10.623369] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T17:00:10.624121] [INFO ] [REMOTE ] AAM: Full fetch complete (940 records). [2025-10-09T17:00:10.624252] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-09T17:00:10.816455] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-09T17:00:10.816741] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:00:10.816813] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:00:10.816902] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-09T17:00:10.816967] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-09T17:00:10.817004] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-09T17:00:10.817043] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-09T17:00:10.817121] [INFO ] [MAIN ] Update Progress: 2/2373 symbols completed. AAM took 7.2s. Estimated remaining: 2h 23m 33s. Rate: 16.5 symbols/min [2025-10-09T17:00:10.991881] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:11.030276] [DEBUG] [LOCAL ] AAT: Loaded 30285 existing records from primary storage. [2025-10-09T17:00:11.030560] [INFO ] [MAIN ] AAT: Loaded 30285 existing records. [2025-10-09T17:00:11.246188] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:11.249141] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-09T17:00:11.249341] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-09T17:00:11.261397] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-09T17:00:11.262200] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-09T17:00:11.262360] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-09T17:00:11.263743] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-09T17:00:11.599614] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-09T17:00:11.695854] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-09T17:00:11.705091] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:11.707151] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-09T17:00:12.043402] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-09T17:00:12.053633] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-09T17:00:12.640477] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T17:00:12.647243] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-09T17:00:12.989126] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:00:12.999160] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-09T17:00:13.561002] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T17:00:13.572160] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-09T17:00:13.790413] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T17:00:13.796060] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-09T17:00:14.554743] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T17:00:14.565808] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-09T17:00:14.880437] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (3.18 seconds). [2025-10-09T17:00:14.892404] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-09T17:00:14.910853] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T17:00:14.917457] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-09T17:00:15.777109] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-09T17:00:15.795913] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-09T17:00:16.322501] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T17:00:16.354893] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T17:00:16.355503] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-09T17:00:16.370210] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-09T17:00:16.514680] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T17:00:16.521221] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-09T17:00:17.418750] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T17:00:17.431286] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-09T17:00:17.836288] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T17:00:17.844340] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-09T17:00:18.367280] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T17:00:18.378674] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-09T17:00:18.813627] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T17:00:18.821104] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-09T17:00:18.915251] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-10-09T17:00:18.927724] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-09T17:00:19.354442] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T17:00:19.366769] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-09T17:00:19.613747] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T17:00:19.620245] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-09T17:00:19.887710] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:00:19.898713] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-09T17:00:20.433097] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:00:20.443892] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-09T17:00:20.818802] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T17:00:20.826711] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-09T17:00:21.298871] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T17:00:21.313374] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-09T17:00:21.470941] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:00:21.482323] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-09T17:00:21.979412] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T17:00:21.986734] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-09T17:00:22.021710] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T17:00:22.033623] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-09T17:00:22.845894] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T17:00:22.895607] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-09T17:00:22.896852] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T17:00:22.912495] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-09T17:00:22.966385] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T17:00:22.973087] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-09T17:00:23.290941] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T17:00:23.308853] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-09T17:00:23.853342] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T17:00:23.857004] [INFO ] [REMOTE ] AAT: Full fetch complete (42691 records). [2025-10-09T17:00:23.857109] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-09T17:00:24.242609] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-09T17:00:24.242720] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-09T17:00:24.243148] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-09T17:00:24.243192] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-09T17:00:24.244197] [DEBUG] [LOCAL ] AAT: Trimmed 42691 records to 30487 (keeping 200 days of data) [2025-10-09T17:00:24.452137] [DEBUG] [LOCAL ] AAT: Primary data saved (30487 records). [2025-10-09T17:00:24.452394] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-09T17:00:24.452558] [INFO ] [MAIN ] Update Progress: 3/2373 symbols completed. AAT took 13.6s. Estimated remaining: 4h 35m 11s. Rate: 8.6 symbols/min [2025-10-09T17:00:24.643041] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:24.643796] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-09T17:00:24.644072] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-09T17:00:24.644912] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-09T17:00:24.645273] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-09T17:00:24.645396] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-09T17:00:24.645613] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-09T17:00:24.781571] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T17:00:24.889313] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-09T17:00:25.035913] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T17:00:25.074600] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-09T17:00:25.085870] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-09T17:00:25.114993] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-09T17:00:25.173516] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:25.174082] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-09T17:00:25.376730] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:00:25.377043] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-09T17:00:25.377132] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:00:25.377183] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-09T17:00:25.377245] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:00:25.377337] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-09T17:00:25.377403] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-09T17:00:25.377440] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-09T17:00:25.377480] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-09T17:00:25.377528] [INFO ] [MAIN ] Update Progress: 4/2373 symbols completed. AAUC took 0.9s. Estimated remaining: 3h 35m 26s. Rate: 11.0 symbols/min [2025-10-09T17:00:25.556411] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:25.556577] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-10-09T17:00:25.556617] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-10-09T17:00:25.556753] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-09T17:00:25.556797] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-09T17:00:25.556840] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-09T17:00:25.556875] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-09T17:00:25.936777] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:25.937115] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-09T17:00:26.314895] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T17:00:26.320208] [INFO ] [REMOTE ] AAP: Full fetch complete (75018 records). [2025-10-09T17:00:26.320344] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-09T17:00:26.730200] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T17:00:26.759450] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-09T17:00:26.760015] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-09T17:00:26.761097] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-09T17:00:26.761500] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-09T17:00:26.763360] [INFO ] [REMOTE ] A: Full fetch complete (73108 records). [2025-10-09T17:00:26.763513] [DEBUG] [LOCAL ] AAP: Trimmed 75018 records to 52268 (keeping 200 days of data) [2025-10-09T17:00:26.763817] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-09T17:00:26.975062] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-09T17:00:26.998347] [INFO ] [REMOTE ] AA: Full fetch complete (77542 records). [2025-10-09T17:00:27.029175] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-09T17:00:27.501476] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-09T17:00:27.517885] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-09T17:00:27.524290] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-09T17:00:27.550951] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-09T17:00:27.572842] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:00:27.626486] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-09T17:00:27.640116] [DEBUG] [LOCAL ] A: Trimmed 73108 records to 51104 (keeping 200 days of data) [2025-10-09T17:00:27.875124] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-09T17:00:27.875277] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-09T17:00:27.877136] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-09T17:00:27.878015] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-09T17:00:27.886468] [DEBUG] [LOCAL ] AA: Trimmed 77542 records to 54010 (keeping 200 days of data) [2025-10-09T17:00:28.485891] [DEBUG] [LOCAL ] AAP: Primary data saved (52268 records). [2025-10-09T17:00:28.488288] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-09T17:00:28.491087] [INFO ] [MAIN ] Update Progress: 5/2373 symbols completed. AAP took 22.0s. Estimated remaining: 3h 16m 51s. Rate: 12.0 symbols/min [2025-10-09T17:00:28.738632] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:28.851939] [DEBUG] [LOCAL ] A: Primary data saved (51104 records). [2025-10-09T17:00:28.854009] [INFO ] [MAIN ] A: Full history saved. [2025-10-09T17:00:28.855332] [INFO ] [MAIN ] Update Progress: 6/2373 symbols completed. A took 25.3s. Estimated remaining: 2h 46m 22s. Rate: 14.2 symbols/min [2025-10-09T17:00:28.972432] [DEBUG] [LOCAL ] ABBV: Loaded 53686 existing records from primary storage. [2025-10-09T17:00:29.000508] [INFO ] [MAIN ] ABBV: Loaded 53686 existing records. [2025-10-09T17:00:29.117412] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:29.119378] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-09T17:00:29.135499] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-09T17:00:29.124876] [DEBUG] [LOCAL ] AA: Primary data saved (54010 records). [2025-10-09T17:00:29.158019] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-09T17:00:29.158359] [INFO ] [MAIN ] AA: Full history saved. [2025-10-09T17:00:29.164217] [INFO ] [MAIN ] Update Progress: 7/2373 symbols completed. AA took 25.6s. Estimated remaining: 2h 24m 17s. Rate: 16.4 symbols/min [2025-10-09T17:00:29.163614] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-09T17:00:29.242175] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-09T17:00:29.250145] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-09T17:00:29.360666] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T17:00:29.500952] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-09T17:00:29.543294] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:29.567819] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-09T17:00:29.578233] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-09T17:00:29.658094] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-09T17:00:29.672416] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-09T17:00:29.675867] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:30.146458] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:30.163229] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-09T17:00:30.279387] [DEBUG] [LOCAL ] ABEV: Loaded 53281 existing records from primary storage. [2025-10-09T17:00:30.301964] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:30.302289] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-09T17:00:30.303259] [INFO ] [MAIN ] ABEV: Loaded 53281 existing records. [2025-10-09T17:00:30.494493] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:30.494753] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-09T17:00:30.494807] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-09T17:00:30.495914] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-09T17:00:30.495989] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-09T17:00:30.876817] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:30.877228] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-09T17:00:31.101964] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T17:00:31.111408] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-09T17:00:31.177360] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T17:00:31.183277] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-09T17:00:32.311972] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T17:00:32.319419] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-09T17:00:32.406871] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T17:00:32.418525] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-09T17:00:32.570138] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T17:00:32.598727] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-09T17:00:32.599144] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-09T17:00:32.610102] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-09T17:00:33.617408] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T17:00:33.624065] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-09T17:00:33.728344] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T17:00:33.736721] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-09T17:00:33.817522] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T17:00:33.828214] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-09T17:00:34.092964] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T17:00:34.103785] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-09T17:00:34.896734] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:00:34.903003] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-09T17:00:34.955453] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T17:00:34.962813] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-09T17:00:35.567367] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T17:00:35.578289] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-09T17:00:35.591162] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-09T17:00:35.595912] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-09T17:00:35.765670] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T17:00:35.775873] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-09T17:00:35.938772] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T17:00:35.946761] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-09T17:00:36.560231] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T17:00:36.565890] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-09T17:00:37.007840] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T17:00:37.014177] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-09T17:00:37.109185] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:00:37.120572] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-09T17:00:37.636933] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T17:00:37.642150] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-09T17:00:37.883682] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-09T17:00:37.895016] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-09T17:00:38.121968] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T17:00:38.127860] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-09T17:00:38.659120] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T17:00:38.686313] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-09T17:00:38.689021] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:00:38.696149] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-09T17:00:39.032070] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T17:00:39.041950] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-09T17:00:39.568082] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T17:00:39.570482] [INFO ] [REMOTE ] AB: Full fetch complete (44957 records). [2025-10-09T17:00:39.570582] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-09T17:00:39.989843] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-09T17:00:39.990157] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-09T17:00:39.990881] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-09T17:00:39.991040] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-09T17:00:39.992536] [DEBUG] [LOCAL ] AB: Trimmed 44957 records to 26515 (keeping 200 days of data) [2025-10-09T17:00:40.142596] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T17:00:40.171913] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-09T17:00:40.227516] [DEBUG] [LOCAL ] AB: Primary data saved (26515 records). [2025-10-09T17:00:40.228735] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T17:00:40.228836] [INFO ] [MAIN ] AB: Full history saved. [2025-10-09T17:00:40.235028] [INFO ] [MAIN ] Update Progress: 8/2373 symbols completed. AB took 14.9s. Estimated remaining: 3h 0m 44s. Rate: 13.1 symbols/min [2025-10-09T17:00:40.256574] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-09T17:00:40.405403] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:40.424774] [DEBUG] [LOCAL ] ABG: Loaded 18494 existing records from primary storage. [2025-10-09T17:00:40.425074] [INFO ] [MAIN ] ABG: Loaded 18494 existing records. [2025-10-09T17:00:40.603520] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:40.603914] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-09T17:00:40.603987] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-09T17:00:40.614908] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-09T17:00:40.631768] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-09T17:00:40.696174] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T17:00:40.750796] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-09T17:00:41.001217] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:41.001556] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-09T17:00:41.345860] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T17:00:41.356828] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-09T17:00:41.954348] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T17:00:41.958009] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-09T17:00:42.466255] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T17:00:42.477968] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-09T17:00:42.488087] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T17:00:42.491630] [INFO ] [REMOTE ] ABCB: Full fetch complete (44633 records). [2025-10-09T17:00:42.491782] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-09T17:00:42.852403] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T17:00:42.899475] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-09T17:00:42.944725] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-09T17:00:42.945918] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-09T17:00:42.956678] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-09T17:00:42.957616] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-09T17:00:42.957823] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-09T17:00:42.958309] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-09T17:00:42.960239] [DEBUG] [LOCAL ] ABCB: Trimmed 44633 records to 30682 (keeping 200 days of data) [2025-10-09T17:00:43.151949] [DEBUG] [LOCAL ] ABCB: Primary data saved (30682 records). [2025-10-09T17:00:43.152092] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-09T17:00:43.152173] [INFO ] [MAIN ] Update Progress: 9/2373 symbols completed. ABCB took 14.3s. Estimated remaining: 2h 53m 22s. Rate: 13.6 symbols/min [2025-10-09T17:00:43.329394] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:43.362894] [DEBUG] [LOCAL ] ABM: Loaded 31947 existing records from primary storage. [2025-10-09T17:00:43.363173] [INFO ] [MAIN ] ABM: Loaded 31947 existing records. [2025-10-09T17:00:43.536580] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:43.536834] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-09T17:00:43.536889] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-09T17:00:43.537130] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-09T17:00:43.537187] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-09T17:00:43.897219] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:43.907720] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T17:00:43.906891] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-09T17:00:43.912634] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-09T17:00:44.072990] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T17:00:44.086368] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-09T17:00:44.815848] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T17:00:44.829135] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-09T17:00:44.852426] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T17:00:44.857776] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-09T17:00:44.883315] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T17:00:44.891040] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-09T17:00:45.817292] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T17:00:45.823534] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-09T17:00:46.057710] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T17:00:46.069609] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-09T17:00:46.112808] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T17:00:46.119015] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-09T17:00:47.012960] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-09T17:00:47.053028] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T17:00:47.053919] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T17:00:47.051753] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-09T17:00:47.065154] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-09T17:00:47.065721] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-09T17:00:47.851938] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T17:00:47.865215] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-09T17:00:47.876914] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T17:00:47.881099] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-09T17:00:48.053560] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T17:00:48.060888] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-09T17:00:48.541684] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T17:00:48.546541] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-09T17:00:49.155056] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-09T17:00:49.166807] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-09T17:00:49.461151] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T17:00:49.468967] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-09T17:00:49.527761] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T17:00:49.533484] [INFO ] [REMOTE ] ABEV: Full fetch complete (77216 records). [2025-10-09T17:00:49.533687] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-09T17:00:49.671774] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T17:00:49.716374] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-09T17:00:49.971074] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-09T17:00:49.971155] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-09T17:00:49.971929] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-09T17:00:49.971997] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-09T17:00:49.973517] [DEBUG] [LOCAL ] ABEV: Trimmed 77216 records to 53667 (keeping 200 days of data) [2025-10-09T17:00:50.296873] [DEBUG] [LOCAL ] ABEV: Primary data saved (53667 records). [2025-10-09T17:00:50.297121] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-09T17:00:50.297306] [INFO ] [MAIN ] Update Progress: 10/2373 symbols completed. ABEV took 21.1s. Estimated remaining: 3h 4m 6s. Rate: 12.8 symbols/min [2025-10-09T17:00:50.468662] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:50.519310] [DEBUG] [LOCAL ] ABR: Loaded 51958 existing records from primary storage. [2025-10-09T17:00:50.519677] [INFO ] [MAIN ] ABR: Loaded 51958 existing records. [2025-10-09T17:00:50.685926] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T17:00:50.723243] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:50.735264] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-09T17:00:50.735763] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-09T17:00:50.737789] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T17:00:50.738086] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-09T17:00:50.736548] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-09T17:00:50.738370] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-09T17:00:50.778492] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-09T17:00:51.060470] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T17:00:51.100705] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-09T17:00:51.154136] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:51.154418] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-09T17:00:51.825285] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:00:51.834138] [INFO ] [REMOTE ] ABBV: Full fetch complete (77330 records). [2025-10-09T17:00:51.835177] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-09T17:00:51.835059] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T17:00:51.838246] [INFO ] [REMOTE ] ABG: Full fetch complete (26576 records). [2025-10-09T17:00:51.838114] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:00:51.838427] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-09T17:00:51.838587] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:00:51.838800] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:00:51.839067] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-09T17:00:51.839149] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-09T17:00:51.900281] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-09T17:00:51.956713] [DEBUG] [LOCAL ] ABBV: Deleted derivative data file. [2025-10-09T17:00:51.978821] [INFO ] [MAIN ] Update Progress: 11/2373 symbols completed. ABBV took 23.5s. Estimated remaining: 2h 53m 19s. Rate: 13.6 symbols/min [2025-10-09T17:00:52.572175] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:52.574039] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-09T17:00:52.574283] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-09T17:00:52.575335] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-09T17:00:52.575466] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-09T17:00:52.594835] [DEBUG] [LOCAL ] ABG: Trimmed 26576 records to 18588 (keeping 200 days of data) [2025-10-09T17:00:52.612500] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T17:00:52.687822] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-09T17:00:52.817844] [DEBUG] [LOCAL ] ABT: Loaded 53623 existing records from primary storage. [2025-10-09T17:00:52.820009] [INFO ] [MAIN ] ABT: Loaded 53623 existing records. [2025-10-09T17:00:52.949551] [DEBUG] [LOCAL ] ABG: Primary data saved (18588 records). [2025-10-09T17:00:52.984315] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-09T17:00:52.992907] [INFO ] [MAIN ] Update Progress: 12/2373 symbols completed. ABG took 12.8s. Estimated remaining: 2h 42m 7s. Rate: 14.6 symbols/min [2025-10-09T17:00:53.185998] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:53.229783] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-09T17:00:53.244754] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T17:00:53.242787] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-09T17:00:53.291863] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-09T17:00:53.292931] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-09T17:00:53.299124] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-09T17:00:53.481855] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:53.484277] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-09T17:00:53.484331] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-09T17:00:53.484473] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-09T17:00:53.484776] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-09T17:00:53.484868] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-09T17:00:53.495387] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-09T17:00:54.030578] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:54.051811] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-09T17:00:54.142296] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:54.158339] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-09T17:00:54.162336] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:00:54.169980] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-09T17:00:55.243385] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T17:00:55.254462] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-09T17:00:55.346027] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T17:00:55.354283] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-09T17:00:55.734715] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T17:00:55.742089] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-09T17:00:55.857252] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T17:00:55.868109] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-09T17:00:56.521959] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T17:00:56.528698] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-09T17:00:56.713550] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T17:00:56.723384] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-09T17:00:57.221183] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T17:00:57.229388] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-09T17:00:57.249087] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T17:00:57.254192] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-09T17:00:57.547053] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:00:57.561454] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-09T17:00:58.178412] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T17:00:58.181806] [INFO ] [REMOTE ] ABM: Full fetch complete (44830 records). [2025-10-09T17:00:58.181948] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-09T17:00:58.710770] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T17:00:58.712530] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-09T17:00:58.713307] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-09T17:00:58.723586] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-09T17:00:58.730333] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-09T17:00:58.731225] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-09T17:00:58.731517] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-09T17:00:58.731811] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-09T17:00:58.734452] [DEBUG] [LOCAL ] ABM: Trimmed 44830 records to 32168 (keeping 200 days of data) [2025-10-09T17:00:58.951908] [DEBUG] [LOCAL ] ABM: Primary data saved (32168 records). [2025-10-09T17:00:58.952053] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-09T17:00:58.952145] [INFO ] [MAIN ] Update Progress: 13/2373 symbols completed. ABM took 15.8s. Estimated remaining: 2h 47m 37s. Rate: 14.1 symbols/min [2025-10-09T17:00:59.166202] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:00:59.213123] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T17:00:59.224450] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-09T17:00:59.238541] [DEBUG] [LOCAL ] ACCO: Loaded 37076 existing records from primary storage. [2025-10-09T17:00:59.238905] [INFO ] [MAIN ] ACCO: Loaded 37076 existing records. [2025-10-09T17:00:59.424828] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:00:59.425084] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-09T17:00:59.425143] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-09T17:00:59.425436] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-09T17:00:59.425495] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-09T17:00:59.794191] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:00:59.794598] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-09T17:00:59.913671] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T17:00:59.920229] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-09T17:01:00.793846] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-09T17:01:00.805096] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-09T17:01:00.923774] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T17:01:00.931953] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-09T17:01:01.105043] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T17:01:01.111040] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-09T17:01:01.291415] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-09T17:01:01.302575] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-09T17:01:01.938885] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T17:01:01.944342] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-09T17:01:02.223600] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T17:01:02.233927] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-09T17:01:02.377523] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T17:01:02.396708] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-09T17:01:02.972797] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T17:01:03.014510] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T17:01:03.170949] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:01:03.196679] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-09T17:01:03.996723] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-09T17:01:04.129142] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T17:01:04.319120] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T17:01:04.796727] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-09T17:01:05.596756] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-09T17:01:05.941392] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T17:01:06.396693] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-09T17:01:06.560913] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:01:07.024076] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:01:07.196742] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-09T17:01:07.441514] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T17:01:07.996751] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-09T17:01:08.796749] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-09T17:01:08.881606] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:01:09.382075] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:01:09.596739] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-09T17:01:10.396802] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-09T17:01:10.583517] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T17:01:10.922027] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:01:11.196737] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-09T17:01:11.534901] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T17:01:11.996729] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-09T17:01:12.796692] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-09T17:01:12.926372] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T17:01:13.596754] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-09T17:01:13.838759] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T17:01:14.239600] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:01:14.396697] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-09T17:01:14.671338] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T17:01:14.673684] [INFO ] [REMOTE ] ACA: Full fetch complete (34186 records). [2025-10-09T17:01:14.673801] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-09T17:01:15.061109] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-09T17:01:15.061216] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-09T17:01:15.062672] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-09T17:01:15.062757] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-09T17:01:15.063821] [DEBUG] [LOCAL ] ACA: Trimmed 34186 records to 23314 (keeping 200 days of data) [2025-10-09T17:01:15.199150] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-09T17:01:15.213392] [DEBUG] [LOCAL ] ACA: Primary data saved (23314 records). [2025-10-09T17:01:15.213504] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-09T17:01:15.213607] [INFO ] [MAIN ] Update Progress: 14/2373 symbols completed. ACA took 22.2s. Estimated remaining: 3h 21m 15s. Rate: 11.7 symbols/min [2025-10-09T17:01:15.384353] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:15.384552] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-09T17:01:15.384591] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-09T17:01:15.384735] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-09T17:01:15.384782] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-09T17:01:15.384825] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-09T17:01:15.384860] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-09T17:01:15.758340] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:15.996707] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-09T17:01:16.334828] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-09T17:01:16.339723] [INFO ] [REMOTE ] ABR: Full fetch complete (75243 records). [2025-10-09T17:01:16.339874] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-09T17:01:16.512739] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T17:01:16.799161] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-09T17:01:16.798953] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-09T17:01:16.800062] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-09T17:01:16.801002] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-09T17:01:16.801172] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-09T17:01:16.802688] [DEBUG] [LOCAL ] ABR: Trimmed 75243 records to 52338 (keeping 200 days of data) [2025-10-09T17:01:17.131170] [DEBUG] [LOCAL ] ABR: Primary data saved (52338 records). [2025-10-09T17:01:17.131329] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-09T17:01:17.131494] [INFO ] [MAIN ] Update Progress: 15/2373 symbols completed. ABR took 26.8s. Estimated remaining: 3h 12m 47s. Rate: 12.2 symbols/min [2025-10-09T17:01:17.299227] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:17.348518] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-09T17:01:17.348873] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-09T17:01:17.527944] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:01:17.528212] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-09T17:01:17.528376] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-09T17:01:17.528722] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-09T17:01:17.528883] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-09T17:01:17.596690] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-09T17:01:17.919797] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-09T17:01:17.923494] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:17.950673] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T17:01:18.396769] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-09T17:01:18.778203] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T17:01:19.196830] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-09T17:01:19.996745] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-09T17:01:20.283457] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T17:01:20.706228] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T17:01:20.710765] [INFO ] [REMOTE ] ABT: Full fetch complete (77595 records). [2025-10-09T17:01:20.710878] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-09T17:01:20.806985] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-09T17:01:21.145235] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-09T17:01:21.160320] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-09T17:01:21.160422] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-09T17:01:21.161341] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-09T17:01:21.161418] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-09T17:01:21.163191] [DEBUG] [LOCAL ] ABT: Trimmed 77595 records to 54012 (keeping 200 days of data) [2025-10-09T17:01:21.500490] [DEBUG] [LOCAL ] ABT: Primary data saved (54012 records). [2025-10-09T17:01:21.500635] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-09T17:01:21.500766] [INFO ] [MAIN ] Update Progress: 16/2373 symbols completed. ABT took 29.5s. Estimated remaining: 3h 11m 23s. Rate: 12.3 symbols/min [2025-10-09T17:01:21.601959] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-09T17:01:21.677313] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:21.677508] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-10-09T17:01:21.677564] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-10-09T17:01:21.677698] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-09T17:01:21.677755] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-09T17:01:21.677852] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-09T17:01:21.677949] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-09T17:01:22.041872] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:22.113241] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T17:01:22.396752] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-09T17:01:22.965494] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:01:23.196781] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-09T17:01:23.996725] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-09T17:01:24.148719] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T17:01:24.796729] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-09T17:01:25.252029] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T17:01:25.256581] [INFO ] [REMOTE ] ACCO: Full fetch complete (53713 records). [2025-10-09T17:01:25.256757] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-09T17:01:25.257517] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:01:25.257613] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:01:25.257694] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:01:25.257750] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-09T17:01:25.257830] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-09T17:01:25.257882] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-09T17:01:25.258142] [DEBUG] [LOCAL ] ACCO: Deleted derivative data file. [2025-10-09T17:01:25.258270] [INFO ] [MAIN ] Update Progress: 17/2373 symbols completed. ACCO took 26.3s. Estimated remaining: 3h 8m 44s. Rate: 12.5 symbols/min [2025-10-09T17:01:25.441953] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:25.442166] [DEBUG] [LOCAL ] ACM: No existing data file found in primary storage. [2025-10-09T17:01:25.442221] [WARN ] [MAIN ] ACM: No existing data found, performing full refresh instead. [2025-10-09T17:01:25.442333] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-09T17:01:25.442375] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-09T17:01:25.442417] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-09T17:01:25.442451] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-09T17:01:25.618533] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-09T17:01:25.806176] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:25.836891] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-09T17:01:26.020254] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T17:01:26.396732] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-09T17:01:27.196724] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-09T17:01:27.454228] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T17:01:27.765975] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T17:01:27.996720] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-09T17:01:28.796738] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-09T17:01:29.163808] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T17:01:29.463414] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-09T17:01:29.596670] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-09T17:01:30.097680] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T17:01:30.396800] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-09T17:01:31.196701] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-09T17:01:31.266928] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T17:01:31.996767] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-09T17:01:32.327380] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-09T17:01:32.774293] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T17:01:32.796672] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-09T17:01:33.466280] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:01:33.596676] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-09T17:01:34.402952] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-09T17:01:34.421373] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T17:01:34.643327] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T17:01:35.196736] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-09T17:01:35.996781] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-09T17:01:36.306285] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T17:01:36.796707] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-09T17:01:36.911812] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-09T17:01:37.116068] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T17:01:37.596790] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-09T17:01:38.091539] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T17:01:38.396779] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-09T17:01:39.196777] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-09T17:01:39.996708] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-09T17:01:40.044887] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T17:01:40.091878] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-09T17:01:40.796766] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-09T17:01:40.921883] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T17:01:40.963143] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T17:01:41.596740] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-09T17:01:42.396745] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-09T17:01:43.196689] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-09T17:01:43.452665] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T17:01:43.510455] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-09T17:01:43.746829] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T17:01:43.996683] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-09T17:01:44.290096] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T17:01:44.292537] [INFO ] [REMOTE ] ACEL: Full fetch complete (38724 records). [2025-10-09T17:01:44.292609] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-09T17:01:44.672879] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-09T17:01:44.672984] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-09T17:01:44.673456] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-09T17:01:44.673500] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-09T17:01:44.674548] [DEBUG] [LOCAL ] ACEL: Trimmed 38724 records to 26864 (keeping 200 days of data) [2025-10-09T17:01:44.796890] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-09T17:01:44.872070] [DEBUG] [LOCAL ] ACEL: Primary data saved (26864 records). [2025-10-09T17:01:44.872231] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-09T17:01:44.872344] [INFO ] [MAIN ] Update Progress: 18/2373 symbols completed. ACEL took 29.7s. Estimated remaining: 3h 40m 56s. Rate: 10.7 symbols/min [2025-10-09T17:01:45.129116] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:45.216560] [DEBUG] [LOCAL ] ACN: Loaded 53428 existing records from primary storage. [2025-10-09T17:01:45.217457] [INFO ] [MAIN ] ACN: Loaded 53428 existing records. [2025-10-09T17:01:45.547731] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:01:45.548110] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-09T17:01:45.548202] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-09T17:01:45.548829] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-09T17:01:45.548894] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-09T17:01:45.599796] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-09T17:01:45.986124] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:46.015944] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T17:01:46.396772] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-09T17:01:46.520748] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T17:01:47.196761] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-09T17:01:47.786494] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-09T17:01:47.996754] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-09T17:01:48.225704] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T17:01:48.765168] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:01:48.796678] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-09T17:01:49.008154] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:01:49.596712] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-09T17:01:50.396686] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-09T17:01:50.582253] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T17:01:51.196794] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-09T17:01:51.634079] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T17:01:51.764896] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T17:01:51.996694] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-09T17:01:52.807317] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-09T17:01:52.809735] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T17:01:53.596682] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-09T17:01:53.710686] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T17:01:54.117300] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T17:01:54.396710] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-09T17:01:55.056738] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T17:01:55.060425] [INFO ] [REMOTE ] ACM: Full fetch complete (62749 records). [2025-10-09T17:01:55.060530] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-09T17:01:55.201825] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-09T17:01:55.457583] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-09T17:01:55.457712] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-09T17:01:55.458391] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-09T17:01:55.458457] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-09T17:01:55.459827] [DEBUG] [LOCAL ] ACM: Trimmed 62749 records to 43290 (keeping 200 days of data) [2025-10-09T17:01:55.730544] [DEBUG] [LOCAL ] ACM: Primary data saved (43290 records). [2025-10-09T17:01:55.730709] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-09T17:01:55.730795] [INFO ] [MAIN ] Update Progress: 19/2373 symbols completed. ACM took 30.5s. Estimated remaining: 3h 51m 38s. Rate: 10.2 symbols/min [2025-10-09T17:01:55.913765] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:01:55.946521] [DEBUG] [LOCAL ] ACP: Loaded 31022 existing records from primary storage. [2025-10-09T17:01:55.947085] [INFO ] [MAIN ] ACP: Loaded 31022 existing records. [2025-10-09T17:01:56.005675] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-09T17:01:56.146605] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:01:56.146886] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-09T17:01:56.146939] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-09T17:01:56.147376] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-09T17:01:56.147436] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-09T17:01:56.531925] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:01:56.578257] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-09T17:01:56.796745] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-09T17:01:57.020356] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T17:01:57.596720] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-09T17:01:58.223635] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:01:58.311730] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-09T17:01:58.396708] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-09T17:01:59.196686] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-09T17:01:59.275390] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:01:59.281436] [INFO ] [REMOTE ] ACI: Full fetch complete (77042 records). [2025-10-09T17:01:59.281731] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-09T17:01:59.695194] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-09T17:01:59.695359] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-09T17:01:59.696223] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-09T17:01:59.696320] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-09T17:01:59.698124] [DEBUG] [LOCAL ] ACI: Trimmed 77042 records to 53644 (keeping 200 days of data) [2025-10-09T17:01:59.929335] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T17:02:00.005924] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-09T17:02:00.052811] [DEBUG] [LOCAL ] ACI: Primary data saved (53644 records). [2025-10-09T17:02:00.052957] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-09T17:02:00.053032] [INFO ] [MAIN ] Update Progress: 20/2373 symbols completed. ACI took 38.6s. Estimated remaining: 3h 48m 26s. Rate: 10.3 symbols/min [2025-10-09T17:02:00.222159] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:00.228949] [DEBUG] [LOCAL ] ACR: Loaded 5619 existing records from primary storage. [2025-10-09T17:02:00.229101] [INFO ] [MAIN ] ACR: Loaded 5619 existing records. [2025-10-09T17:02:00.410946] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:02:00.411186] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-09T17:02:00.411235] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-09T17:02:00.411423] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-09T17:02:00.411481] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-09T17:02:00.770159] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:00.796702] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-09T17:02:01.159208] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T17:02:01.482159] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T17:02:01.556942] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-09T17:02:01.562090] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-09T17:02:01.562238] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-09T17:02:01.601858] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-09T17:02:02.043372] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-09T17:02:02.043483] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-09T17:02:02.044359] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-09T17:02:02.044429] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-09T17:02:02.046079] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54208 (keeping 200 days of data) [2025-10-09T17:02:02.381087] [DEBUG] [LOCAL ] ACHR: Primary data saved (54208 records). [2025-10-09T17:02:02.381233] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-09T17:02:02.381316] [INFO ] [MAIN ] Update Progress: 21/2373 symbols completed. ACHR took 45.2s. Estimated remaining: 3h 41m 49s. Rate: 10.6 symbols/min [2025-10-09T17:02:02.401836] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-09T17:02:02.551955] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:02.586351] [DEBUG] [LOCAL ] ACRE: Loaded 33676 existing records from primary storage. [2025-10-09T17:02:02.586670] [INFO ] [MAIN ] ACRE: Loaded 33676 existing records. [2025-10-09T17:02:02.759427] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:02:02.759692] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-09T17:02:02.759749] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-09T17:02:02.759976] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-09T17:02:02.760032] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-09T17:02:03.105535] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:03.196672] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-09T17:02:03.805743] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-09T17:02:03.851049] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T17:02:03.996694] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-09T17:02:04.384820] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T17:02:04.796730] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-09T17:02:05.120068] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T17:02:05.170201] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-09T17:02:05.596781] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-09T17:02:06.396686] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-09T17:02:06.846491] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T17:02:07.196731] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-09T17:02:07.826850] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T17:02:07.992464] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T17:02:08.001110] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-09T17:02:08.760144] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T17:02:08.796722] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-09T17:02:09.356126] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T17:02:09.596731] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-09T17:02:10.346687] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T17:02:10.396691] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-09T17:02:11.196731] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-09T17:02:11.738305] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T17:02:11.996678] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-09T17:02:12.796699] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-09T17:02:12.867178] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T17:02:13.039985] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T17:02:13.596764] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-09T17:02:13.968675] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-09T17:02:14.176067] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T17:02:14.396765] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-09T17:02:15.196791] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-09T17:02:15.850102] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T17:02:15.996722] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-09T17:02:16.796774] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-09T17:02:17.165358] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T17:02:17.389459] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-09T17:02:17.532673] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T17:02:17.596674] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-09T17:02:18.396738] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-09T17:02:18.719780] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T17:02:19.196723] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-09T17:02:19.996837] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-09T17:02:20.490784] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T17:02:20.740193] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T17:02:20.796679] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-09T17:02:21.120162] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T17:02:21.123438] [INFO ] [REMOTE ] ACP: Full fetch complete (46494 records). [2025-10-09T17:02:21.123711] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-09T17:02:21.125992] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:02:21.126222] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:02:21.126291] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:02:21.126371] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-09T17:02:21.126465] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-09T17:02:21.126536] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-09T17:02:21.126844] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-10-09T17:02:21.126991] [INFO ] [MAIN ] Update Progress: 22/2373 symbols completed. ACP took 25.4s. Estimated remaining: 4h 5m 2s. Rate: 9.6 symbols/min [2025-10-09T17:02:21.308935] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:21.309141] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-09T17:02:21.309181] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-09T17:02:21.309293] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-09T17:02:21.309336] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-09T17:02:21.309379] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-09T17:02:21.309413] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-09T17:02:21.604966] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-09T17:02:21.690388] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:22.137638] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T17:02:22.224135] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T17:02:22.396714] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-09T17:02:23.196729] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-09T17:02:23.555777] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T17:02:23.921104] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T17:02:23.996731] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-09T17:02:24.488767] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T17:02:24.489666] [INFO ] [REMOTE ] ACR: Full fetch complete (8562 records). [2025-10-09T17:02:24.489738] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-09T17:02:24.801896] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-09T17:02:24.917396] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-09T17:02:24.917498] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-09T17:02:24.917744] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-09T17:02:24.917809] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-09T17:02:24.918304] [DEBUG] [LOCAL ] ACR: Trimmed 8562 records to 5643 (keeping 200 days of data) [2025-10-09T17:02:24.956026] [DEBUG] [LOCAL ] ACR: Primary data saved (5643 records). [2025-10-09T17:02:24.956189] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-09T17:02:24.956290] [INFO ] [MAIN ] Update Progress: 23/2373 symbols completed. ACR took 24.9s. Estimated remaining: 4h 0m 48s. Rate: 9.8 symbols/min [2025-10-09T17:02:25.127792] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:25.128022] [DEBUG] [LOCAL ] ACVA: No existing data file found in primary storage. [2025-10-09T17:02:25.128079] [WARN ] [MAIN ] ACVA: No existing data found, performing full refresh instead. [2025-10-09T17:02:25.128191] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-09T17:02:25.128234] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-09T17:02:25.128277] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-09T17:02:25.128310] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-09T17:02:25.478188] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:25.558872] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T17:02:25.596700] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-09T17:02:26.396731] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-09T17:02:26.757797] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T17:02:27.196716] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-09T17:02:27.439688] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T17:02:27.996717] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-09T17:02:28.150436] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T17:02:28.393816] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T17:02:28.796762] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-09T17:02:29.373865] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T17:02:29.596707] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-09T17:02:30.396734] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-09T17:02:31.007887] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T17:02:31.196727] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-09T17:02:31.996747] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-09T17:02:32.050028] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T17:02:32.550118] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:02:32.796730] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-09T17:02:33.596750] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-09T17:02:33.986756] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T17:02:34.396693] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-09T17:02:34.468558] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:02:34.500896] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T17:02:35.196716] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-09T17:02:35.996697] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-09T17:02:36.008057] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T17:02:36.374703] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T17:02:36.796725] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-09T17:02:37.143982] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T17:02:37.147058] [INFO ] [REMOTE ] ACRE: Full fetch complete (50218 records). [2025-10-09T17:02:37.147216] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-09T17:02:37.552543] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-09T17:02:37.552672] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-09T17:02:37.553282] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-09T17:02:37.553329] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-09T17:02:37.554554] [DEBUG] [LOCAL ] ACRE: Trimmed 50218 records to 33893 (keeping 200 days of data) [2025-10-09T17:02:37.634705] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-09T17:02:37.830948] [DEBUG] [LOCAL ] ACRE: Primary data saved (33893 records). [2025-10-09T17:02:37.831127] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-09T17:02:37.831220] [INFO ] [MAIN ] Update Progress: 24/2373 symbols completed. ACRE took 35.4s. Estimated remaining: 4h 11m 40s. Rate: 9.3 symbols/min [2025-10-09T17:02:38.095390] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:38.097833] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-09T17:02:38.097902] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-09T17:02:38.098120] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-09T17:02:38.098176] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-09T17:02:38.098228] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-09T17:02:38.098269] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-09T17:02:38.299212] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T17:02:38.401839] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-09T17:02:38.569237] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:38.602378] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T17:02:39.084833] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T17:02:39.196699] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-09T17:02:39.996703] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-09T17:02:40.186424] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:02:40.186746] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-09T17:02:40.186855] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:02:40.186941] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-09T17:02:40.187024] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:02:40.187116] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-09T17:02:40.187195] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-09T17:02:40.187236] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-09T17:02:40.187278] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-09T17:02:40.187338] [INFO ] [MAIN ] Update Progress: 25/2373 symbols completed. AD took 2.4s. Estimated remaining: 4h 5m 11s. Rate: 9.6 symbols/min [2025-10-09T17:02:40.363545] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:40.407573] [DEBUG] [LOCAL ] ADC: Loaded 46168 existing records from primary storage. [2025-10-09T17:02:40.407886] [INFO ] [MAIN ] ADC: Loaded 46168 existing records. [2025-10-09T17:02:40.601445] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:02:40.601728] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-09T17:02:40.601803] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-09T17:02:40.602221] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-09T17:02:40.602282] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-09T17:02:40.809387] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-09T17:02:40.999712] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T17:02:40.998263] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:41.459942] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T17:02:41.596683] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-09T17:02:42.396739] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-09T17:02:43.153078] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:02:43.196668] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-09T17:02:43.996702] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-09T17:02:44.249926] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T17:02:44.254955] [INFO ] [REMOTE ] ACN: Full fetch complete (77152 records). [2025-10-09T17:02:44.255080] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-09T17:02:44.670268] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-09T17:02:44.670459] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-09T17:02:44.671295] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-09T17:02:44.674634] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-09T17:02:44.676759] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T17:02:44.680302] [DEBUG] [LOCAL ] ACN: Trimmed 77152 records to 53818 (keeping 200 days of data) [2025-10-09T17:02:44.798937] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-09T17:02:44.823517] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T17:02:45.071739] [DEBUG] [LOCAL ] ACN: Primary data saved (53818 records). [2025-10-09T17:02:45.071882] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-09T17:02:45.073620] [INFO ] [MAIN ] Update Progress: 26/2373 symbols completed. ACN took 1m 0s. Estimated remaining: 4h 3m 0s. Rate: 9.7 symbols/min [2025-10-09T17:02:45.270036] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:45.305787] [DEBUG] [LOCAL ] ADCT: Loaded 35096 existing records from primary storage. [2025-10-09T17:02:45.306054] [INFO ] [MAIN ] ADCT: Loaded 35096 existing records. [2025-10-09T17:02:45.484625] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:02:45.484853] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-09T17:02:45.484898] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-09T17:02:45.485124] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-09T17:02:45.485181] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-09T17:02:45.601894] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-09T17:02:45.886080] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:45.984535] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T17:02:46.396749] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-09T17:02:47.165214] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T17:02:47.196717] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-09T17:02:47.996720] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-09T17:02:48.122571] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T17:02:48.529240] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T17:02:48.800154] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-09T17:02:48.803203] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:02:49.596736] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-09T17:02:50.388358] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T17:02:50.397997] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-09T17:02:51.196720] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-09T17:02:51.366196] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T17:02:51.463415] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:02:51.919635] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:02:51.921385] [INFO ] [REMOTE ] ACV: Full fetch complete (10290 records). [2025-10-09T17:02:51.921460] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-09T17:02:52.001881] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-09T17:02:52.309216] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-09T17:02:52.309293] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-09T17:02:52.309473] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-09T17:02:52.309512] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-09T17:02:52.309960] [DEBUG] [LOCAL ] ACV: Trimmed 10290 records to 7732 (keeping 200 days of data) [2025-10-09T17:02:52.356018] [DEBUG] [LOCAL ] ACV: Primary data saved (7732 records). [2025-10-09T17:02:52.356145] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-09T17:02:52.356216] [INFO ] [MAIN ] Update Progress: 27/2373 symbols completed. ACV took 31.2s. Estimated remaining: 4h 4m 27s. Rate: 9.6 symbols/min [2025-10-09T17:02:52.524449] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:02:52.577423] [DEBUG] [LOCAL ] ADM: Loaded 53388 existing records from primary storage. [2025-10-09T17:02:52.577763] [INFO ] [MAIN ] ADM: Loaded 53388 existing records. [2025-10-09T17:02:52.757513] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:02:52.757779] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-09T17:02:52.757828] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-09T17:02:52.758085] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-09T17:02:52.758142] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-09T17:02:52.801987] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-09T17:02:53.126936] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:02:53.548192] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T17:02:53.596710] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-09T17:02:54.362122] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T17:02:54.396746] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-09T17:02:55.196722] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-09T17:02:55.250413] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T17:02:55.915915] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:02:55.996676] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-09T17:02:56.652835] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T17:02:56.796725] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-09T17:02:57.455350] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:02:57.596694] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-09T17:02:58.162284] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T17:02:58.396768] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-09T17:02:58.832589] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T17:02:59.196790] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-09T17:02:59.996698] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-09T17:03:00.144623] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T17:03:00.382520] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T17:03:00.796765] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-09T17:03:01.596794] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-09T17:03:01.801052] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:03:01.805434] [INFO ] [REMOTE ] ACVA: Full fetch complete (70552 records). [2025-10-09T17:03:01.805847] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-09T17:03:02.267325] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:03:02.267579] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-09T17:03:02.273738] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-09T17:03:02.274975] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-09T17:03:02.275395] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-09T17:03:02.276969] [DEBUG] [LOCAL ] ACVA: Trimmed 70552 records to 49581 (keeping 200 days of data) [2025-10-09T17:03:02.396761] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-09T17:03:02.583546] [DEBUG] [LOCAL ] ACVA: Primary data saved (49581 records). [2025-10-09T17:03:02.583716] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-09T17:03:02.583800] [INFO ] [MAIN ] Update Progress: 28/2373 symbols completed. ACVA took 37.6s. Estimated remaining: 4h 9m 54s. Rate: 9.4 symbols/min [2025-10-09T17:03:02.761278] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:02.803342] [DEBUG] [LOCAL ] ADNT: Loaded 47191 existing records from primary storage. [2025-10-09T17:03:02.803694] [INFO ] [MAIN ] ADNT: Loaded 47191 existing records. [2025-10-09T17:03:02.983783] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:02.984216] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-09T17:03:02.984371] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-09T17:03:02.984775] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-09T17:03:02.984835] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-09T17:03:03.201803] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-09T17:03:03.358562] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:03.388328] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T17:03:03.729603] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T17:03:03.996698] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-09T17:03:04.796795] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-09T17:03:04.987318] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T17:03:05.596780] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-09T17:03:06.036371] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-09T17:03:06.401795] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-09T17:03:06.415355] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T17:03:07.160021] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:03:07.196733] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-09T17:03:07.942396] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T17:03:07.946875] [INFO ] [REMOTE ] ADC: Full fetch complete (66204 records). [2025-10-09T17:03:07.947050] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-09T17:03:08.005182] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-09T17:03:08.372015] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-09T17:03:08.372158] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-09T17:03:08.372893] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-09T17:03:08.372960] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-09T17:03:08.374333] [DEBUG] [LOCAL ] ADC: Trimmed 66204 records to 46495 (keeping 200 days of data) [2025-10-09T17:03:08.690981] [DEBUG] [LOCAL ] ADC: Primary data saved (46495 records). [2025-10-09T17:03:08.691365] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-09T17:03:08.691692] [INFO ] [MAIN ] Update Progress: 29/2373 symbols completed. ADC took 28.5s. Estimated remaining: 4h 9m 24s. Rate: 9.4 symbols/min [2025-10-09T17:03:08.801784] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-09T17:03:08.902360] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:08.915676] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:03:08.974411] [DEBUG] [LOCAL ] ADT: Loaded 53446 existing records from primary storage. [2025-10-09T17:03:08.974809] [INFO ] [MAIN ] ADT: Loaded 53446 existing records. [2025-10-09T17:03:09.165973] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:09.166208] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-09T17:03:09.166254] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-09T17:03:09.166485] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-09T17:03:09.166542] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-09T17:03:09.567531] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:09.591542] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T17:03:09.599331] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-09T17:03:10.396700] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-09T17:03:10.720761] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T17:03:11.145261] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:03:11.196682] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-09T17:03:11.300498] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T17:03:11.996738] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-09T17:03:12.769269] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T17:03:12.796671] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-09T17:03:13.010560] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T17:03:13.596714] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-09T17:03:14.393578] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T17:03:14.397372] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-09T17:03:14.624478] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T17:03:15.196724] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-09T17:03:15.996733] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-09T17:03:16.065247] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:03:16.796723] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-09T17:03:17.195971] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T17:03:17.596690] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-09T17:03:17.709635] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T17:03:18.277506] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T17:03:18.396746] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-09T17:03:18.817286] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T17:03:19.196718] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-09T17:03:19.837178] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T17:03:19.842418] [INFO ] [REMOTE ] ADCT: Full fetch complete (51448 records). [2025-10-09T17:03:19.842513] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-09T17:03:20.001873] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-09T17:03:20.246061] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-09T17:03:20.246146] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-09T17:03:20.246740] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-09T17:03:20.246827] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-09T17:03:20.248186] [DEBUG] [LOCAL ] ADCT: Trimmed 51448 records to 35427 (keeping 200 days of data) [2025-10-09T17:03:20.470352] [DEBUG] [LOCAL ] ADCT: Primary data saved (35427 records). [2025-10-09T17:03:20.470736] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-09T17:03:20.472276] [INFO ] [MAIN ] Update Progress: 30/2373 symbols completed. ADCT took 35.4s. Estimated remaining: 4h 16m 19s. Rate: 9.1 symbols/min [2025-10-09T17:03:20.668845] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:20.697568] [DEBUG] [LOCAL ] ADX: Loaded 27572 existing records from primary storage. [2025-10-09T17:03:20.698066] [INFO ] [MAIN ] ADX: Loaded 27572 existing records. [2025-10-09T17:03:20.807580] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-09T17:03:20.895796] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:20.896283] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-09T17:03:20.896342] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-09T17:03:20.908084] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-09T17:03:20.928456] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-09T17:03:21.012156] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:03:21.312267] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:21.596773] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-09T17:03:21.632992] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T17:03:22.396732] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-09T17:03:22.430028] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T17:03:23.198400] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:03:23.196725] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-09T17:03:23.866757] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T17:03:23.996791] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-09T17:03:24.796695] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-09T17:03:24.890819] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T17:03:25.423335] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T17:03:25.596730] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-09T17:03:25.792754] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T17:03:26.396732] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-09T17:03:27.059455] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:03:27.196708] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-09T17:03:27.916579] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T17:03:27.996687] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-09T17:03:28.639521] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T17:03:28.796733] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-09T17:03:29.596686] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-09T17:03:29.664518] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T17:03:30.396804] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-09T17:03:30.576680] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T17:03:31.196720] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-09T17:03:31.471323] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T17:03:31.492004] [INFO ] [REMOTE ] ADM: Full fetch complete (77262 records). [2025-10-09T17:03:31.494349] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-09T17:03:31.496095] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T17:03:31.907453] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-09T17:03:31.907546] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-09T17:03:31.908315] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-09T17:03:31.908385] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-09T17:03:31.909975] [DEBUG] [LOCAL ] ADM: Trimmed 77262 records to 53778 (keeping 200 days of data) [2025-10-09T17:03:32.000207] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-09T17:03:32.239186] [DEBUG] [LOCAL ] ADM: Primary data saved (53778 records). [2025-10-09T17:03:32.239336] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-09T17:03:32.240355] [INFO ] [MAIN ] Update Progress: 31/2373 symbols completed. ADM took 39.9s. Estimated remaining: 4h 22m 46s. Rate: 8.9 symbols/min [2025-10-09T17:03:32.419477] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:32.419690] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-10-09T17:03:32.419747] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-10-09T17:03:32.419871] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-09T17:03:32.419942] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-09T17:03:32.420008] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-09T17:03:32.420064] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-09T17:03:32.795718] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:32.796665] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-09T17:03:33.094088] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T17:03:33.596690] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-09T17:03:33.649057] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T17:03:34.256115] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T17:03:34.396734] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-09T17:03:35.064872] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:03:35.069839] [INFO ] [REMOTE ] ADT: Full fetch complete (77184 records). [2025-10-09T17:03:35.069994] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-09T17:03:35.201912] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-09T17:03:35.510550] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-09T17:03:35.510920] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-09T17:03:35.522090] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-09T17:03:35.529721] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-09T17:03:35.530499] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T17:03:35.538913] [DEBUG] [LOCAL ] ADT: Trimmed 77184 records to 53834 (keeping 200 days of data) [2025-10-09T17:03:35.861944] [DEBUG] [LOCAL ] ADT: Primary data saved (53834 records). [2025-10-09T17:03:35.862098] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-09T17:03:35.862194] [INFO ] [MAIN ] Update Progress: 32/2373 symbols completed. ADT took 27.2s. Estimated remaining: 4h 18m 52s. Rate: 9.0 symbols/min [2025-10-09T17:03:36.006941] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-09T17:03:36.041442] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:36.053093] [DEBUG] [LOCAL ] AEFC: Loaded 8446 existing records from primary storage. [2025-10-09T17:03:36.053411] [INFO ] [MAIN ] AEFC: Loaded 8446 existing records. [2025-10-09T17:03:36.229945] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:36.230170] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-09T17:03:36.230219] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-09T17:03:36.230421] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-09T17:03:36.230482] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-09T17:03:36.621596] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:36.796682] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-09T17:03:36.948522] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T17:03:37.492303] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T17:03:37.506112] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T17:03:37.596707] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-09T17:03:38.341490] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T17:03:38.396757] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-09T17:03:39.196759] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-09T17:03:39.577545] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T17:03:39.582361] [INFO ] [REMOTE ] ADNT: Full fetch complete (67947 records). [2025-10-09T17:03:39.582477] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-09T17:03:39.907050] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T17:03:39.997460] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-09T17:03:39.997324] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-09T17:03:39.997801] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-09T17:03:39.999772] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-09T17:03:39.999846] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-09T17:03:40.001376] [DEBUG] [LOCAL ] ADNT: Trimmed 67947 records to 47491 (keeping 200 days of data) [2025-10-09T17:03:40.285246] [DEBUG] [LOCAL ] ADNT: Primary data saved (47491 records). [2025-10-09T17:03:40.285386] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-09T17:03:40.285470] [INFO ] [MAIN ] Update Progress: 33/2373 symbols completed. ADNT took 37.7s. Estimated remaining: 4h 16m 8s. Rate: 9.1 symbols/min [2025-10-09T17:03:40.464394] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:40.464668] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-10-09T17:03:40.464726] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-10-09T17:03:40.464842] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-09T17:03:40.464884] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-09T17:03:40.464925] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-10-09T17:03:40.464958] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-09T17:03:40.803121] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-09T17:03:40.827549] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:40.835482] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T17:03:41.596711] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-09T17:03:42.189043] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:03:42.371607] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T17:03:42.396690] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-09T17:03:43.072439] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T17:03:43.196751] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-09T17:03:43.996750] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-09T17:03:44.278708] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T17:03:44.477323] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T17:03:44.796756] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-09T17:03:45.596741] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-09T17:03:46.390277] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T17:03:46.396687] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-09T17:03:47.196686] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-09T17:03:47.460066] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T17:03:47.759983] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T17:03:47.996773] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-09T17:03:48.652302] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:03:48.796734] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-09T17:03:49.372381] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T17:03:49.561102] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T17:03:49.596709] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-09T17:03:50.159180] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T17:03:50.396716] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-09T17:03:50.990338] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T17:03:51.196739] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-09T17:03:51.996717] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-09T17:03:52.441139] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T17:03:52.796728] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-09T17:03:53.230424] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:03:53.418250] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T17:03:53.419269] [INFO ] [REMOTE ] AEFC: Full fetch complete (11945 records). [2025-10-09T17:03:53.419340] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-09T17:03:53.602497] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-09T17:03:53.827847] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-09T17:03:53.827924] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-09T17:03:53.828174] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-09T17:03:53.828219] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-09T17:03:53.828688] [DEBUG] [LOCAL ] AEFC: Trimmed 11945 records to 8470 (keeping 200 days of data) [2025-10-09T17:03:53.879632] [DEBUG] [LOCAL ] AEFC: Primary data saved (8470 records). [2025-10-09T17:03:53.879789] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-09T17:03:53.879869] [INFO ] [MAIN ] Update Progress: 34/2373 symbols completed. AEFC took 18.0s. Estimated remaining: 4h 24m 5s. Rate: 8.9 symbols/min [2025-10-09T17:03:54.042886] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:54.094842] [DEBUG] [LOCAL ] AEM: Loaded 53466 existing records from primary storage. [2025-10-09T17:03:54.095183] [INFO ] [MAIN ] AEM: Loaded 53466 existing records. [2025-10-09T17:03:54.272263] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:54.272530] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-09T17:03:54.272577] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-09T17:03:54.272937] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-09T17:03:54.273010] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-09T17:03:54.408858] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-09T17:03:54.625104] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:54.641331] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T17:03:55.196715] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-09T17:03:55.996749] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-09T17:03:56.262536] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T17:03:56.796706] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-09T17:03:56.892232] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:03:56.964991] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T17:03:56.967524] [INFO ] [REMOTE ] ADX: Full fetch complete (41858 records). [2025-10-09T17:03:56.967617] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-09T17:03:57.342956] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-09T17:03:57.343032] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-09T17:03:57.343463] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-09T17:03:57.343505] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-09T17:03:57.344348] [DEBUG] [LOCAL ] ADX: Trimmed 41858 records to 27755 (keeping 200 days of data) [2025-10-09T17:03:57.523466] [DEBUG] [LOCAL ] ADX: Primary data saved (27755 records). [2025-10-09T17:03:57.523603] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-09T17:03:57.523705] [INFO ] [MAIN ] Update Progress: 35/2373 symbols completed. ADX took 37.1s. Estimated remaining: 4h 20m 29s. Rate: 9.0 symbols/min [2025-10-09T17:03:57.601875] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-09T17:03:57.692590] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:03:57.742159] [DEBUG] [LOCAL ] AEO: Loaded 53563 existing records from primary storage. [2025-10-09T17:03:57.742488] [INFO ] [MAIN ] AEO: Loaded 53563 existing records. [2025-10-09T17:03:57.915434] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:03:57.915620] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-09T17:03:57.915697] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-09T17:03:57.915949] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-09T17:03:57.916013] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-09T17:03:58.278447] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:03:58.396675] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-09T17:03:58.472456] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:03:59.196691] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-09T17:03:59.321845] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T17:03:59.996707] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-09T17:04:00.354215] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T17:04:00.796747] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-09T17:04:01.118626] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T17:04:01.596773] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-09T17:04:01.752514] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T17:04:02.243768] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T17:04:02.396709] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-09T17:04:03.174264] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T17:04:03.196696] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-09T17:04:03.996758] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-09T17:04:04.086254] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T17:04:04.614115] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T17:04:04.796709] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-09T17:04:05.596690] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-09T17:04:05.718589] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:04:06.157073] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T17:04:06.396740] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-09T17:04:07.196715] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-09T17:04:07.797676] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-09T17:04:07.996737] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-09T17:04:08.043305] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T17:04:08.796765] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-09T17:04:09.145745] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T17:04:09.596694] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-09T17:04:09.920183] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T17:04:10.072471] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T17:04:10.396719] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-09T17:04:10.821065] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T17:04:11.196739] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-09T17:04:11.996688] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-09T17:04:12.034492] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T17:04:12.796691] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-09T17:04:12.903505] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T17:04:13.596721] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-09T17:04:14.102382] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T17:04:14.334897] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T17:04:14.396677] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-09T17:04:15.144121] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T17:04:15.196698] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-09T17:04:15.996714] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-09T17:04:16.194322] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T17:04:16.796696] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-09T17:04:17.195550] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T17:04:17.207638] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T17:04:17.596783] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-09T17:04:18.229688] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:04:18.233952] [INFO ] [REMOTE ] AEE: Full fetch complete (72313 records). [2025-10-09T17:04:18.234116] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-09T17:04:18.235130] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:04:18.235290] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:04:18.235333] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:04:18.235371] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-09T17:04:18.235429] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-10-09T17:04:18.235464] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-10-09T17:04:18.235521] [DEBUG] [LOCAL ] AEE: No derivative data file found to delete. [2025-10-09T17:04:18.235604] [INFO ] [MAIN ] Update Progress: 36/2373 symbols completed. AEE took 46.0s. Estimated remaining: 4h 35m 33s. Rate: 8.5 symbols/min [2025-10-09T17:04:18.404081] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-09T17:04:18.407579] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:18.461754] [DEBUG] [LOCAL ] AER: Loaded 48212 existing records from primary storage. [2025-10-09T17:04:18.462087] [INFO ] [MAIN ] AER: Loaded 48212 existing records. [2025-10-09T17:04:18.646971] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:18.647226] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-09T17:04:18.647281] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-09T17:04:18.647636] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-09T17:04:18.647731] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-09T17:04:19.015697] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:19.196739] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-09T17:04:19.745676] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-09T17:04:19.900050] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T17:04:19.904253] [INFO ] [REMOTE ] AEG: Full fetch complete (70231 records). [2025-10-09T17:04:19.904360] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-09T17:04:20.001885] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-09T17:04:20.326731] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-09T17:04:20.326866] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-09T17:04:20.328013] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-09T17:04:20.328086] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-09T17:04:20.330296] [DEBUG] [LOCAL ] AEG: Trimmed 70231 records to 49927 (keeping 200 days of data) [2025-10-09T17:04:20.667180] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T17:04:20.686970] [DEBUG] [LOCAL ] AEG: Primary data saved (49927 records). [2025-10-09T17:04:20.687077] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-09T17:04:20.687144] [INFO ] [MAIN ] Update Progress: 37/2373 symbols completed. AEG took 40.4s. Estimated remaining: 4h 30m 34s. Rate: 8.6 symbols/min [2025-10-09T17:04:20.796718] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-09T17:04:21.596904] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-09T17:04:21.852231] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T17:04:21.936176] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T17:04:22.396722] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-09T17:04:23.196725] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-09T17:04:23.663804] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T17:04:24.008677] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-09T17:04:24.014059] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-09T17:04:24.796698] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-09T17:04:24.884591] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T17:04:25.596741] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-09T17:04:25.989899] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-09T17:04:26.384875] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T17:04:26.396718] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-09T17:04:27.196732] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-09T17:04:27.441768] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T17:04:27.996692] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-09T17:04:28.077522] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:04:28.082219] [INFO ] [REMOTE ] AEO: Full fetch complete (77447 records). [2025-10-09T17:04:28.082381] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-09T17:04:28.486887] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-09T17:04:28.487007] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-09T17:04:28.488148] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-09T17:04:28.488250] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-09T17:04:28.490434] [DEBUG] [LOCAL ] AEO: Trimmed 77447 records to 53953 (keeping 200 days of data) [2025-10-09T17:04:28.845385] [DEBUG] [LOCAL ] AEO: Primary data saved (53953 records). [2025-10-09T17:04:28.845526] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-09T17:04:28.846963] [INFO ] [MAIN ] Update Progress: 38/2373 symbols completed. AEO took 31.3s. Estimated remaining: 4h 31m 42s. Rate: 8.6 symbols/min [2025-10-09T17:04:28.939377] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T17:04:28.950172] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-09T17:04:29.492150] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:04:29.596726] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-09T17:04:30.674628] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:04:30.685174] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-09T17:04:31.442317] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T17:04:31.447200] [INFO ] [REMOTE ] AEM: Full fetch complete (77194 records). [2025-10-09T17:04:31.447328] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-09T17:04:31.855439] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-09T17:04:31.855787] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-09T17:04:31.856548] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-09T17:04:31.856592] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-09T17:04:31.858840] [DEBUG] [LOCAL ] AEM: Trimmed 77194 records to 53856 (keeping 200 days of data) [2025-10-09T17:04:32.204577] [DEBUG] [LOCAL ] AEM: Primary data saved (53856 records). [2025-10-09T17:04:32.204789] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-09T17:04:32.206268] [INFO ] [MAIN ] Update Progress: 39/2373 symbols completed. AEM took 38.3s. Estimated remaining: 4h 27m 58s. Rate: 8.7 symbols/min [2025-10-09T17:04:32.324035] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T17:04:32.333664] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-09T17:04:33.887924] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T17:04:33.899380] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-09T17:04:35.591170] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:04:35.601762] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-09T17:04:37.072559] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T17:04:37.083008] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-09T17:04:38.654075] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T17:04:38.660597] [INFO ] [REMOTE ] AER: Full fetch complete (69574 records). [2025-10-09T17:04:38.660925] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-09T17:04:39.188018] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-09T17:04:39.188122] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-09T17:04:39.188860] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-09T17:04:39.188929] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-09T17:04:39.190395] [DEBUG] [LOCAL ] AER: Trimmed 69574 records to 48578 (keeping 200 days of data) [2025-10-09T17:04:39.529486] [DEBUG] [LOCAL ] AER: Primary data saved (48578 records). [2025-10-09T17:04:39.529676] [INFO ] [MAIN ] AER: Full history saved. [2025-10-09T17:04:39.530803] [INFO ] [MAIN ] Update Progress: 40/2373 symbols completed. AER took 21.3s. Estimated remaining: 4h 28m 16s. Rate: 8.7 symbols/min [2025-10-09T17:04:40.234196] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:40.235139] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:40.241323] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:40.240184] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-09T17:04:40.257477] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-09T17:04:40.264202] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:40.265409] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-09T17:04:40.265606] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-09T17:04:40.265717] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-09T17:04:40.265770] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-09T17:04:40.391613] [DEBUG] [LOCAL ] AFB: Loaded 11448 existing records from primary storage. [2025-10-09T17:04:40.400809] [INFO ] [MAIN ] AFB: Loaded 11448 existing records. [2025-10-09T17:04:40.720392] [DEBUG] [LOCAL ] AESI: Loaded 49557 existing records from primary storage. [2025-10-09T17:04:40.746256] [DEBUG] [LOCAL ] AES: Loaded 53671 existing records from primary storage. [2025-10-09T17:04:40.751597] [INFO ] [MAIN ] AESI: Loaded 49557 existing records. [2025-10-09T17:04:40.764380] [INFO ] [MAIN ] AES: Loaded 53671 existing records. [2025-10-09T17:04:41.119070] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:41.220762] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-09T17:04:41.236884] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-09T17:04:41.278729] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-09T17:04:41.318860] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:41.351107] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-09T17:04:41.350490] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-09T17:04:41.417289] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:41.428110] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-09T17:04:41.444324] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-09T17:04:41.490696] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-09T17:04:41.547386] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:41.511856] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-09T17:04:41.567158] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-09T17:04:41.567698] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-09T17:04:41.595777] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-09T17:04:41.606305] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-09T17:04:41.682426] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:04:41.801361] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-09T17:04:41.831898] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:04:41.837224] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-09T17:04:41.933378] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:04:41.959459] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-09T17:04:41.978222] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-09T17:04:41.991963] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-09T17:04:42.002192] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-09T17:04:42.035326] [INFO ] [MAIN ] Update Progress: 41/2373 symbols completed. AEXA took 2.5s. Estimated remaining: 4h 23m 60s. Rate: 8.8 symbols/min [2025-10-09T17:04:42.579710] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:42.667883] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-09T17:04:42.726999] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:42.723791] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:42.727482] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-09T17:04:42.811027] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:42.811973] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-09T17:04:42.847987] [DEBUG] [LOCAL ] AFG: Loaded 32197 existing records from primary storage. [2025-10-09T17:04:42.848350] [INFO ] [MAIN ] AFG: Loaded 32197 existing records. [2025-10-09T17:04:43.049700] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:43.050006] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-09T17:04:43.050062] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-09T17:04:43.050363] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-09T17:04:43.050424] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-09T17:04:43.428026] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:43.428461] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-09T17:04:43.606097] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T17:04:43.609008] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-09T17:04:44.041942] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T17:04:44.050926] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-09T17:04:44.401695] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T17:04:44.404518] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-09T17:04:44.836624] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:04:44.844689] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-09T17:04:44.844051] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T17:04:44.856875] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-09T17:04:45.124891] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T17:04:45.127608] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-09T17:04:45.521527] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:04:45.530419] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-09T17:04:45.971492] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T17:04:45.977153] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-09T17:04:46.037852] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T17:04:46.041239] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-09T17:04:46.329252] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:04:46.339789] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-09T17:04:46.963582] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T17:04:46.984583] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T17:04:46.984246] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-09T17:04:47.082610] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T17:04:47.196765] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-09T17:04:47.645840] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T17:04:47.946966] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T17:04:47.996669] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-09T17:04:48.685146] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:04:48.720109] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T17:04:48.796679] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-09T17:04:49.596727] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-09T17:04:49.671707] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-09T17:04:50.396736] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-09T17:04:50.941938] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T17:04:51.114050] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T17:04:51.196690] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-09T17:04:51.996721] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-09T17:04:52.691379] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T17:04:52.770127] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T17:04:52.796665] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-09T17:04:53.586940] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T17:04:53.588505] [INFO ] [REMOTE ] AFB: Full fetch complete (16522 records). [2025-10-09T17:04:53.588572] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-09T17:04:53.601783] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-09T17:04:53.949241] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-09T17:04:53.949324] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-09T17:04:53.949566] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-09T17:04:53.949603] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-09T17:04:53.950110] [DEBUG] [LOCAL ] AFB: Trimmed 16522 records to 11507 (keeping 200 days of data) [2025-10-09T17:04:54.027639] [DEBUG] [LOCAL ] AFB: Primary data saved (11507 records). [2025-10-09T17:04:54.027797] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-09T17:04:54.027877] [INFO ] [MAIN ] Update Progress: 42/2373 symbols completed. AFB took 14.5s. Estimated remaining: 4h 28m 41s. Rate: 8.7 symbols/min [2025-10-09T17:04:54.194032] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:04:54.198756] [DEBUG] [LOCAL ] AFGB: Loaded 2309 existing records from primary storage. [2025-10-09T17:04:54.198915] [INFO ] [MAIN ] AFGB: Loaded 2309 existing records. [2025-10-09T17:04:54.372356] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:04:54.372556] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-09T17:04:54.372628] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-09T17:04:54.372885] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-09T17:04:54.372953] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-09T17:04:54.403437] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-09T17:04:54.727443] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:04:55.196679] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-09T17:04:55.460222] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-09T17:04:55.618830] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-09T17:04:55.870222] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:04:55.996704] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-09T17:04:56.796761] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-09T17:04:57.192036] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T17:04:57.192213] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T17:04:57.596757] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-09T17:04:58.396776] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-09T17:04:58.945742] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T17:04:59.196778] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-09T17:04:59.722490] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T17:04:59.996793] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-09T17:05:00.474352] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T17:05:00.796754] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-09T17:05:01.599522] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-09T17:05:01.603093] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T17:05:02.093957] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-09T17:05:02.396762] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-09T17:05:03.104585] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-09T17:05:03.196762] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-09T17:05:03.611959] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T17:05:03.987202] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T17:05:03.998733] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-09T17:05:04.796742] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-09T17:05:05.596710] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-09T17:05:05.951471] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T17:05:06.122114] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T17:05:06.229171] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T17:05:06.396742] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-09T17:05:07.196712] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-09T17:05:07.996718] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-09T17:05:08.200202] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T17:05:08.453915] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T17:05:08.796719] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-09T17:05:09.067710] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T17:05:09.093285] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-09T17:05:09.596728] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-09T17:05:10.396726] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-09T17:05:10.783922] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-09T17:05:11.131769] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T17:05:11.136200] [INFO ] [REMOTE ] AESI: Full fetch complete (70763 records). [2025-10-09T17:05:11.136359] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-09T17:05:11.201801] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-09T17:05:11.538755] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-09T17:05:11.538866] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-09T17:05:11.539551] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-09T17:05:11.539595] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-09T17:05:11.541826] [DEBUG] [LOCAL ] AESI: Trimmed 70763 records to 49944 (keeping 200 days of data) [2025-10-09T17:05:11.544905] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-09T17:05:11.860758] [DEBUG] [LOCAL ] AESI: Primary data saved (49944 records). [2025-10-09T17:05:11.860909] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-09T17:05:11.860996] [INFO ] [MAIN ] Update Progress: 43/2373 symbols completed. AESI took 32.3s. Estimated remaining: 4h 38m 26s. Rate: 8.4 symbols/min [2025-10-09T17:05:12.008637] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-09T17:05:12.041374] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:12.046263] [DEBUG] [LOCAL ] AFGC: Loaded 2549 existing records from primary storage. [2025-10-09T17:05:12.046412] [INFO ] [MAIN ] AFGC: Loaded 2549 existing records. [2025-10-09T17:05:12.228171] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:12.228386] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-09T17:05:12.228436] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-09T17:05:12.228595] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-09T17:05:12.228693] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-09T17:05:12.601717] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:12.796719] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-09T17:05:13.367565] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T17:05:13.596762] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-09T17:05:14.058732] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T17:05:14.330466] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-09T17:05:14.396671] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-09T17:05:15.196728] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-09T17:05:15.593635] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T17:05:15.996698] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-09T17:05:16.312503] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T17:05:16.331121] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-09T17:05:16.796750] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-09T17:05:17.596714] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-09T17:05:18.231996] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T17:05:18.251685] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T17:05:18.396739] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-09T17:05:18.955178] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T17:05:18.956022] [INFO ] [REMOTE ] AFGB: Full fetch complete (3615 records). [2025-10-09T17:05:18.956129] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-09T17:05:19.201888] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-09T17:05:19.341959] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-09T17:05:19.342038] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-09T17:05:19.342170] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-09T17:05:19.342208] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-09T17:05:19.342549] [DEBUG] [LOCAL ] AFGB: Trimmed 3615 records to 2317 (keeping 200 days of data) [2025-10-09T17:05:19.356977] [DEBUG] [LOCAL ] AFGB: Primary data saved (2317 records). [2025-10-09T17:05:19.357051] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-09T17:05:19.357123] [INFO ] [MAIN ] Update Progress: 44/2373 symbols completed. AFGB took 25.3s. Estimated remaining: 4h 38m 36s. Rate: 8.4 symbols/min [2025-10-09T17:05:19.524304] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:19.528721] [DEBUG] [LOCAL ] AFGD: Loaded 1807 existing records from primary storage. [2025-10-09T17:05:19.528876] [INFO ] [MAIN ] AFGD: Loaded 1807 existing records. [2025-10-09T17:05:19.704157] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:19.704406] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-09T17:05:19.704455] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-09T17:05:19.704675] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-09T17:05:19.704737] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-09T17:05:20.001988] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-09T17:05:20.060738] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:20.429117] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-09T17:05:20.437760] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T17:05:20.440740] [INFO ] [REMOTE ] AFG: Full fetch complete (46219 records). [2025-10-09T17:05:20.440837] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-09T17:05:20.826303] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-09T17:05:20.808327] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-09T17:05:20.827159] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-09T17:05:20.827713] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-09T17:05:20.827791] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-09T17:05:20.829028] [DEBUG] [LOCAL ] AFG: Trimmed 46219 records to 32429 (keeping 200 days of data) [2025-10-09T17:05:21.045874] [DEBUG] [LOCAL ] AFG: Primary data saved (32429 records). [2025-10-09T17:05:21.046004] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-09T17:05:21.046083] [INFO ] [MAIN ] Update Progress: 45/2373 symbols completed. AFG took 38.9s. Estimated remaining: 4h 33m 45s. Rate: 8.5 symbols/min [2025-10-09T17:05:21.214092] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:21.219097] [DEBUG] [LOCAL ] AFGE: Loaded 2427 existing records from primary storage. [2025-10-09T17:05:21.219272] [INFO ] [MAIN ] AFGE: Loaded 2427 existing records. [2025-10-09T17:05:21.311290] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-09T17:05:21.408483] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:21.408747] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-09T17:05:21.408810] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-09T17:05:21.409005] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-09T17:05:21.409069] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-09T17:05:21.603213] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-09T17:05:21.781979] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:22.396708] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-09T17:05:22.924483] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-09T17:05:23.196712] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-09T17:05:23.497469] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T17:05:23.847751] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T17:05:23.996724] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-09T17:05:24.448936] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T17:05:24.796727] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-09T17:05:25.596783] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-09T17:05:26.056880] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T17:05:26.396718] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-09T17:05:26.893925] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T17:05:26.961730] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T17:05:27.196720] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-09T17:05:27.596118] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-09T17:05:27.996765] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-09T17:05:28.438120] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T17:05:28.796719] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-09T17:05:29.304404] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T17:05:29.596754] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-09T17:05:30.040022] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T17:05:30.396731] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-09T17:05:31.196745] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-09T17:05:31.793804] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T17:05:31.996699] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-09T17:05:32.205726] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-09T17:05:32.210502] [INFO ] [REMOTE ] AES: Full fetch complete (77721 records). [2025-10-09T17:05:32.210692] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-09T17:05:32.556480] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T17:05:32.659280] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-09T17:05:32.659356] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-09T17:05:32.660095] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-09T17:05:32.660161] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-09T17:05:32.661487] [DEBUG] [LOCAL ] AES: Trimmed 77721 records to 54060 (keeping 200 days of data) [2025-10-09T17:05:32.839948] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-09T17:05:32.995517] [DEBUG] [LOCAL ] AES: Primary data saved (54060 records). [2025-10-09T17:05:32.995703] [INFO ] [MAIN ] AES: Full history saved. [2025-10-09T17:05:32.995857] [INFO ] [MAIN ] Update Progress: 46/2373 symbols completed. AES took 53.5s. Estimated remaining: 4h 37m 46s. Rate: 8.4 symbols/min [2025-10-09T17:05:33.161323] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:33.212966] [DEBUG] [LOCAL ] AFL: Loaded 53161 existing records from primary storage. [2025-10-09T17:05:33.213292] [INFO ] [MAIN ] AFL: Loaded 53161 existing records. [2025-10-09T17:05:33.386872] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:33.387053] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-09T17:05:33.387097] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-09T17:05:33.387476] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-09T17:05:33.387534] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-09T17:05:33.468350] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T17:05:33.489426] [INFO ] [REMOTE ] AFGC: Full fetch complete (3691 records). [2025-10-09T17:05:33.492019] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-09T17:05:33.617158] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-09T17:05:34.067927] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:34.121705] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-09T17:05:34.121784] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-09T17:05:34.121906] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-09T17:05:34.121946] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-09T17:05:34.122291] [DEBUG] [LOCAL ] AFGC: Trimmed 3691 records to 2560 (keeping 200 days of data) [2025-10-09T17:05:34.138401] [DEBUG] [LOCAL ] AFGC: Primary data saved (2560 records). [2025-10-09T17:05:34.138461] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-09T17:05:34.138535] [INFO ] [MAIN ] Update Progress: 47/2373 symbols completed. AFGC took 22.3s. Estimated remaining: 4h 32m 41s. Rate: 8.5 symbols/min [2025-10-09T17:05:34.312806] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:34.315883] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-09T17:05:34.369461] [DEBUG] [LOCAL ] AG: Loaded 53642 existing records from primary storage. [2025-10-09T17:05:34.369834] [INFO ] [MAIN ] AG: Loaded 53642 existing records. [2025-10-09T17:05:34.401835] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-09T17:05:34.547764] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:34.547990] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-09T17:05:34.548054] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-09T17:05:34.549428] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-09T17:05:34.549489] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-09T17:05:34.901865] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:34.987341] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T17:05:35.196795] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-09T17:05:35.996733] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-09T17:05:36.796710] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-09T17:05:37.191534] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-09T17:05:37.291145] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T17:05:37.596734] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-09T17:05:38.052704] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T17:05:38.304349] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-09T17:05:38.396711] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-09T17:05:39.196762] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-09T17:05:39.996707] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-09T17:05:40.158230] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T17:05:40.310812] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-09T17:05:40.796695] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-09T17:05:41.069197] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T17:05:41.260790] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T17:05:41.596774] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-09T17:05:42.043048] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T17:05:42.396708] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-09T17:05:43.196786] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-09T17:05:43.522669] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-09T17:05:43.996709] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-09T17:05:44.363894] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-09T17:05:44.408175] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-09T17:05:44.796714] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-09T17:05:45.596712] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-09T17:05:45.990450] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-09T17:05:46.396757] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-09T17:05:46.893327] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-09T17:05:47.196733] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-09T17:05:47.990215] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:05:48.000021] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-09T17:05:48.478345] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T17:05:48.479232] [INFO ] [REMOTE ] AFGD: Full fetch complete (3061 records). [2025-10-09T17:05:48.479301] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-09T17:05:48.797684] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-09T17:05:48.873830] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-09T17:05:48.873935] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-09T17:05:48.874090] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-09T17:05:48.874231] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-09T17:05:48.874867] [DEBUG] [LOCAL ] AFGD: Trimmed 3061 records to 1815 (keeping 200 days of data) [2025-10-09T17:05:48.887375] [DEBUG] [LOCAL ] AFGD: Primary data saved (1815 records). [2025-10-09T17:05:48.913470] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-09T17:05:48.916856] [INFO ] [MAIN ] Update Progress: 48/2373 symbols completed. AFGD took 29.6s. Estimated remaining: 4h 38m 49s. Rate: 8.3 symbols/min [2025-10-09T17:05:48.968276] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T17:05:49.119940] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:05:49.163496] [DEBUG] [LOCAL ] AGCO: Loaded 42343 existing records from primary storage. [2025-10-09T17:05:49.163827] [INFO ] [MAIN ] AGCO: Loaded 42343 existing records. [2025-10-09T17:05:49.350213] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:05:49.350462] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-09T17:05:49.350509] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-09T17:05:49.351782] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-09T17:05:49.351842] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-09T17:05:49.604843] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-09T17:05:49.735120] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:05:50.191222] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T17:05:50.396814] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-09T17:05:51.164450] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T17:05:51.196667] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-09T17:05:51.996717] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-09T17:05:52.411517] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T17:05:52.796698] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-09T17:05:53.190339] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-09T17:05:53.331277] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T17:05:53.596772] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-09T17:05:53.606876] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T17:05:54.396805] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-09T17:05:55.196731] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-09T17:05:55.931408] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T17:05:55.996710] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-09T17:05:56.045776] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-09T17:05:56.698711] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T17:05:56.796703] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-09T17:05:57.536681] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T17:05:57.596726] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-09T17:05:58.164472] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T17:05:58.396711] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-09T17:05:58.644940] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T17:05:58.847380] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-09T17:05:59.196720] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-09T17:05:59.996749] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-09T17:06:00.793454] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T17:06:00.803761] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-09T17:06:01.596718] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-09T17:06:02.396687] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-09T17:06:02.473902] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-09T17:06:02.623023] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T17:06:02.835579] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T17:06:02.836302] [INFO ] [REMOTE ] AFGE: Full fetch complete (3445 records). [2025-10-09T17:06:02.836367] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-09T17:06:03.193688] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-09T17:06:03.193811] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-09T17:06:03.193998] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-09T17:06:03.194075] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-09T17:06:03.194581] [DEBUG] [LOCAL ] AFGE: Trimmed 3445 records to 2436 (keeping 200 days of data) [2025-10-09T17:06:03.202806] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-09T17:06:03.212035] [DEBUG] [LOCAL ] AFGE: Primary data saved (2436 records). [2025-10-09T17:06:03.212108] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-09T17:06:03.212195] [INFO ] [MAIN ] Update Progress: 49/2373 symbols completed. AFGE took 42.2s. Estimated remaining: 4h 44m 18s. Rate: 8.2 symbols/min [2025-10-09T17:06:03.386943] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T17:06:03.431130] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:03.449797] [DEBUG] [LOCAL ] AGD: Loaded 18490 existing records from primary storage. [2025-10-09T17:06:03.450033] [INFO ] [MAIN ] AGD: Loaded 18490 existing records. [2025-10-09T17:06:03.624261] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:03.624493] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-09T17:06:03.624570] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-09T17:06:03.625526] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-09T17:06:03.625610] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-09T17:06:03.970353] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:03.996667] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-09T17:06:04.656674] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T17:06:04.796705] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-09T17:06:04.995565] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T17:06:05.596724] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-09T17:06:06.396733] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-09T17:06:06.565915] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T17:06:06.833870] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:06:07.196733] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-09T17:06:07.996725] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-09T17:06:08.644501] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-09T17:06:08.730197] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T17:06:08.796696] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-09T17:06:08.878049] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T17:06:09.596712] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-09T17:06:10.396779] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-09T17:06:11.126462] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-09T17:06:11.131163] [INFO ] [REMOTE ] AG: Full fetch complete (77615 records). [2025-10-09T17:06:11.131291] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-09T17:06:11.200099] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-09T17:06:11.249483] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T17:06:11.272088] [INFO ] [REMOTE ] AFL: Full fetch complete (76519 records). [2025-10-09T17:06:11.295818] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-09T17:06:11.355341] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:06:11.354918] [FATAL] [VALIDATOR ] AFL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:06:11.384554] [FATAL] [MAIN ] AFL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:06:11.463730] [WARN ] [MAIN ] AFL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:06:11.500830] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-09T17:06:11.503423] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-10-09T17:06:11.503811] [INFO ] [LOCAL ] AFL: Starting deletion of derivative data. [2025-10-09T17:06:11.519848] [DEBUG] [LOCAL ] AFL: Deleted derivative data file. [2025-10-09T17:06:11.543921] [INFO ] [MAIN ] Update Progress: 50/2373 symbols completed. AFL took 38.5s. Estimated remaining: 4h 44m 57s. Rate: 8.2 symbols/min [2025-10-09T17:06:11.678689] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-09T17:06:11.702018] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-09T17:06:11.713091] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-09T17:06:11.713485] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-09T17:06:11.784199] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:11.781038] [DEBUG] [LOCAL ] AG: Trimmed 77615 records to 54032 (keeping 200 days of data) [2025-10-09T17:06:11.997371] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-09T17:06:12.023432] [DEBUG] [LOCAL ] AGI: Loaded 53420 existing records from primary storage. [2025-10-09T17:06:12.024939] [INFO ] [MAIN ] AGI: Loaded 53420 existing records. [2025-10-09T17:06:12.217760] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:12.218821] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-09T17:06:12.219674] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-09T17:06:12.221853] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-09T17:06:12.221931] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-09T17:06:12.670677] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:12.757297] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T17:06:12.789496] [DEBUG] [LOCAL ] AG: Primary data saved (54032 records). [2025-10-09T17:06:12.789626] [INFO ] [MAIN ] AG: Full history saved. [2025-10-09T17:06:12.791035] [INFO ] [MAIN ] Update Progress: 51/2373 symbols completed. AG took 38.7s. Estimated remaining: 4h 40m 11s. Rate: 8.3 symbols/min [2025-10-09T17:06:12.802321] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-09T17:06:12.961308] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:13.012045] [DEBUG] [LOCAL ] AGL: Loaded 52495 existing records from primary storage. [2025-10-09T17:06:13.012369] [INFO ] [MAIN ] AGL: Loaded 52495 existing records. [2025-10-09T17:06:13.190151] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:13.190413] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-09T17:06:13.190469] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-09T17:06:13.191725] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-09T17:06:13.191785] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-09T17:06:13.492853] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:06:13.562635] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:13.596668] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-09T17:06:14.396739] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-09T17:06:14.535557] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T17:06:14.880392] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T17:06:15.196799] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-09T17:06:15.996739] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-09T17:06:16.239465] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T17:06:16.733161] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T17:06:16.796682] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-09T17:06:16.903393] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T17:06:17.470843] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T17:06:17.596727] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-09T17:06:18.396739] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-09T17:06:19.196749] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-09T17:06:19.638181] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-09T17:06:19.967168] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T17:06:19.996715] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-09T17:06:20.796692] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-09T17:06:20.979094] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T17:06:21.596706] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-09T17:06:21.685500] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T17:06:21.737681] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T17:06:22.396738] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-09T17:06:23.196869] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-09T17:06:23.294070] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T17:06:23.342475] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-09T17:06:23.996734] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-09T17:06:24.796692] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-09T17:06:24.900199] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:06:25.294207] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T17:06:25.596756] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-09T17:06:25.815684] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T17:06:26.396741] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-09T17:06:27.196693] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-09T17:06:27.353014] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T17:06:27.622009] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T17:06:27.625482] [INFO ] [REMOTE ] AGCO: Full fetch complete (61418 records). [2025-10-09T17:06:27.625586] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-09T17:06:27.626313] [FATAL] [VALIDATOR ] AGCO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:06:27.626400] [FATAL] [MAIN ] AGCO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:06:27.626445] [WARN ] [MAIN ] AGCO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:06:27.626514] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-09T17:06:27.626604] [DEBUG] [LOCAL ] AGCO: No primary data file found to delete. [2025-10-09T17:06:27.626685] [INFO ] [LOCAL ] AGCO: Starting deletion of derivative data. [2025-10-09T17:06:27.626891] [DEBUG] [LOCAL ] AGCO: Deleted derivative data file. [2025-10-09T17:06:27.627526] [INFO ] [MAIN ] Update Progress: 52/2373 symbols completed. AGCO took 38.7s. Estimated remaining: 4h 45m 43s. Rate: 8.1 symbols/min [2025-10-09T17:06:27.798062] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:27.810439] [DEBUG] [LOCAL ] AGM: Loaded 10458 existing records from primary storage. [2025-10-09T17:06:27.810682] [INFO ] [MAIN ] AGM: Loaded 10458 existing records. [2025-10-09T17:06:27.984533] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:27.984760] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-09T17:06:27.984810] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-09T17:06:27.985220] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-09T17:06:27.985277] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-09T17:06:28.005212] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-09T17:06:28.345309] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:28.374841] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T17:06:28.377233] [INFO ] [REMOTE ] AGD: Full fetch complete (26053 records). [2025-10-09T17:06:28.377308] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-09T17:06:28.769631] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-09T17:06:28.769764] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-09T17:06:28.770118] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-09T17:06:28.770160] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-09T17:06:28.771125] [DEBUG] [LOCAL ] AGD: Trimmed 26053 records to 18787 (keeping 200 days of data) [2025-10-09T17:06:28.819902] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-09T17:06:28.891531] [DEBUG] [LOCAL ] AGD: Primary data saved (18787 records). [2025-10-09T17:06:28.891707] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-09T17:06:28.891814] [INFO ] [MAIN ] Update Progress: 53/2373 symbols completed. AGD took 25.7s. Estimated remaining: 4h 41m 8s. Rate: 8.3 symbols/min [2025-10-09T17:06:29.068730] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:29.104010] [DEBUG] [LOCAL ] AGO: Loaded 27924 existing records from primary storage. [2025-10-09T17:06:29.104287] [INFO ] [MAIN ] AGO: Loaded 27924 existing records. [2025-10-09T17:06:29.288357] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:29.288731] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-09T17:06:29.288800] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-09T17:06:29.289032] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-09T17:06:29.289089] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-09T17:06:29.597049] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-09T17:06:29.688127] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:29.718210] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T17:06:30.396701] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-09T17:06:30.551187] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T17:06:30.665869] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T17:06:31.196709] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-09T17:06:31.556966] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T17:06:31.716751] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T17:06:31.996722] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-09T17:06:32.796753] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-09T17:06:33.596714] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-09T17:06:33.802743] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T17:06:34.273134] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T17:06:34.403988] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-09T17:06:34.423933] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T17:06:35.078372] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T17:06:35.196673] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-09T17:06:35.996700] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-09T17:06:36.059324] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T17:06:36.796777] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-09T17:06:37.596704] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-09T17:06:37.737359] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T17:06:37.797577] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T17:06:38.396709] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-09T17:06:38.433735] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T17:06:39.196730] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-09T17:06:39.996720] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-09T17:06:40.311432] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T17:06:40.387464] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T17:06:40.796716] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-09T17:06:41.596737] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-09T17:06:41.648634] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T17:06:41.894180] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T17:06:42.396734] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-09T17:06:43.196683] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-09T17:06:43.565913] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-09T17:06:43.641674] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T17:06:43.878110] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T17:06:43.996691] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-09T17:06:44.796728] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-09T17:06:45.465186] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:06:45.596731] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-09T17:06:46.358824] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T17:06:46.364983] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T17:06:46.372011] [INFO ] [REMOTE ] AGL: Full fetch complete (75603 records). [2025-10-09T17:06:46.372830] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-09T17:06:46.401968] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-09T17:06:46.790984] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-09T17:06:46.791075] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-09T17:06:46.791828] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-09T17:06:46.791895] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-09T17:06:46.793527] [DEBUG] [LOCAL ] AGL: Trimmed 75603 records to 52884 (keeping 200 days of data) [2025-10-09T17:06:47.091383] [DEBUG] [LOCAL ] AGL: Primary data saved (52884 records). [2025-10-09T17:06:47.091602] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-09T17:06:47.092680] [INFO ] [MAIN ] Update Progress: 54/2373 symbols completed. AGL took 34.3s. Estimated remaining: 4h 48m 50s. Rate: 8.0 symbols/min [2025-10-09T17:06:47.201892] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-09T17:06:47.276357] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:47.276534] [DEBUG] [LOCAL ] AGRO: No existing data file found in primary storage. [2025-10-09T17:06:47.276575] [WARN ] [MAIN ] AGRO: No existing data found, performing full refresh instead. [2025-10-09T17:06:47.276751] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-09T17:06:47.276796] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-09T17:06:47.276840] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-09T17:06:47.276877] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-09T17:06:47.662816] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:47.679206] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T17:06:47.996746] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-09T17:06:48.796766] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-09T17:06:49.136869] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T17:06:49.444545] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T17:06:49.596754] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-09T17:06:49.784828] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T17:06:50.396731] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-09T17:06:50.897613] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T17:06:51.196736] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-09T17:06:51.729725] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:06:51.996696] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-09T17:06:52.796680] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-09T17:06:53.220084] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T17:06:53.391238] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T17:06:53.596686] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-09T17:06:54.043191] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T17:06:54.396767] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-09T17:06:54.505615] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T17:06:54.507357] [INFO ] [REMOTE ] AGM: Full fetch complete (13028 records). [2025-10-09T17:06:54.507430] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-09T17:06:54.887744] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-09T17:06:54.887854] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-09T17:06:54.888136] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-09T17:06:54.888200] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-09T17:06:54.889081] [DEBUG] [LOCAL ] AGM: Trimmed 13028 records to 10514 (keeping 200 days of data) [2025-10-09T17:06:54.961879] [DEBUG] [LOCAL ] AGM: Primary data saved (10514 records). [2025-10-09T17:06:54.962064] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-09T17:06:54.962178] [INFO ] [MAIN ] Update Progress: 55/2373 symbols completed. AGM took 27.3s. Estimated remaining: 4h 48m 59s. Rate: 8.0 symbols/min [2025-10-09T17:06:55.135622] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:06:55.171814] [DEBUG] [LOCAL ] AGX: Loaded 33176 existing records from primary storage. [2025-10-09T17:06:55.172098] [INFO ] [MAIN ] AGX: Loaded 33176 existing records. [2025-10-09T17:06:55.202576] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-09T17:06:55.353140] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:06:55.353369] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-09T17:06:55.353416] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-09T17:06:55.353731] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-09T17:06:55.353790] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-09T17:06:55.704875] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:06:55.996702] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-09T17:06:56.308662] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T17:06:56.337463] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T17:06:56.796764] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-09T17:06:57.096150] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T17:06:57.596761] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-09T17:06:57.892687] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T17:06:58.396733] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-09T17:06:59.026288] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:06:59.196730] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-09T17:06:59.705557] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T17:06:59.996732] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-09T17:07:00.796679] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-09T17:07:01.127569] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T17:07:01.131104] [INFO ] [REMOTE ] AGO: Full fetch complete (39433 records). [2025-10-09T17:07:01.131243] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-09T17:07:01.255823] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-09T17:07:01.322573] [INFO ] [REMOTE ] AGI: Full fetch complete (76915 records). [2025-10-09T17:07:01.341367] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-09T17:07:01.601745] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-09T17:07:01.684416] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-09T17:07:01.699784] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-09T17:07:01.752519] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-09T17:07:01.758148] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-09T17:07:01.824104] [DEBUG] [LOCAL ] AGO: Trimmed 39433 records to 28116 (keeping 200 days of data) [2025-10-09T17:07:02.012163] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-09T17:07:02.015896] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-09T17:07:02.021137] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-09T17:07:02.022667] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-09T17:07:02.041700] [DEBUG] [LOCAL ] AGI: Trimmed 76915 records to 53810 (keeping 200 days of data) [2025-10-09T17:07:02.188818] [DEBUG] [LOCAL ] AGO: Primary data saved (28116 records). [2025-10-09T17:07:02.189537] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-09T17:07:02.192592] [INFO ] [MAIN ] Update Progress: 56/2373 symbols completed. AGO took 33.3s. Estimated remaining: 4h 48m 41s. Rate: 8.0 symbols/min [2025-10-09T17:07:02.330309] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T17:07:02.404179] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-09T17:07:02.410348] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:02.552876] [DEBUG] [LOCAL ] AHH: Loaded 40772 existing records from primary storage. [2025-10-09T17:07:02.558637] [INFO ] [MAIN ] AHH: Loaded 40772 existing records. [2025-10-09T17:07:02.811376] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:02.813027] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-09T17:07:02.813934] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-09T17:07:02.814798] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-09T17:07:02.814882] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-09T17:07:03.201954] [DEBUG] [LOCAL ] AGI: Primary data saved (53810 records). [2025-10-09T17:07:03.232764] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:03.234331] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T17:07:03.233480] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-09T17:07:03.238086] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-09T17:07:03.243343] [INFO ] [MAIN ] Update Progress: 57/2373 symbols completed. AGI took 51.7s. Estimated remaining: 4h 44m 13s. Rate: 8.1 symbols/min [2025-10-09T17:07:03.412527] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:03.412752] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-09T17:07:03.412800] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-09T17:07:03.412917] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-09T17:07:03.412960] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-09T17:07:03.413002] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-09T17:07:03.413036] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-09T17:07:03.771747] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:03.790927] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T17:07:03.996766] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-09T17:07:04.796798] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-09T17:07:04.970516] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T17:07:05.347860] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T17:07:05.596738] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-09T17:07:05.658716] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T17:07:06.396728] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-09T17:07:06.600981] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:07:06.601278] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-09T17:07:06.601380] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:07:06.601427] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-09T17:07:06.601489] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:07:06.601560] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-09T17:07:06.601624] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-09T17:07:06.601696] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-09T17:07:06.601753] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-09T17:07:06.601814] [INFO ] [MAIN ] Update Progress: 58/2373 symbols completed. AHL took 3.4s. Estimated remaining: 4h 41m 26s. Rate: 8.2 symbols/min [2025-10-09T17:07:06.775988] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:06.819794] [DEBUG] [LOCAL ] AHR: Loaded 49109 existing records from primary storage. [2025-10-09T17:07:06.820117] [INFO ] [MAIN ] AHR: Loaded 49109 existing records. [2025-10-09T17:07:07.002582] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:07.003083] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-09T17:07:07.003200] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-09T17:07:07.003750] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-09T17:07:07.003885] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-09T17:07:07.205246] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-09T17:07:07.268823] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:07:07.420590] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:07.996718] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-09T17:07:08.755973] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T17:07:08.796702] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-09T17:07:09.596710] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-09T17:07:09.805177] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T17:07:10.391125] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T17:07:10.400219] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-09T17:07:10.627700] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T17:07:11.196722] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-09T17:07:11.936509] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T17:07:11.996703] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-09T17:07:12.796701] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-09T17:07:12.838018] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:07:13.596688] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-09T17:07:13.802601] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T17:07:14.396713] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-09T17:07:14.510973] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T17:07:15.182020] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:07:15.196688] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-09T17:07:15.799578] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:07:15.996781] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-09T17:07:16.463515] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T17:07:16.796728] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-09T17:07:17.214738] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T17:07:17.596731] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-09T17:07:18.396755] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-09T17:07:18.421553] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T17:07:19.196693] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-09T17:07:19.246001] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T17:07:19.826563] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T17:07:19.996763] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-09T17:07:20.657609] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:07:20.796733] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-09T17:07:21.596748] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-09T17:07:21.757983] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T17:07:22.054954] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T17:07:22.396773] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-09T17:07:22.546600] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T17:07:23.196778] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-09T17:07:23.996704] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-09T17:07:24.030393] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:07:24.484756] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T17:07:24.487743] [INFO ] [REMOTE ] AGRO: Full fetch complete (49352 records). [2025-10-09T17:07:24.487833] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-09T17:07:24.809795] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-09T17:07:24.861396] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-09T17:07:24.861477] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-09T17:07:24.861990] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-09T17:07:24.862054] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-09T17:07:24.863042] [DEBUG] [LOCAL ] AGRO: Trimmed 49352 records to 33620 (keeping 200 days of data) [2025-10-09T17:07:25.074103] [DEBUG] [LOCAL ] AGRO: Primary data saved (33620 records). [2025-10-09T17:07:25.074224] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-09T17:07:25.074295] [INFO ] [MAIN ] Update Progress: 59/2373 symbols completed. AGRO took 38.0s. Estimated remaining: 4h 48m 37s. Rate: 8.0 symbols/min [2025-10-09T17:07:25.253299] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:25.277370] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T17:07:25.290736] [DEBUG] [LOCAL ] AHT: Loaded 6227 existing records from primary storage. [2025-10-09T17:07:25.290937] [INFO ] [MAIN ] AHT: Loaded 6227 existing records. [2025-10-09T17:07:25.460917] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:25.461090] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-09T17:07:25.461138] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-09T17:07:25.461310] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-09T17:07:25.461366] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-09T17:07:25.601906] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-09T17:07:25.814170] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:26.396682] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-09T17:07:26.460536] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T17:07:27.066135] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T17:07:27.196751] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-09T17:07:27.228501] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T17:07:27.996747] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-09T17:07:28.669548] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T17:07:28.796697] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-09T17:07:29.225394] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:07:29.596744] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-09T17:07:30.250675] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T17:07:30.301091] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T17:07:30.396677] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-09T17:07:31.196760] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-09T17:07:31.996694] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-09T17:07:32.228628] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T17:07:32.428370] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T17:07:32.526179] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T17:07:32.529598] [INFO ] [REMOTE ] AHH: Full fetch complete (59903 records). [2025-10-09T17:07:32.529731] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-09T17:07:32.801859] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-09T17:07:32.918043] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-09T17:07:32.918145] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-09T17:07:32.918769] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-09T17:07:32.918838] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-09T17:07:32.920120] [DEBUG] [LOCAL ] AHH: Trimmed 59903 records to 41015 (keeping 200 days of data) [2025-10-09T17:07:33.163503] [DEBUG] [LOCAL ] AHH: Primary data saved (41015 records). [2025-10-09T17:07:33.163633] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-09T17:07:33.163755] [INFO ] [MAIN ] Update Progress: 60/2373 symbols completed. AHH took 31.0s. Estimated remaining: 4h 48m 53s. Rate: 8.0 symbols/min [2025-10-09T17:07:33.333313] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:33.337472] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T17:07:33.389838] [DEBUG] [LOCAL ] AI: Loaded 53755 existing records from primary storage. [2025-10-09T17:07:33.390162] [INFO ] [MAIN ] AI: Loaded 53755 existing records. [2025-10-09T17:07:33.561182] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:33.561371] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-09T17:07:33.561417] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-09T17:07:33.561687] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-09T17:07:33.561745] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-09T17:07:33.601848] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-09T17:07:33.924153] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:34.396750] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-09T17:07:34.844185] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T17:07:34.846838] [INFO ] [REMOTE ] AGX: Full fetch complete (48602 records). [2025-10-09T17:07:34.846947] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-09T17:07:35.203386] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-09T17:07:35.246363] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-09T17:07:35.246449] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-09T17:07:35.247046] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-09T17:07:35.247110] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-09T17:07:35.248268] [DEBUG] [LOCAL ] AGX: Trimmed 48602 records to 33340 (keeping 200 days of data) [2025-10-09T17:07:35.465163] [DEBUG] [LOCAL ] AGX: Primary data saved (33340 records). [2025-10-09T17:07:35.465307] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-09T17:07:35.465392] [INFO ] [MAIN ] Update Progress: 61/2373 symbols completed. AGX took 40.5s. Estimated remaining: 4h 45m 28s. Rate: 8.1 symbols/min [2025-10-09T17:07:35.631604] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:35.680561] [DEBUG] [LOCAL ] AIG: Loaded 53474 existing records from primary storage. [2025-10-09T17:07:35.680903] [INFO ] [MAIN ] AIG: Loaded 53474 existing records. [2025-10-09T17:07:35.857075] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:35.857296] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-09T17:07:35.857351] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-09T17:07:35.857601] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-09T17:07:35.857698] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-09T17:07:36.004471] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-09T17:07:36.217597] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:36.518902] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T17:07:36.523367] [INFO ] [REMOTE ] AHR: Full fetch complete (70757 records). [2025-10-09T17:07:36.523477] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-09T17:07:36.800768] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-09T17:07:36.816989] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T17:07:36.941880] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-09T17:07:36.941995] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-09T17:07:36.942879] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-09T17:07:36.942977] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-09T17:07:36.982082] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-09T17:07:36.993901] [DEBUG] [LOCAL ] AHR: Trimmed 70757 records to 49469 (keeping 200 days of data) [2025-10-09T17:07:37.302231] [DEBUG] [LOCAL ] AHR: Primary data saved (49469 records). [2025-10-09T17:07:37.302375] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-09T17:07:37.302470] [INFO ] [MAIN ] Update Progress: 62/2373 symbols completed. AHR took 30.7s. Estimated remaining: 4h 41m 53s. Rate: 8.2 symbols/min [2025-10-09T17:07:37.473349] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:37.473547] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-09T17:07:37.473584] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-09T17:07:37.473724] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-09T17:07:37.473771] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-09T17:07:37.473814] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-09T17:07:37.473846] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-09T17:07:37.609629] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-09T17:07:37.824248] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:38.361006] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T17:07:38.396694] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-09T17:07:38.659131] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:07:38.659739] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-09T17:07:38.685867] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:07:38.686019] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-09T17:07:38.686087] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:07:38.686172] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-09T17:07:38.686785] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-09T17:07:38.687696] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T17:07:38.687771] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-09T17:07:38.698983] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-09T17:07:38.699041] [INFO ] [MAIN ] Update Progress: 63/2373 symbols completed. AII took 1.4s. Estimated remaining: 4h 38m 9s. Rate: 8.3 symbols/min [2025-10-09T17:07:38.867538] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:38.889994] [DEBUG] [LOCAL ] AIN: Loaded 24522 existing records from primary storage. [2025-10-09T17:07:38.890223] [INFO ] [MAIN ] AIN: Loaded 24522 existing records. [2025-10-09T17:07:39.062564] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:39.062790] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-09T17:07:39.062845] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-09T17:07:39.063036] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-09T17:07:39.063091] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-09T17:07:39.201941] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-09T17:07:39.409575] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:39.996746] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-09T17:07:40.796787] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-09T17:07:40.849980] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T17:07:41.539936] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-09T17:07:41.596705] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-09T17:07:42.396735] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-09T17:07:42.570274] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T17:07:43.196724] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-09T17:07:43.320027] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T17:07:43.478244] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T17:07:43.996754] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-09T17:07:44.685634] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T17:07:44.796722] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-09T17:07:44.914863] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T17:07:45.596724] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-09T17:07:45.839205] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T17:07:46.396719] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-09T17:07:46.941383] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T17:07:47.196712] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-09T17:07:47.494048] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T17:07:47.906121] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T17:07:47.996692] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-09T17:07:48.796716] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-09T17:07:49.596686] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-09T17:07:49.671859] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T17:07:49.950909] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T17:07:50.396801] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-09T17:07:51.196734] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-09T17:07:51.204414] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T17:07:51.926530] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-09T17:07:51.996732] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-09T17:07:52.398420] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T17:07:52.796722] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-09T17:07:53.596720] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-09T17:07:53.956821] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:07:54.159976] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-09T17:07:54.396796] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-09T17:07:55.196686] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-09T17:07:55.631548] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-09T17:07:55.772010] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T17:07:55.773113] [INFO ] [REMOTE ] AHT: Full fetch complete (9173 records). [2025-10-09T17:07:55.773182] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-09T17:07:56.002033] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-09T17:07:56.152915] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-09T17:07:56.152995] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-09T17:07:56.153216] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-09T17:07:56.153255] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-09T17:07:56.153723] [DEBUG] [LOCAL ] AHT: Trimmed 9173 records to 6268 (keeping 200 days of data) [2025-10-09T17:07:56.191934] [DEBUG] [LOCAL ] AHT: Primary data saved (6268 records). [2025-10-09T17:07:56.192049] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-09T17:07:56.192131] [INFO ] [MAIN ] Update Progress: 64/2373 symbols completed. AHT took 31.1s. Estimated remaining: 4h 44m 12s. Rate: 8.1 symbols/min [2025-10-09T17:07:56.362354] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:07:56.378731] [DEBUG] [LOCAL ] AIO: Loaded 13421 existing records from primary storage. [2025-10-09T17:07:56.378991] [INFO ] [MAIN ] AIO: Loaded 13421 existing records. [2025-10-09T17:07:56.570866] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:07:56.571268] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-09T17:07:56.571348] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-09T17:07:56.571710] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-09T17:07:56.571773] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-09T17:07:56.769998] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-09T17:07:56.806096] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-09T17:07:56.986943] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:07:57.107324] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T17:07:57.596760] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-09T17:07:58.169457] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T17:07:58.396727] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-09T17:07:59.196766] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-09T17:07:59.474846] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:07:59.996763] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-09T17:08:00.134166] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T17:08:00.199397] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-09T17:08:00.796725] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-09T17:08:01.596730] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-09T17:08:01.680093] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:08:01.726715] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T17:08:02.396740] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-09T17:08:03.196721] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-09T17:08:03.996730] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-09T17:08:04.148285] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-09T17:08:04.175104] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T17:08:04.520750] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T17:08:04.540394] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T17:08:04.796730] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-09T17:08:05.596747] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-09T17:08:06.396705] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-09T17:08:06.596595] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T17:08:07.196710] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-09T17:08:07.233804] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-10-09T17:08:07.322365] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T17:08:07.996783] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-09T17:08:08.739073] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T17:08:08.796677] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-09T17:08:08.971424] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T17:08:09.596721] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-09T17:08:10.396696] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-09T17:08:10.477188] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T17:08:10.499299] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T17:08:11.196730] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-09T17:08:11.996805] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-09T17:08:12.782443] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-09T17:08:12.787119] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-09T17:08:12.787242] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-09T17:08:12.808854] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-09T17:08:12.951816] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T17:08:13.097362] [INFO ] [REMOTE ] AIG: Full fetch complete (77383 records). [2025-10-09T17:08:13.110500] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-09T17:08:13.140684] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T17:08:13.353254] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-09T17:08:13.371981] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-09T17:08:13.378057] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-09T17:08:13.383737] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-09T17:08:13.515295] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54145 (keeping 200 days of data) [2025-10-09T17:08:13.616351] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-09T17:08:13.766774] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-09T17:08:13.767147] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-09T17:08:13.769636] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-09T17:08:13.770249] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-09T17:08:13.774592] [DEBUG] [LOCAL ] AIG: Trimmed 77383 records to 53863 (keeping 200 days of data) [2025-10-09T17:08:13.992852] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T17:08:13.998274] [INFO ] [REMOTE ] AIN: Full fetch complete (33550 records). [2025-10-09T17:08:13.999355] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-09T17:08:14.499813] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-09T17:08:14.505225] [DEBUG] [LOCAL ] AI: Primary data saved (54145 records). [2025-10-09T17:08:14.505361] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-09T17:08:14.507045] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-09T17:08:14.507920] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-09T17:08:14.507187] [INFO ] [MAIN ] AI: Full history saved. [2025-10-09T17:08:14.517028] [INFO ] [MAIN ] Update Progress: 65/2373 symbols completed. AI took 41.4s. Estimated remaining: 4h 50m 33s. Rate: 7.9 symbols/min [2025-10-09T17:08:14.519630] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T17:08:14.535350] [DEBUG] [LOCAL ] AIN: Trimmed 33550 records to 24721 (keeping 200 days of data) [2025-10-09T17:08:14.624279] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-09T17:08:14.883349] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:14.926928] [DEBUG] [LOCAL ] AIR: Loaded 28818 existing records from primary storage. [2025-10-09T17:08:14.929728] [INFO ] [MAIN ] AIR: Loaded 28818 existing records. [2025-10-09T17:08:15.126154] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:15.127581] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-09T17:08:15.128994] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-09T17:08:15.130358] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-09T17:08:15.130707] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-09T17:08:15.541708] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:15.582385] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-09T17:08:15.590373] [DEBUG] [LOCAL ] AIN: Primary data saved (24721 records). [2025-10-09T17:08:15.591128] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-09T17:08:15.591341] [INFO ] [MAIN ] Update Progress: 66/2373 symbols completed. AIN took 36.9s. Estimated remaining: 4h 46m 39s. Rate: 8.0 symbols/min [2025-10-09T17:08:15.678845] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T17:08:15.752308] [DEBUG] [LOCAL ] AIG: Primary data saved (53863 records). [2025-10-09T17:08:15.763328] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-09T17:08:15.769900] [INFO ] [MAIN ] Update Progress: 67/2373 symbols completed. AIG took 40.3s. Estimated remaining: 4h 42m 21s. Rate: 8.2 symbols/min [2025-10-09T17:08:15.926736] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:16.006522] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-09T17:08:16.006441] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:16.026971] [DEBUG] [LOCAL ] AIT: Loaded 27109 existing records from primary storage. [2025-10-09T17:08:16.027300] [INFO ] [MAIN ] AIT: Loaded 27109 existing records. [2025-10-09T17:08:16.229577] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:16.230843] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-09T17:08:16.230955] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-09T17:08:16.231570] [DEBUG] [LOCAL ] AIV: Loaded 40918 existing records from primary storage. [2025-10-09T17:08:16.231980] [INFO ] [MAIN ] AIV: Loaded 40918 existing records. [2025-10-09T17:08:16.232034] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-09T17:08:16.232132] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-09T17:08:16.596375] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:16.607115] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-09T17:08:16.636752] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-09T17:08:16.648627] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-09T17:08:16.669343] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-09T17:08:16.899480] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:16.938125] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-09T17:08:17.127507] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:08:17.167626] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:17.138455] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T17:08:17.596715] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-09T17:08:18.367161] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:08:18.396665] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-09T17:08:18.607816] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T17:08:19.196717] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-09T17:08:19.346238] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T17:08:19.843377] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T17:08:19.996739] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-09T17:08:20.796727] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-09T17:08:21.167558] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T17:08:21.596722] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-09T17:08:22.352421] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:08:22.396666] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-09T17:08:22.491456] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T17:08:22.493142] [INFO ] [REMOTE ] AIO: Full fetch complete (20110 records). [2025-10-09T17:08:22.493224] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-09T17:08:22.849018] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-09T17:08:22.849097] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-09T17:08:22.849390] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-09T17:08:22.849428] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-09T17:08:22.850003] [DEBUG] [LOCAL ] AIO: Trimmed 20110 records to 13483 (keeping 200 days of data) [2025-10-09T17:08:22.933170] [DEBUG] [LOCAL ] AIO: Primary data saved (13483 records). [2025-10-09T17:08:22.933318] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-09T17:08:22.933401] [INFO ] [MAIN ] Update Progress: 68/2373 symbols completed. AIO took 26.7s. Estimated remaining: 4h 42m 8s. Rate: 8.2 symbols/min [2025-10-09T17:08:23.097677] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:23.128202] [DEBUG] [LOCAL ] AIZ: Loaded 29684 existing records from primary storage. [2025-10-09T17:08:23.128523] [INFO ] [MAIN ] AIZ: Loaded 29684 existing records. [2025-10-09T17:08:23.201819] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-09T17:08:23.305795] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:23.305989] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-09T17:08:23.306036] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-09T17:08:23.306292] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-09T17:08:23.306353] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-09T17:08:23.691408] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:23.893859] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T17:08:23.996787] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-09T17:08:24.320851] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T17:08:24.796757] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-09T17:08:25.313978] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T17:08:25.596729] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-09T17:08:26.228339] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:08:26.396755] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-09T17:08:27.196682] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-09T17:08:27.360105] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T17:08:27.921037] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T17:08:27.996714] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-09T17:08:28.721027] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T17:08:28.796714] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-09T17:08:29.471255] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T17:08:29.596668] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-09T17:08:29.911883] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T17:08:30.396827] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-09T17:08:30.748611] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T17:08:31.196762] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-09T17:08:31.996685] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-09T17:08:32.198185] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:08:32.277689] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T17:08:32.796735] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-09T17:08:33.534787] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T17:08:33.596697] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-09T17:08:34.141169] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T17:08:34.396774] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-09T17:08:35.021000] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T17:08:35.196717] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-09T17:08:35.864262] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T17:08:35.996752] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-09T17:08:36.490397] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T17:08:36.796734] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-09T17:08:37.411455] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T17:08:37.596687] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-09T17:08:38.064568] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T17:08:38.396769] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-09T17:08:38.568697] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T17:08:39.196705] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-09T17:08:39.511134] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T17:08:39.996731] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-09T17:08:40.603374] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T17:08:40.796730] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-09T17:08:41.386437] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T17:08:41.596742] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-09T17:08:42.396780] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-09T17:08:42.428911] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T17:08:42.432319] [INFO ] [REMOTE ] AIR: Full fetch complete (39511 records). [2025-10-09T17:08:42.432447] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-09T17:08:42.433037] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:08:42.433124] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:08:42.433168] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:08:42.433246] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-09T17:08:42.433346] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-09T17:08:42.433400] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-10-09T17:08:42.433719] [DEBUG] [LOCAL ] AIR: Deleted derivative data file. [2025-10-09T17:08:42.433831] [INFO ] [MAIN ] Update Progress: 69/2373 symbols completed. AIR took 27.9s. Estimated remaining: 4h 48m 46s. Rate: 8.0 symbols/min [2025-10-09T17:08:42.611494] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:42.624874] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T17:08:42.634287] [DEBUG] [LOCAL ] AIZN: Loaded 4106 existing records from primary storage. [2025-10-09T17:08:42.634508] [INFO ] [MAIN ] AIZN: Loaded 4106 existing records. [2025-10-09T17:08:42.808259] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:42.808503] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-09T17:08:42.808560] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-09T17:08:42.808761] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-09T17:08:42.808818] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-09T17:08:43.160291] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:43.196679] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-09T17:08:43.996703] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-09T17:08:44.009743] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T17:08:44.095491] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T17:08:44.796760] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-09T17:08:45.226837] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T17:08:45.596687] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-09T17:08:45.690558] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T17:08:46.396695] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-09T17:08:46.623441] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T17:08:46.625577] [INFO ] [REMOTE ] AIT: Full fetch complete (39186 records). [2025-10-09T17:08:46.625677] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-09T17:08:46.997420] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T17:08:47.015291] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-09T17:08:47.015358] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-09T17:08:47.015820] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-09T17:08:47.015887] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-09T17:08:47.016794] [DEBUG] [LOCAL ] AIT: Trimmed 39186 records to 27293 (keeping 200 days of data) [2025-10-09T17:08:47.188843] [DEBUG] [LOCAL ] AIT: Primary data saved (27293 records). [2025-10-09T17:08:47.188983] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-09T17:08:47.189063] [INFO ] [MAIN ] Update Progress: 70/2373 symbols completed. AIT took 31.6s. Estimated remaining: 4h 47m 8s. Rate: 8.0 symbols/min [2025-10-09T17:08:47.201895] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-09T17:08:47.364035] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:47.406566] [DEBUG] [LOCAL ] AJG: Loaded 46653 existing records from primary storage. [2025-10-09T17:08:47.406959] [INFO ] [MAIN ] AJG: Loaded 46653 existing records. [2025-10-09T17:08:47.590132] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:08:47.590375] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-09T17:08:47.590424] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-09T17:08:47.590759] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-09T17:08:47.590818] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-09T17:08:47.973112] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:47.996736] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-09T17:08:48.636965] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T17:08:48.638065] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:08:48.796730] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-09T17:08:49.371519] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T17:08:49.596724] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-09T17:08:50.396738] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-09T17:08:50.997898] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:08:51.196734] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-09T17:08:51.996701] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-09T17:08:52.044238] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T17:08:52.126976] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T17:08:52.796719] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-09T17:08:53.596714] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-09T17:08:53.981041] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T17:08:54.256370] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T17:08:54.260404] [INFO ] [REMOTE ] AIV: Full fetch complete (60119 records). [2025-10-09T17:08:54.260518] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-09T17:08:54.400261] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-09T17:08:54.668629] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-09T17:08:54.678683] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-09T17:08:54.680101] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-09T17:08:54.680787] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:08:54.686788] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-09T17:08:54.688597] [DEBUG] [LOCAL ] AIV: Trimmed 60119 records to 41248 (keeping 200 days of data) [2025-10-09T17:08:54.922690] [DEBUG] [LOCAL ] AIV: Primary data saved (41248 records). [2025-10-09T17:08:54.922822] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-09T17:08:54.922898] [INFO ] [MAIN ] Update Progress: 71/2373 symbols completed. AIV took 39.1s. Estimated remaining: 4h 47m 8s. Rate: 8.0 symbols/min [2025-10-09T17:08:55.091053] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:08:55.091274] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-09T17:08:55.091331] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-09T17:08:55.091487] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-09T17:08:55.091528] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-09T17:08:55.091611] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-09T17:08:55.091689] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-09T17:08:55.163369] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T17:08:55.201802] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-09T17:08:55.476221] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:08:55.806079] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T17:08:55.996735] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-09T17:08:56.796731] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-09T17:08:57.344782] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T17:08:57.378221] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T17:08:57.596728] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-09T17:08:58.219389] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T17:08:58.396721] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-09T17:08:59.196688] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-09T17:08:59.317372] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T17:08:59.996727] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-09T17:09:00.796702] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-09T17:09:00.997507] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T17:09:01.365368] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T17:09:01.527436] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T17:09:01.529951] [INFO ] [REMOTE ] AIZ: Full fetch complete (42832 records). [2025-10-09T17:09:01.530081] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-09T17:09:01.601896] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-09T17:09:01.910962] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-09T17:09:01.911045] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-09T17:09:01.911513] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-09T17:09:01.911559] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-09T17:09:01.912545] [DEBUG] [LOCAL ] AIZ: Trimmed 42832 records to 29831 (keeping 200 days of data) [2025-10-09T17:09:02.115547] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-09T17:09:02.121476] [DEBUG] [LOCAL ] AIZ: Primary data saved (29831 records). [2025-10-09T17:09:02.121575] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-09T17:09:02.121671] [INFO ] [MAIN ] Update Progress: 72/2373 symbols completed. AIZ took 39.2s. Estimated remaining: 4h 46m 52s. Rate: 8.0 symbols/min [2025-10-09T17:09:02.295392] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:09:02.348711] [DEBUG] [LOCAL ] AKR: Loaded 45857 existing records from primary storage. [2025-10-09T17:09:02.349052] [INFO ] [MAIN ] AKR: Loaded 45857 existing records. [2025-10-09T17:09:02.401805] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-09T17:09:02.551774] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:09:02.552018] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-09T17:09:02.552113] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-09T17:09:02.552394] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-09T17:09:02.552450] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-09T17:09:02.906979] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:09:02.946214] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T17:09:03.196747] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-09T17:09:03.773028] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T17:09:03.996728] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-09T17:09:04.796729] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-09T17:09:05.270760] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T17:09:05.596701] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-09T17:09:05.640681] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:09:06.396783] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-09T17:09:06.827907] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-09T17:09:07.209727] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-09T17:09:07.212025] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T17:09:07.965499] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T17:09:07.966549] [INFO ] [REMOTE ] AIZN: Full fetch complete (5932 records). [2025-10-09T17:09:07.966620] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-09T17:09:08.001907] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-09T17:09:08.395863] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-09T17:09:08.395951] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-09T17:09:08.396139] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-09T17:09:08.396202] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-09T17:09:08.396671] [DEBUG] [LOCAL ] AIZN: Trimmed 5932 records to 4137 (keeping 200 days of data) [2025-10-09T17:09:08.425592] [DEBUG] [LOCAL ] AIZN: Primary data saved (4137 records). [2025-10-09T17:09:08.425701] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-09T17:09:08.425790] [INFO ] [MAIN ] Update Progress: 73/2373 symbols completed. AIZN took 26.0s. Estimated remaining: 4h 46m 7s. Rate: 8.0 symbols/min [2025-10-09T17:09:08.631428] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:09:08.635791] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T17:09:08.679626] [DEBUG] [LOCAL ] AL: Loaded 44474 existing records from primary storage. [2025-10-09T17:09:08.679954] [INFO ] [MAIN ] AL: Loaded 44474 existing records. [2025-10-09T17:09:08.801805] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-09T17:09:08.869009] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:09:08.869330] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-09T17:09:08.869391] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-09T17:09:08.870195] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-09T17:09:08.870256] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-09T17:09:09.226392] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:09:09.483777] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T17:09:09.596756] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-09T17:09:10.396762] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-09T17:09:11.196780] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-09T17:09:11.430022] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T17:09:11.538282] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T17:09:11.559993] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T17:09:11.996738] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-09T17:09:12.796732] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-09T17:09:13.380468] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T17:09:13.596736] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-09T17:09:13.908664] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-09T17:09:14.396683] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-09T17:09:14.424925] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T17:09:14.796247] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T17:09:15.196724] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-09T17:09:15.779173] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T17:09:15.779885] [INFO ] [REMOTE ] AKA: Full fetch complete (2417 records). [2025-10-09T17:09:15.779953] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-09T17:09:15.963223] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T17:09:15.963440] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:09:15.963502] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:09:15.963583] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-09T17:09:15.963679] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-09T17:09:15.963737] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-09T17:09:15.963782] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-09T17:09:15.963840] [INFO ] [MAIN ] Update Progress: 74/2373 symbols completed. AKA took 21.0s. Estimated remaining: 4h 46m 2s. Rate: 8.0 symbols/min [2025-10-09T17:09:16.001946] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-09T17:09:16.145488] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:09:16.197807] [DEBUG] [LOCAL ] ALB: Loaded 53288 existing records from primary storage. [2025-10-09T17:09:16.198162] [INFO ] [MAIN ] ALB: Loaded 53288 existing records. [2025-10-09T17:09:16.373174] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:09:16.373366] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-09T17:09:16.373412] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-09T17:09:16.373693] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-09T17:09:16.373752] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-09T17:09:16.735638] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:09:16.796728] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-09T17:09:17.603514] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-09T17:09:17.630226] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T17:09:18.179383] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T17:09:18.396739] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-09T17:09:19.196721] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-09T17:09:19.369002] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:09:19.818263] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T17:09:19.996746] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-09T17:09:20.498849] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T17:09:20.796735] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-09T17:09:21.463177] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:09:21.596741] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-09T17:09:22.396692] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-09T17:09:22.428246] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T17:09:23.052959] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T17:09:23.196744] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-09T17:09:23.996723] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-09T17:09:24.342238] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-09T17:09:24.737899] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T17:09:24.796739] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-09T17:09:25.230523] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T17:09:25.596728] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-09T17:09:26.396684] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-09T17:09:26.515275] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:09:26.952468] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T17:09:27.196714] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-09T17:09:27.996705] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-09T17:09:28.123137] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:09:28.796686] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-09T17:09:28.822162] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:09:29.050408] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T17:09:29.596711] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-09T17:09:30.249882] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T17:09:30.396750] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-09T17:09:31.196694] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-09T17:09:31.240694] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:09:31.996707] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-09T17:09:32.071042] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T17:09:32.575711] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T17:09:32.796739] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-09T17:09:33.318959] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T17:09:33.596731] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-09T17:09:34.396698] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-09T17:09:34.656175] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T17:09:35.160615] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T17:09:35.196676] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-09T17:09:35.996687] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-09T17:09:36.090272] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:09:36.551509] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:09:36.796697] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-09T17:09:37.498280] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:09:37.596676] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-09T17:09:38.083435] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T17:09:38.396786] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-09T17:09:39.151272] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T17:09:39.155234] [INFO ] [REMOTE ] AJG: Full fetch complete (69094 records). [2025-10-09T17:09:39.155398] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-09T17:09:39.201816] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-09T17:09:39.547295] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-09T17:09:39.547376] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-09T17:09:39.548126] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-09T17:09:39.548193] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-09T17:09:39.549587] [DEBUG] [LOCAL ] AJG: Trimmed 69094 records to 46983 (keeping 200 days of data) [2025-10-09T17:09:39.848191] [DEBUG] [LOCAL ] AJG: Primary data saved (46983 records). [2025-10-09T17:09:39.848322] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-09T17:09:39.849698] [INFO ] [MAIN ] Update Progress: 75/2373 symbols completed. AJG took 52.7s. Estimated remaining: 4h 54m 18s. Rate: 7.8 symbols/min [2025-10-09T17:09:40.003557] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-09T17:09:40.023313] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:09:40.078567] [DEBUG] [LOCAL ] ALC: Loaded 51032 existing records from primary storage. [2025-10-09T17:09:40.078905] [INFO ] [MAIN ] ALC: Loaded 51032 existing records. [2025-10-09T17:09:40.256452] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:09:40.256775] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-09T17:09:40.256830] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-09T17:09:40.257043] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-09T17:09:40.257100] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-09T17:09:40.649447] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:09:40.695274] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T17:09:40.701286] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-09T17:09:40.713147] [INFO ] [REMOTE ] AKR: Full fetch complete (65240 records). [2025-10-09T17:09:40.713772] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-09T17:09:40.802269] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-09T17:09:41.097296] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-09T17:09:41.097377] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-09T17:09:41.098033] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-09T17:09:41.098097] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-09T17:09:41.099427] [DEBUG] [LOCAL ] AKR: Trimmed 65240 records to 46135 (keeping 200 days of data) [2025-10-09T17:09:41.380114] [DEBUG] [LOCAL ] AKR: Primary data saved (46135 records). [2025-10-09T17:09:41.380246] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-09T17:09:41.381411] [INFO ] [MAIN ] Update Progress: 76/2373 symbols completed. AKR took 39.3s. Estimated remaining: 4h 51m 4s. Rate: 7.9 symbols/min [2025-10-09T17:09:41.554744] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:09:41.589980] [DEBUG] [LOCAL ] ALE: Loaded 31298 existing records from primary storage. [2025-10-09T17:09:41.590255] [INFO ] [MAIN ] ALE: Loaded 31298 existing records. [2025-10-09T17:09:41.620753] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-09T17:09:41.776745] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T17:09:41.782569] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:09:41.786327] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-09T17:09:41.786512] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-09T17:09:41.786829] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-09T17:09:41.786891] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-09T17:09:41.818393] [INFO ] [REMOTE ] AL: Full fetch complete (62875 records). [2025-10-09T17:09:41.862558] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-09T17:09:42.432317] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:09:42.443190] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-09T17:09:42.628824] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-09T17:09:42.628934] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-09T17:09:42.629541] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-09T17:09:42.629583] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-09T17:09:42.630923] [DEBUG] [LOCAL ] AL: Trimmed 62875 records to 44819 (keeping 200 days of data) [2025-10-09T17:09:42.902084] [DEBUG] [LOCAL ] AL: Primary data saved (44819 records). [2025-10-09T17:09:42.902244] [INFO ] [MAIN ] AL: Full history saved. [2025-10-09T17:09:42.902332] [INFO ] [MAIN ] Update Progress: 77/2373 symbols completed. AL took 34.5s. Estimated remaining: 4h 47m 55s. Rate: 8.0 symbols/min [2025-10-09T17:09:42.971361] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-09T17:09:43.196733] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-09T17:09:43.326075] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T17:09:43.457268] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T17:09:43.996778] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-09T17:09:44.796742] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-09T17:09:45.549226] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T17:09:45.605226] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-09T17:09:45.608210] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-09T17:09:46.091917] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T17:09:46.396797] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-09T17:09:47.001243] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T17:09:47.196740] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-09T17:09:47.996773] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-09T17:09:48.581857] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T17:09:48.664114] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-09T17:09:48.781533] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T17:09:48.796681] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-09T17:09:49.596766] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-09T17:09:50.396704] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-09T17:09:50.712449] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T17:09:51.196736] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-09T17:09:51.414328] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T17:09:51.712740] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-09T17:09:51.996761] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-09T17:09:52.728173] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T17:09:52.796685] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-09T17:09:53.276724] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T17:09:53.596718] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-09T17:09:54.321893] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T17:09:54.396745] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-09T17:09:54.811301] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T17:09:55.196733] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-09T17:09:55.996791] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-09T17:09:56.938503] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T17:09:56.953900] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-09T17:09:56.984675] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:09:57.007454] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-09T17:09:57.012739] [INFO ] [REMOTE ] ALB: Full fetch complete (76892 records). [2025-10-09T17:09:57.012921] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-09T17:09:57.456313] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-09T17:09:57.456458] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-09T17:09:57.457790] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-09T17:09:57.457917] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-09T17:09:57.460484] [DEBUG] [LOCAL ] ALB: Trimmed 76892 records to 53678 (keeping 200 days of data) [2025-10-09T17:09:57.596899] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-09T17:09:57.836773] [DEBUG] [LOCAL ] ALB: Primary data saved (53678 records). [2025-10-09T17:09:57.836979] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-09T17:09:57.837667] [INFO ] [MAIN ] Update Progress: 78/2373 symbols completed. ALB took 41.9s. Estimated remaining: 4h 51m 26s. Rate: 7.9 symbols/min [2025-10-09T17:09:58.598744] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T17:09:58.610422] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-09T17:09:59.162734] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:09:59.196795] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-09T17:10:00.360734] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T17:10:00.372219] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-09T17:10:00.778006] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T17:10:00.796686] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-09T17:10:05.957563] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (5.59 seconds). [2025-10-09T17:10:05.962104] [INFO ] [REMOTE ] ALC: Full fetch complete (73181 records). [2025-10-09T17:10:05.962228] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-09T17:10:06.374002] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (5.58 seconds). [2025-10-09T17:10:06.423558] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-09T17:10:06.424502] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-09T17:10:06.424562] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-09T17:10:06.425507] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-09T17:10:06.425586] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-09T17:10:06.427238] [DEBUG] [LOCAL ] ALC: Trimmed 73181 records to 51409 (keeping 200 days of data) [2025-10-09T17:10:06.750023] [DEBUG] [LOCAL ] ALC: Primary data saved (51409 records). [2025-10-09T17:10:06.750169] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-09T17:10:06.751149] [INFO ] [MAIN ] Update Progress: 79/2373 symbols completed. ALC took 26.9s. Estimated remaining: 4h 51m 56s. Rate: 7.9 symbols/min [2025-10-09T17:10:07.851606] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:10:07.855079] [INFO ] [REMOTE ] ALE: Full fetch complete (43414 records). [2025-10-09T17:10:07.855171] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-09T17:10:08.224456] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-09T17:10:08.224533] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-09T17:10:08.225193] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-09T17:10:08.225257] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-09T17:10:08.226248] [DEBUG] [LOCAL ] ALE: Trimmed 43414 records to 31566 (keeping 200 days of data) [2025-10-09T17:10:08.418800] [DEBUG] [LOCAL ] ALE: Primary data saved (31566 records). [2025-10-09T17:10:08.418938] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-09T17:10:08.419834] [INFO ] [MAIN ] Update Progress: 80/2373 symbols completed. ALE took 27.0s. Estimated remaining: 4h 48m 57s. Rate: 7.9 symbols/min [2025-10-09T17:10:08.991588] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:09.001958] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:09.139285] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:09.184574] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:09.185483] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-09T17:10:09.185592] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-09T17:10:09.185772] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-09T17:10:09.185827] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-09T17:10:09.185879] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-09T17:10:09.185919] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-09T17:10:09.356553] [DEBUG] [LOCAL ] ALG: Loaded 9862 existing records from primary storage. [2025-10-09T17:10:09.384935] [INFO ] [MAIN ] ALG: Loaded 9862 existing records. [2025-10-09T17:10:09.422581] [DEBUG] [LOCAL ] ALEX: Loaded 31184 existing records from primary storage. [2025-10-09T17:10:09.476211] [INFO ] [MAIN ] ALEX: Loaded 31184 existing records. [2025-10-09T17:10:09.692968] [DEBUG] [LOCAL ] ALIT: Loaded 52779 existing records from primary storage. [2025-10-09T17:10:09.726874] [INFO ] [MAIN ] ALIT: Loaded 52779 existing records. [2025-10-09T17:10:10.365476] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:10.412690] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-09T17:10:10.431824] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:10.418137] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-09T17:10:10.507681] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-09T17:10:10.508426] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-09T17:10:10.562042] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:10.556113] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-09T17:10:10.559181] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:10.562284] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-09T17:10:10.562711] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-09T17:10:10.562940] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-09T17:10:10.563037] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-09T17:10:10.562545] [INFO ] [REMOTE ] ALH: Fetching primary data for 2024-12. [2025-10-09T17:10:10.563149] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-09T17:10:10.656698] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-09T17:10:10.663683] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-09T17:10:11.006786] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:10:11.195968] [WARN ] [REMOTE ] ALH: No data returned for month 2024-12 [2025-10-09T17:10:11.310919] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:10:11.380277] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-09T17:10:11.411464] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:10:11.430982] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-09T17:10:11.518161] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-09T17:10:11.667778] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:11.688575] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-09T17:10:11.592401] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-09T17:10:11.702676] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-09T17:10:11.706911] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:11.728839] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-09T17:10:11.727775] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:11.727927] [INFO ] [MAIN ] Update Progress: 81/2373 symbols completed. ALH took 3.3s. Estimated remaining: 4h 46m 49s. Rate: 8.0 symbols/min [2025-10-09T17:10:11.731187] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-09T17:10:11.908674] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:11.959339] [DEBUG] [LOCAL ] ALK: Loaded 53058 existing records from primary storage. [2025-10-09T17:10:11.959699] [INFO ] [MAIN ] ALK: Loaded 53058 existing records. [2025-10-09T17:10:12.132254] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:12.132494] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-09T17:10:12.132541] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-09T17:10:12.132789] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-09T17:10:12.132847] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-09T17:10:12.479619] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:12.479980] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-09T17:10:13.053964] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:10:13.056867] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-09T17:10:13.309079] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T17:10:13.343819] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-09T17:10:13.346453] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:10:13.357037] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-09T17:10:13.961216] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T17:10:13.964211] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-09T17:10:14.417206] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:10:14.424795] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-09T17:10:15.034714] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:10:15.052223] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-09T17:10:15.053784] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T17:10:15.056854] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-09T17:10:15.102816] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-09T17:10:15.113549] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-09T17:10:15.234247] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T17:10:15.239778] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-09T17:10:16.221170] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T17:10:16.224902] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-09T17:10:16.675078] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T17:10:16.716445] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-09T17:10:16.719101] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:10:16.727130] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-09T17:10:16.990498] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T17:10:17.001296] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-09T17:10:17.143280] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T17:10:17.146327] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-09T17:10:17.864049] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T17:10:17.866797] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-09T17:10:17.949034] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T17:10:18.396694] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-09T17:10:18.440940] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T17:10:18.728023] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:10:18.768991] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T17:10:19.196743] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-09T17:10:19.334106] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T17:10:19.996724] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-09T17:10:20.796767] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-09T17:10:20.942370] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T17:10:21.007432] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T17:10:21.272614] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T17:10:21.596730] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-09T17:10:22.396769] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-09T17:10:23.147633] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T17:10:23.196677] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-09T17:10:23.456830] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T17:10:23.912402] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T17:10:23.996728] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-09T17:10:24.796754] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-09T17:10:25.413518] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T17:10:25.489825] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:10:25.490950] [INFO ] [REMOTE ] ALG: Full fetch complete (15615 records). [2025-10-09T17:10:25.491020] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-09T17:10:25.598747] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-09T17:10:25.860591] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-09T17:10:25.860694] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-09T17:10:25.860948] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-09T17:10:25.860989] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-09T17:10:25.861453] [DEBUG] [LOCAL ] ALG: Trimmed 15615 records to 9904 (keeping 200 days of data) [2025-10-09T17:10:25.924568] [DEBUG] [LOCAL ] ALG: Primary data saved (9904 records). [2025-10-09T17:10:25.924727] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-09T17:10:25.924816] [INFO ] [MAIN ] Update Progress: 82/2373 symbols completed. ALG took 17.5s. Estimated remaining: 4h 49m 48s. Rate: 7.9 symbols/min [2025-10-09T17:10:26.103800] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:26.152446] [DEBUG] [LOCAL ] ALL: Loaded 49900 existing records from primary storage. [2025-10-09T17:10:26.152785] [INFO ] [MAIN ] ALL: Loaded 49900 existing records. [2025-10-09T17:10:26.339393] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:26.339675] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-09T17:10:26.339735] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-09T17:10:26.339992] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-09T17:10:26.340049] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-09T17:10:26.406395] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-09T17:10:26.693497] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:27.196814] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-09T17:10:27.291487] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T17:10:27.785868] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:10:27.996687] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-09T17:10:28.331113] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T17:10:28.796718] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-09T17:10:29.596688] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-09T17:10:29.743765] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T17:10:30.226678] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:10:30.396719] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-09T17:10:30.888729] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T17:10:31.196751] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-09T17:10:31.996726] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-09T17:10:32.332157] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T17:10:32.796748] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-09T17:10:33.029720] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T17:10:33.033216] [INFO ] [REMOTE ] ALEX: Full fetch complete (44703 records). [2025-10-09T17:10:33.033440] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-09T17:10:33.152522] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T17:10:33.447898] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-09T17:10:33.448015] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-09T17:10:33.448554] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-09T17:10:33.448596] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-09T17:10:33.449603] [DEBUG] [LOCAL ] ALEX: Trimmed 44703 records to 31426 (keeping 200 days of data) [2025-10-09T17:10:33.602154] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-09T17:10:33.643388] [DEBUG] [LOCAL ] ALEX: Primary data saved (31426 records). [2025-10-09T17:10:33.643526] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-09T17:10:33.643621] [INFO ] [MAIN ] Update Progress: 83/2373 symbols completed. ALEX took 25.2s. Estimated remaining: 4h 49m 44s. Rate: 7.9 symbols/min [2025-10-09T17:10:33.829535] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:33.875371] [DEBUG] [LOCAL ] ALLE: Loaded 44372 existing records from primary storage. [2025-10-09T17:10:33.875783] [INFO ] [MAIN ] ALLE: Loaded 44372 existing records. [2025-10-09T17:10:34.050177] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:34.050443] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-09T17:10:34.050490] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-09T17:10:34.050902] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-09T17:10:34.050959] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-09T17:10:34.399868] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-09T17:10:34.436846] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:34.568289] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T17:10:35.196691] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-09T17:10:35.362709] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:10:35.996744] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-09T17:10:36.136789] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T17:10:36.506049] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T17:10:36.796739] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-09T17:10:37.596743] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-09T17:10:37.719755] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T17:10:38.396711] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-09T17:10:38.679045] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T17:10:39.196694] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-09T17:10:39.512745] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T17:10:39.996721] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-09T17:10:40.195340] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T17:10:40.566436] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T17:10:40.796737] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-09T17:10:41.596749] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-09T17:10:42.059963] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-09T17:10:42.122895] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T17:10:42.396720] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-09T17:10:43.196691] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-09T17:10:43.432812] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T17:10:43.437365] [INFO ] [REMOTE ] ALK: Full fetch complete (76836 records). [2025-10-09T17:10:43.437473] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-09T17:10:43.844062] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-09T17:10:43.844250] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-09T17:10:43.845426] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-09T17:10:43.845539] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-09T17:10:43.847207] [DEBUG] [LOCAL ] ALK: Trimmed 76836 records to 53447 (keeping 200 days of data) [2025-10-09T17:10:44.012188] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-09T17:10:44.089277] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T17:10:44.205310] [DEBUG] [LOCAL ] ALK: Primary data saved (53447 records). [2025-10-09T17:10:44.205478] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-09T17:10:44.206418] [INFO ] [MAIN ] Update Progress: 84/2373 symbols completed. ALK took 32.5s. Estimated remaining: 4h 50m 58s. Rate: 7.9 symbols/min [2025-10-09T17:10:44.388067] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:44.440666] [DEBUG] [LOCAL ] ALLY: Loaded 53228 existing records from primary storage. [2025-10-09T17:10:44.441016] [INFO ] [MAIN ] ALLY: Loaded 53228 existing records. [2025-10-09T17:10:44.617558] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:44.617940] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-09T17:10:44.618029] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-09T17:10:44.618414] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-09T17:10:44.618472] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-09T17:10:44.809711] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-09T17:10:44.978090] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:45.024041] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T17:10:45.602472] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-09T17:10:45.604220] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T17:10:46.396737] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-09T17:10:46.489745] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:10:47.196716] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-09T17:10:47.452372] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-09T17:10:47.996735] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-09T17:10:48.064398] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T17:10:48.796740] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-09T17:10:48.994255] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:10:49.411816] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T17:10:49.417077] [INFO ] [REMOTE ] ALIT: Full fetch complete (76440 records). [2025-10-09T17:10:49.417234] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-09T17:10:49.599786] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-09T17:10:49.825305] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-09T17:10:49.825400] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-09T17:10:49.826162] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-09T17:10:49.826232] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-09T17:10:49.827799] [DEBUG] [LOCAL ] ALIT: Trimmed 76440 records to 53167 (keeping 200 days of data) [2025-10-09T17:10:50.135903] [DEBUG] [LOCAL ] ALIT: Primary data saved (53167 records). [2025-10-09T17:10:50.136045] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-09T17:10:50.137170] [INFO ] [MAIN ] Update Progress: 85/2373 symbols completed. ALIT took 41.7s. Estimated remaining: 4h 50m 5s. Rate: 7.9 symbols/min [2025-10-09T17:10:50.338065] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:10:50.382180] [DEBUG] [LOCAL ] ALSN: Loaded 43352 existing records from primary storage. [2025-10-09T17:10:50.382476] [INFO ] [MAIN ] ALSN: Loaded 43352 existing records. [2025-10-09T17:10:50.414254] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-09T17:10:50.569061] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:10:50.569381] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-09T17:10:50.569489] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-09T17:10:50.569781] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-09T17:10:50.569841] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-09T17:10:50.962122] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:10:50.975814] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-09T17:10:51.019574] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T17:10:51.196697] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-09T17:10:51.983031] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T17:10:51.996672] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-09T17:10:52.796743] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-09T17:10:53.126494] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-09T17:10:53.267553] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T17:10:53.596742] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-09T17:10:54.406379] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-09T17:10:54.409295] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T17:10:55.196689] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-09T17:10:55.278260] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T17:10:55.998184] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-09T17:10:56.003935] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T17:10:56.796711] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-09T17:10:56.851517] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T17:10:57.306308] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T17:10:57.596745] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-09T17:10:58.396715] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-09T17:10:58.457552] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T17:10:59.039147] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T17:10:59.196808] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-09T17:10:59.996755] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-09T17:11:00.033985] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T17:11:00.038091] [INFO ] [REMOTE ] ALL: Full fetch complete (72341 records). [2025-10-09T17:11:00.038222] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-09T17:11:00.440908] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-09T17:11:00.440990] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-09T17:11:00.441737] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-09T17:11:00.441839] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-09T17:11:00.443237] [DEBUG] [LOCAL ] ALL: Trimmed 72341 records to 50206 (keeping 200 days of data) [2025-10-09T17:11:00.766948] [DEBUG] [LOCAL ] ALL: Primary data saved (50206 records). [2025-10-09T17:11:00.767092] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-09T17:11:00.768123] [INFO ] [MAIN ] Update Progress: 86/2373 symbols completed. ALL took 34.8s. Estimated remaining: 4h 51m 17s. Rate: 7.9 symbols/min [2025-10-09T17:11:00.799903] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-09T17:11:00.940095] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:00.963577] [DEBUG] [LOCAL ] ALTG: Loaded 23572 existing records from primary storage. [2025-10-09T17:11:00.963870] [INFO ] [MAIN ] ALTG: Loaded 23572 existing records. [2025-10-09T17:11:01.153764] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:01.154110] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-09T17:11:01.154290] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-09T17:11:01.154603] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-09T17:11:01.154708] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-09T17:11:01.286771] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-09T17:11:01.602021] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-09T17:11:01.651195] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:02.290846] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-09T17:11:02.396715] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-09T17:11:02.445701] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T17:11:02.708233] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T17:11:02.711932] [INFO ] [REMOTE ] ALLE: Full fetch complete (64222 records). [2025-10-09T17:11:02.712142] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-09T17:11:02.713282] [FATAL] [VALIDATOR ] ALLE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:11:02.713438] [FATAL] [MAIN ] ALLE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:11:02.713489] [WARN ] [MAIN ] ALLE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:11:02.713544] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-09T17:11:02.713622] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-09T17:11:02.713708] [INFO ] [LOCAL ] ALLE: Starting deletion of derivative data. [2025-10-09T17:11:02.714088] [DEBUG] [LOCAL ] ALLE: Deleted derivative data file. [2025-10-09T17:11:02.714199] [INFO ] [MAIN ] Update Progress: 87/2373 symbols completed. ALLE took 29.1s. Estimated remaining: 4h 48m 40s. Rate: 7.9 symbols/min [2025-10-09T17:11:02.907244] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:02.920535] [DEBUG] [LOCAL ] ALUR: Loaded 10405 existing records from primary storage. [2025-10-09T17:11:02.920875] [INFO ] [MAIN ] ALUR: Loaded 10405 existing records. [2025-10-09T17:11:03.124386] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:03.124719] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-09T17:11:03.124784] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-09T17:11:03.125053] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-09T17:11:03.125112] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-09T17:11:03.198528] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-09T17:11:03.528457] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T17:11:03.564870] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:03.996747] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-09T17:11:04.796744] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-09T17:11:04.997819] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T17:11:05.027224] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T17:11:05.596733] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-09T17:11:06.281103] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T17:11:06.396738] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-09T17:11:06.952860] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T17:11:07.196723] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-09T17:11:07.678737] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T17:11:07.996684] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-09T17:11:08.237830] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T17:11:08.796683] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-09T17:11:09.157915] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T17:11:09.596772] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-09T17:11:10.388233] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T17:11:10.398997] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-09T17:11:10.413402] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T17:11:11.196712] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-09T17:11:11.996684] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-09T17:11:12.078611] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T17:11:12.381282] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T17:11:12.796767] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-09T17:11:13.371809] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:11:13.596773] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-09T17:11:14.110423] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T17:11:14.395346] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T17:11:14.398098] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-09T17:11:15.196698] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-09T17:11:15.802574] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:11:15.996719] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-09T17:11:16.124419] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T17:11:16.796712] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-09T17:11:17.596725] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-09T17:11:17.815255] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T17:11:17.949409] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T17:11:18.077460] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T17:11:18.396751] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-09T17:11:19.196789] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-09T17:11:19.996696] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-09T17:11:20.019372] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T17:11:20.023859] [INFO ] [REMOTE ] ALLY: Full fetch complete (76949 records). [2025-10-09T17:11:20.023975] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-09T17:11:20.363530] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T17:11:20.461105] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-09T17:11:20.461198] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-09T17:11:20.462063] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-09T17:11:20.462132] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-09T17:11:20.463820] [DEBUG] [LOCAL ] ALLY: Trimmed 76949 records to 53617 (keeping 200 days of data) [2025-10-09T17:11:20.812172] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-09T17:11:20.842264] [DEBUG] [LOCAL ] ALLY: Primary data saved (53617 records). [2025-10-09T17:11:20.842430] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-09T17:11:20.843332] [INFO ] [MAIN ] Update Progress: 88/2373 symbols completed. ALLY took 36.6s. Estimated remaining: 4h 53m 6s. Rate: 7.8 symbols/min [2025-10-09T17:11:20.991557] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T17:11:21.074188] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:21.126092] [DEBUG] [LOCAL ] ALV: Loaded 42086 existing records from primary storage. [2025-10-09T17:11:21.126437] [INFO ] [MAIN ] ALV: Loaded 42086 existing records. [2025-10-09T17:11:21.312830] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:21.313817] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-09T17:11:21.313866] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-09T17:11:21.314183] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-09T17:11:21.314240] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-09T17:11:21.602058] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-09T17:11:21.694549] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:21.708548] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T17:11:22.396782] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-09T17:11:22.432990] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T17:11:23.196686] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-09T17:11:23.392572] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T17:11:23.996756] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-09T17:11:24.623078] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:11:24.796749] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-09T17:11:25.137113] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T17:11:25.291759] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T17:11:25.596938] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-09T17:11:26.396773] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-09T17:11:27.091878] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T17:11:27.196713] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-09T17:11:27.542520] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T17:11:27.996724] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-09T17:11:28.712810] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:11:28.796740] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-09T17:11:29.096622] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T17:11:29.596757] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-09T17:11:30.349672] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T17:11:30.396723] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-09T17:11:31.204804] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-09T17:11:31.221692] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T17:11:31.499522] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:11:31.501759] [INFO ] [REMOTE ] ALTG: Full fetch complete (33541 records). [2025-10-09T17:11:31.501830] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-09T17:11:31.875781] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-09T17:11:31.875858] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-09T17:11:31.876228] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-09T17:11:31.876266] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-09T17:11:31.877243] [DEBUG] [LOCAL ] ALTG: Trimmed 33541 records to 23737 (keeping 200 days of data) [2025-10-09T17:11:31.964995] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T17:11:31.967346] [INFO ] [REMOTE ] ALUR: Full fetch complete (19922 records). [2025-10-09T17:11:31.968464] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-09T17:11:31.997925] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-09T17:11:32.414376] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-09T17:11:32.415908] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-09T17:11:32.417695] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-09T17:11:32.418094] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-09T17:11:32.418824] [DEBUG] [LOCAL ] ALTG: Primary data saved (23737 records). [2025-10-09T17:11:32.419161] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-09T17:11:32.419269] [INFO ] [MAIN ] Update Progress: 89/2373 symbols completed. ALTG took 31.7s. Estimated remaining: 4h 54m 38s. Rate: 7.8 symbols/min [2025-10-09T17:11:32.419712] [DEBUG] [LOCAL ] ALUR: Trimmed 19922 records to 10452 (keeping 200 days of data) [2025-10-09T17:11:32.627255] [DEBUG] [LOCAL ] ALUR: Primary data saved (10452 records). [2025-10-09T17:11:32.643743] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-09T17:11:32.644748] [INFO ] [MAIN ] Update Progress: 90/2373 symbols completed. ALUR took 29.9s. Estimated remaining: 4h 51m 20s. Rate: 7.8 symbols/min [2025-10-09T17:11:32.700601] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:32.799868] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-09T17:11:32.823075] [DEBUG] [LOCAL ] ALX: Loaded 6520 existing records from primary storage. [2025-10-09T17:11:32.854327] [INFO ] [MAIN ] ALX: Loaded 6520 existing records. [2025-10-09T17:11:32.853815] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:33.058791] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:33.059104] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-09T17:11:33.059158] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-09T17:11:33.059392] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-09T17:11:33.059452] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-09T17:11:33.194247] [DEBUG] [LOCAL ] AM: Loaded 51994 existing records from primary storage. [2025-10-09T17:11:33.228993] [INFO ] [MAIN ] AM: Loaded 51994 existing records. [2025-10-09T17:11:33.595063] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:33.605723] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-09T17:11:33.610953] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-09T17:11:33.638750] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-09T17:11:33.645490] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-09T17:11:33.695764] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:33.740600] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-09T17:11:34.076746] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:34.077940] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T17:11:34.396735] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-09T17:11:34.404723] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T17:11:34.576026] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T17:11:35.196732] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-09T17:11:35.996729] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-09T17:11:36.036375] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:11:36.489615] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T17:11:36.796717] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-09T17:11:37.538498] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T17:11:37.596768] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-09T17:11:38.308925] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:11:38.396738] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-09T17:11:38.946357] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T17:11:38.950353] [INFO ] [REMOTE ] ALSN: Full fetch complete (62252 records). [2025-10-09T17:11:38.950477] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-09T17:11:39.204688] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-09T17:11:39.353114] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-09T17:11:39.353192] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-09T17:11:39.353826] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-09T17:11:39.353888] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-09T17:11:39.355123] [DEBUG] [LOCAL ] ALSN: Trimmed 62252 records to 43701 (keeping 200 days of data) [2025-10-09T17:11:39.623195] [DEBUG] [LOCAL ] ALSN: Primary data saved (43701 records). [2025-10-09T17:11:39.623322] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-09T17:11:39.624455] [INFO ] [MAIN ] Update Progress: 91/2373 symbols completed. ALSN took 49.5s. Estimated remaining: 4h 50m 55s. Rate: 7.8 symbols/min [2025-10-09T17:11:39.795366] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:39.840267] [DEBUG] [LOCAL ] AMBC: Loaded 36338 existing records from primary storage. [2025-10-09T17:11:39.840524] [INFO ] [MAIN ] AMBC: Loaded 36338 existing records. [2025-10-09T17:11:40.001431] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-09T17:11:40.026878] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:40.027169] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-09T17:11:40.028033] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-09T17:11:40.028442] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-09T17:11:40.028597] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-09T17:11:40.220294] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T17:11:40.448610] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:40.524874] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T17:11:40.796728] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-09T17:11:40.867218] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T17:11:41.316614] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-09T17:11:41.596711] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-09T17:11:42.396738] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-09T17:11:43.170026] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T17:11:43.196666] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-09T17:11:43.996722] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-09T17:11:44.037318] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T17:11:44.555621] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:11:44.796725] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-09T17:11:45.596755] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-09T17:11:45.927289] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T17:11:46.056719] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T17:11:46.396686] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-09T17:11:46.746282] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T17:11:46.894971] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T17:11:47.196704] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-09T17:11:47.996724] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-09T17:11:48.796729] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-09T17:11:49.031570] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T17:11:49.159843] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T17:11:49.330864] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T17:11:49.596736] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-09T17:11:50.396709] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-09T17:11:50.475195] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T17:11:51.196778] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-09T17:11:51.850261] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T17:11:51.853789] [INFO ] [REMOTE ] ALV: Full fetch complete (61732 records). [2025-10-09T17:11:51.853937] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-09T17:11:52.005951] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-09T17:11:52.208448] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T17:11:52.261862] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-09T17:11:52.261965] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-09T17:11:52.262686] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-09T17:11:52.262757] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-09T17:11:52.264413] [DEBUG] [LOCAL ] ALV: Trimmed 61732 records to 42387 (keeping 200 days of data) [2025-10-09T17:11:52.545618] [DEBUG] [LOCAL ] ALV: Primary data saved (42387 records). [2025-10-09T17:11:52.545781] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-09T17:11:52.545868] [INFO ] [MAIN ] Update Progress: 92/2373 symbols completed. ALV took 31.7s. Estimated remaining: 4h 52m 58s. Rate: 7.8 symbols/min [2025-10-09T17:11:52.721148] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:11:52.766504] [DEBUG] [LOCAL ] AMBP: Loaded 44668 existing records from primary storage. [2025-10-09T17:11:52.766871] [INFO ] [MAIN ] AMBP: Loaded 44668 existing records. [2025-10-09T17:11:52.802051] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-09T17:11:52.947138] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:11:52.947369] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-09T17:11:52.947417] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-09T17:11:52.947791] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-09T17:11:52.947849] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-09T17:11:53.345952] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:11:53.596784] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-09T17:11:53.701244] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T17:11:53.724767] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-09T17:11:54.396745] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-09T17:11:54.951848] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T17:11:55.196712] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-09T17:11:55.316239] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T17:11:55.996708] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-09T17:11:56.796742] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-09T17:11:56.853790] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T17:11:57.435031] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T17:11:57.450437] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T17:11:57.596748] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-09T17:11:58.396742] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-09T17:11:59.036342] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:11:59.196718] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-09T17:11:59.885819] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:11:59.887172] [INFO ] [REMOTE ] ALX: Full fetch complete (7483 records). [2025-10-09T17:11:59.887240] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-09T17:12:00.001153] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-09T17:12:00.068073] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T17:12:00.300126] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-09T17:12:00.300239] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-09T17:12:00.300466] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-09T17:12:00.300515] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-09T17:12:00.301045] [DEBUG] [LOCAL ] ALX: Trimmed 7483 records to 6663 (keeping 200 days of data) [2025-10-09T17:12:00.351882] [DEBUG] [LOCAL ] ALX: Primary data saved (6663 records). [2025-10-09T17:12:00.352082] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-09T17:12:00.352184] [INFO ] [MAIN ] Update Progress: 93/2373 symbols completed. ALX took 27.9s. Estimated remaining: 4h 52m 53s. Rate: 7.8 symbols/min [2025-10-09T17:12:00.534954] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:00.535207] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-09T17:12:00.535261] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-09T17:12:00.535388] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-09T17:12:00.535431] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-09T17:12:00.535473] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-09T17:12:00.535508] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-09T17:12:00.805343] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-09T17:12:00.896219] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:01.505015] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T17:12:01.596675] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-09T17:12:01.814489] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:12:01.814737] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-09T17:12:01.814825] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:12:01.814906] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-09T17:12:01.814985] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:12:01.815071] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-09T17:12:01.815151] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-09T17:12:01.815220] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-09T17:12:01.815312] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-09T17:12:01.815393] [INFO ] [MAIN ] Update Progress: 94/2373 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 50m 14s. Rate: 7.9 symbols/min [2025-10-09T17:12:01.994195] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:02.046045] [DEBUG] [LOCAL ] AMC: Loaded 53761 existing records from primary storage. [2025-10-09T17:12:02.046367] [INFO ] [MAIN ] AMC: Loaded 53761 existing records. [2025-10-09T17:12:02.220683] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:02.220871] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-09T17:12:02.221003] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-09T17:12:02.221225] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-09T17:12:02.221281] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-09T17:12:02.398497] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-09T17:12:02.594027] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:02.623037] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T17:12:03.196709] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-09T17:12:03.850481] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:12:03.996737] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-09T17:12:04.796729] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-09T17:12:04.986991] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T17:12:05.596708] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-09T17:12:05.930880] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T17:12:05.961972] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T17:12:06.396730] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-09T17:12:07.196708] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-09T17:12:07.368874] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T17:12:07.996718] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-09T17:12:08.742097] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T17:12:08.796681] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-09T17:12:08.872474] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-10-09T17:12:09.276846] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T17:12:09.596718] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-09T17:12:09.829815] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T17:12:10.396717] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-09T17:12:11.196977] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-09T17:12:11.857925] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-09T17:12:11.964266] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T17:12:11.996795] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-09T17:12:12.796796] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-09T17:12:13.001449] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:12:13.005942] [INFO ] [REMOTE ] AM: Full fetch complete (75579 records). [2025-10-09T17:12:13.006063] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-09T17:12:13.395472] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-09T17:12:13.395556] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-09T17:12:13.396315] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-09T17:12:13.396379] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-09T17:12:13.397774] [DEBUG] [LOCAL ] AM: Trimmed 75579 records to 52383 (keeping 200 days of data) [2025-10-09T17:12:13.602448] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-09T17:12:13.667043] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T17:12:13.782111] [DEBUG] [LOCAL ] AM: Primary data saved (52383 records). [2025-10-09T17:12:13.782252] [INFO ] [MAIN ] AM: Full history saved. [2025-10-09T17:12:13.783668] [INFO ] [MAIN ] Update Progress: 95/2373 symbols completed. AM took 41.1s. Estimated remaining: 4h 51m 50s. Rate: 7.8 symbols/min [2025-10-09T17:12:13.980995] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:14.034098] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-09T17:12:14.034409] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-09T17:12:14.140780] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T17:12:14.153810] [INFO ] [REMOTE ] AMBC: Full fetch complete (51489 records). [2025-10-09T17:12:14.164297] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-09T17:12:14.323383] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:14.333948] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-09T17:12:14.334014] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-09T17:12:14.339724] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-09T17:12:14.352021] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-09T17:12:14.401951] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-09T17:12:14.952365] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-09T17:12:14.962784] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-09T17:12:14.981864] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-09T17:12:14.992241] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-09T17:12:15.022751] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:15.023531] [DEBUG] [LOCAL ] AMBC: Trimmed 51489 records to 36609 (keeping 200 days of data) [2025-10-09T17:12:15.220101] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-09T17:12:15.249539] [DEBUG] [LOCAL ] AMBC: Primary data saved (36609 records). [2025-10-09T17:12:15.249715] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-09T17:12:15.250534] [INFO ] [MAIN ] Update Progress: 96/2373 symbols completed. AMBC took 35.6s. Estimated remaining: 4h 49m 15s. Rate: 7.9 symbols/min [2025-10-09T17:12:15.444123] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:15.498488] [DEBUG] [LOCAL ] AME: Loaded 48717 existing records from primary storage. [2025-10-09T17:12:15.498860] [INFO ] [MAIN ] AME: Loaded 48717 existing records. [2025-10-09T17:12:15.674446] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:15.674793] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-09T17:12:15.674868] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-09T17:12:15.675259] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-09T17:12:15.675319] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-09T17:12:16.059227] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:16.062631] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-09T17:12:16.063115] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-09T17:12:16.275741] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T17:12:16.796729] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-09T17:12:16.843601] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:12:17.596691] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-09T17:12:17.773148] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T17:12:18.396781] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-09T17:12:19.196804] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-09T17:12:19.247905] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-09T17:12:19.328417] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T17:12:20.006518] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-09T17:12:20.009271] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T17:12:20.771324] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:12:20.796691] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-09T17:12:21.596685] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-09T17:12:21.754130] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T17:12:22.389118] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:12:22.397844] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-09T17:12:23.196754] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-09T17:12:23.707579] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-09T17:12:23.864809] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T17:12:23.996724] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-09T17:12:24.796771] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-09T17:12:25.023978] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T17:12:25.348236] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:12:25.596765] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-09T17:12:26.396757] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-09T17:12:27.130255] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T17:12:27.134668] [INFO ] [REMOTE ] AMBP: Full fetch complete (65397 records). [2025-10-09T17:12:27.134861] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-09T17:12:27.198304] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-09T17:12:27.460468] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-09T17:12:27.572468] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-09T17:12:27.572545] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-09T17:12:27.573213] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-09T17:12:27.573276] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-09T17:12:27.574585] [DEBUG] [LOCAL ] AMBP: Trimmed 65397 records to 44975 (keeping 200 days of data) [2025-10-09T17:12:27.812295] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T17:12:27.873714] [DEBUG] [LOCAL ] AMBP: Primary data saved (44975 records). [2025-10-09T17:12:27.873838] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-09T17:12:27.873912] [INFO ] [MAIN ] Update Progress: 97/2373 symbols completed. AMBP took 35.3s. Estimated remaining: 4h 51m 5s. Rate: 7.8 symbols/min [2025-10-09T17:12:28.009691] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-09T17:12:28.041116] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:28.062008] [DEBUG] [LOCAL ] AMG: Loaded 20177 existing records from primary storage. [2025-10-09T17:12:28.062257] [INFO ] [MAIN ] AMG: Loaded 20177 existing records. [2025-10-09T17:12:28.241353] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:28.241541] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-09T17:12:28.241589] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-09T17:12:28.241812] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-09T17:12:28.241870] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-09T17:12:28.583189] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:28.796668] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-09T17:12:29.199702] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T17:12:29.596744] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-09T17:12:29.831310] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:12:29.951921] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T17:12:30.396747] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-09T17:12:31.196676] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-09T17:12:31.317492] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T17:12:31.913220] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-09T17:12:31.996669] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-09T17:12:32.508234] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T17:12:32.796737] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-09T17:12:33.596733] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-09T17:12:34.243329] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T17:12:34.396710] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-09T17:12:34.451239] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-09T17:12:34.475396] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T17:12:35.196754] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-09T17:12:35.775803] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:12:35.996679] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-09T17:12:36.313102] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T17:12:36.796810] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-09T17:12:37.596772] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-09T17:12:37.847313] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T17:12:38.396742] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-09T17:12:38.486329] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T17:12:38.539527] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T17:12:39.196755] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-09T17:12:39.996761] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-09T17:12:40.759981] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-09T17:12:40.796680] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-09T17:12:41.089181] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T17:12:41.596732] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-09T17:12:41.737312] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T17:12:42.396749] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-09T17:12:43.094940] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:12:43.202763] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-09T17:12:43.222192] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-09T17:12:43.996706] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-09T17:12:44.209590] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T17:12:44.485310] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T17:12:44.489507] [INFO ] [REMOTE ] AME: Full fetch complete (69903 records). [2025-10-09T17:12:44.489630] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-09T17:12:44.801804] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-09T17:12:44.876998] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-09T17:12:44.877091] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-09T17:12:44.877788] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-09T17:12:44.877851] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-09T17:12:44.879359] [DEBUG] [LOCAL ] AME: Trimmed 69903 records to 49074 (keeping 200 days of data) [2025-10-09T17:12:45.191165] [DEBUG] [LOCAL ] AME: Primary data saved (49074 records). [2025-10-09T17:12:45.191302] [INFO ] [MAIN ] AME: Full history saved. [2025-10-09T17:12:45.193079] [INFO ] [MAIN ] Update Progress: 98/2373 symbols completed. AME took 29.9s. Estimated remaining: 4h 54m 41s. Rate: 7.7 symbols/min [2025-10-09T17:12:45.359659] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:45.410096] [DEBUG] [LOCAL ] AMH: Loaded 51757 existing records from primary storage. [2025-10-09T17:12:45.410396] [INFO ] [MAIN ] AMH: Loaded 51757 existing records. [2025-10-09T17:12:45.587419] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:45.587603] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-09T17:12:45.587681] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-09T17:12:45.588008] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-09T17:12:45.588068] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-09T17:12:45.620179] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-09T17:12:45.949996] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:46.130019] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T17:12:46.342512] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-09T17:12:46.346974] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-10-09T17:12:46.347085] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-09T17:12:46.409207] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-09T17:12:46.742784] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-09T17:12:46.742921] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-09T17:12:46.743735] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-09T17:12:46.743803] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-09T17:12:46.745301] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 54151 (keeping 200 days of data) [2025-10-09T17:12:47.052150] [DEBUG] [LOCAL ] AMC: Primary data saved (54151 records). [2025-10-09T17:12:47.052297] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-09T17:12:47.053679] [INFO ] [MAIN ] Update Progress: 99/2373 symbols completed. AMC took 45.2s. Estimated remaining: 4h 52m 17s. Rate: 7.8 symbols/min [2025-10-09T17:12:47.222925] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:47.205413] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-09T17:12:47.264172] [DEBUG] [LOCAL ] AMN: Loaded 41756 existing records from primary storage. [2025-10-09T17:12:47.264450] [INFO ] [MAIN ] AMN: Loaded 41756 existing records. [2025-10-09T17:12:47.440126] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:47.440554] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-09T17:12:47.440625] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-09T17:12:47.440959] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-09T17:12:47.441017] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-09T17:12:47.796479] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:47.826828] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-09T17:12:47.996693] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-09T17:12:48.160806] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T17:12:48.222023] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T17:12:48.796774] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-09T17:12:49.599440] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-09T17:12:49.604490] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T17:12:50.396746] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-09T17:12:50.752901] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T17:12:50.757519] [INFO ] [REMOTE ] AMCR: Full fetch complete (77680 records). [2025-10-09T17:12:50.757713] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-09T17:12:51.195189] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-09T17:12:51.195418] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-09T17:12:51.196459] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-09T17:12:51.196564] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-09T17:12:51.196965] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-09T17:12:51.199793] [DEBUG] [LOCAL ] AMCR: Trimmed 77680 records to 54059 (keeping 200 days of data) [2025-10-09T17:12:51.324218] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:12:51.480823] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:12:51.610533] [DEBUG] [LOCAL ] AMCR: Primary data saved (54059 records). [2025-10-09T17:12:51.610829] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-09T17:12:51.610942] [INFO ] [MAIN ] Update Progress: 100/2373 symbols completed. AMCR took 37.8s. Estimated remaining: 4h 50m 58s. Rate: 7.8 symbols/min [2025-10-09T17:12:51.792265] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:12:51.830944] [DEBUG] [LOCAL ] AMP: Loaded 31938 existing records from primary storage. [2025-10-09T17:12:51.831322] [INFO ] [MAIN ] AMP: Loaded 31938 existing records. [2025-10-09T17:12:51.998485] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-09T17:12:52.022871] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:12:52.023333] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-09T17:12:52.023388] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-09T17:12:52.023680] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-09T17:12:52.023744] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-09T17:12:52.408367] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:12:52.430685] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T17:12:52.796786] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-09T17:12:53.529966] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T17:12:53.596680] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-09T17:12:54.134733] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T17:12:54.396743] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-09T17:12:55.196702] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-09T17:12:55.413287] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T17:12:55.446970] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T17:12:55.996735] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-09T17:12:56.796796] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-09T17:12:56.835603] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:12:57.596724] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-09T17:12:57.686870] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T17:12:58.051814] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T17:12:58.396716] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-09T17:12:58.805555] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T17:12:59.196726] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-09T17:12:59.996686] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-09T17:13:00.064889] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T17:13:00.173992] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-09T17:13:00.175886] [INFO ] [REMOTE ] AMG: Full fetch complete (29709 records). [2025-10-09T17:13:00.175956] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-09T17:13:00.538737] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-09T17:13:00.538840] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-09T17:13:00.539239] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-09T17:13:00.539281] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-09T17:13:00.540165] [DEBUG] [LOCAL ] AMG: Trimmed 29709 records to 20269 (keeping 200 days of data) [2025-10-09T17:13:00.665787] [DEBUG] [LOCAL ] AMG: Primary data saved (20269 records). [2025-10-09T17:13:00.665909] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-09T17:13:00.665983] [INFO ] [MAIN ] Update Progress: 101/2373 symbols completed. AMG took 32.8s. Estimated remaining: 4h 51m 21s. Rate: 7.8 symbols/min [2025-10-09T17:13:00.801788] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-09T17:13:00.848531] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:00.898195] [DEBUG] [LOCAL ] AMPX: Loaded 52318 existing records from primary storage. [2025-10-09T17:13:00.898500] [INFO ] [MAIN ] AMPX: Loaded 52318 existing records. [2025-10-09T17:13:01.073853] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:01.074108] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-09T17:13:01.074168] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-09T17:13:01.074417] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-09T17:13:01.074474] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-09T17:13:01.436149] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:01.465520] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:13:01.596727] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-09T17:13:02.354915] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T17:13:02.396739] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-09T17:13:03.148159] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T17:13:03.196715] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-09T17:13:03.996742] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-09T17:13:04.172080] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T17:13:04.320891] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T17:13:04.796726] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-09T17:13:05.163431] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:13:05.596698] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-09T17:13:06.371404] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:13:06.396675] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-09T17:13:07.196677] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-09T17:13:07.290195] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T17:13:07.996684] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-09T17:13:08.152848] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:13:08.796730] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-09T17:13:08.838272] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T17:13:09.559438] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:13:09.596664] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-09T17:13:10.380848] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T17:13:10.396731] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-09T17:13:11.196702] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-09T17:13:11.342934] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T17:13:11.821542] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T17:13:11.996755] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-09T17:13:12.796741] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-09T17:13:12.942394] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T17:13:13.596714] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-09T17:13:13.708310] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T17:13:14.396741] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-09T17:13:14.732940] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-09T17:13:15.003353] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T17:13:15.007788] [INFO ] [REMOTE ] AMH: Full fetch complete (74817 records). [2025-10-09T17:13:15.007895] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-09T17:13:15.204186] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-09T17:13:15.400703] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-09T17:13:15.400796] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-09T17:13:15.401521] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-09T17:13:15.401564] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-09T17:13:15.403066] [DEBUG] [LOCAL ] AMH: Trimmed 74817 records to 52145 (keeping 200 days of data) [2025-10-09T17:13:15.730325] [DEBUG] [LOCAL ] AMH: Primary data saved (52145 records). [2025-10-09T17:13:15.730477] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-09T17:13:15.731370] [INFO ] [MAIN ] Update Progress: 102/2373 symbols completed. AMH took 30.5s. Estimated remaining: 4h 53m 58s. Rate: 7.7 symbols/min [2025-10-09T17:13:15.906241] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:15.943977] [DEBUG] [LOCAL ] AMPY: Loaded 38587 existing records from primary storage. [2025-10-09T17:13:15.944282] [INFO ] [MAIN ] AMPY: Loaded 38587 existing records. [2025-10-09T17:13:16.006614] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-09T17:13:16.124117] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:16.124497] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-09T17:13:16.124573] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-09T17:13:16.124848] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-09T17:13:16.124909] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-09T17:13:16.513796] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-09T17:13:16.519751] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:16.796724] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-09T17:13:16.842803] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T17:13:17.596750] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-09T17:13:17.701356] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T17:13:18.063432] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T17:13:18.396729] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-09T17:13:18.987776] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T17:13:18.991438] [INFO ] [REMOTE ] AMN: Full fetch complete (60320 records). [2025-10-09T17:13:18.991529] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-09T17:13:19.205677] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-09T17:13:19.404407] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-09T17:13:19.404522] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-09T17:13:19.405436] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-09T17:13:19.405521] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-09T17:13:19.407190] [DEBUG] [LOCAL ] AMN: Trimmed 60320 records to 42026 (keeping 200 days of data) [2025-10-09T17:13:19.656521] [DEBUG] [LOCAL ] AMN: Primary data saved (42026 records). [2025-10-09T17:13:19.656678] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-09T17:13:19.657217] [INFO ] [MAIN ] Update Progress: 103/2373 symbols completed. AMN took 32.6s. Estimated remaining: 4h 52m 25s. Rate: 7.8 symbols/min [2025-10-09T17:13:19.828513] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:19.860082] [DEBUG] [LOCAL ] AMR: Loaded 29039 existing records from primary storage. [2025-10-09T17:13:19.860395] [INFO ] [MAIN ] AMR: Loaded 29039 existing records. [2025-10-09T17:13:20.001545] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-09T17:13:20.045838] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:20.046399] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-09T17:13:20.046489] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-09T17:13:20.046810] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-09T17:13:20.046868] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-09T17:13:20.370921] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-09T17:13:20.489708] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:20.520797] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T17:13:20.796710] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-09T17:13:21.292590] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T17:13:21.596717] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-09T17:13:21.828512] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T17:13:22.396774] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-09T17:13:22.747989] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T17:13:23.186788] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T17:13:23.196666] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-09T17:13:23.996743] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-09T17:13:24.039287] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T17:13:24.796736] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-09T17:13:25.321868] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T17:13:25.596714] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-09T17:13:26.167359] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T17:13:26.396735] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-09T17:13:27.099267] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T17:13:27.196690] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-09T17:13:28.006693] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-09T17:13:28.009273] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T17:13:28.521485] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T17:13:28.796757] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-09T17:13:29.596817] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-09T17:13:29.812398] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T17:13:30.116179] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T17:13:30.396750] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-09T17:13:31.036969] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T17:13:31.196748] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-09T17:13:31.631334] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T17:13:31.996729] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-09T17:13:32.796749] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-09T17:13:33.448544] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:13:33.573123] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-09T17:13:33.596709] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-09T17:13:33.949192] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T17:13:34.396788] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-09T17:13:35.086452] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T17:13:35.196745] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-09T17:13:35.447816] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:13:35.996717] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-09T17:13:36.796789] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-09T17:13:37.153577] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T17:13:37.156516] [INFO ] [REMOTE ] AMP: Full fetch complete (47425 records). [2025-10-09T17:13:37.156734] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-09T17:13:37.316055] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-09T17:13:37.583518] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-09T17:13:37.583624] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-09T17:13:37.584189] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-09T17:13:37.584239] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-09T17:13:37.585209] [DEBUG] [LOCAL ] AMP: Trimmed 47425 records to 32147 (keeping 200 days of data) [2025-10-09T17:13:37.644082] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-09T17:13:37.791626] [DEBUG] [LOCAL ] AMP: Primary data saved (32147 records). [2025-10-09T17:13:37.791791] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-09T17:13:37.791873] [INFO ] [MAIN ] Update Progress: 104/2373 symbols completed. AMP took 46.2s. Estimated remaining: 4h 56m 5s. Rate: 7.7 symbols/min [2025-10-09T17:13:37.958277] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:37.998147] [DEBUG] [LOCAL ] AMRC: Loaded 38091 existing records from primary storage. [2025-10-09T17:13:37.998435] [INFO ] [MAIN ] AMRC: Loaded 38091 existing records. [2025-10-09T17:13:38.174251] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:38.174560] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-09T17:13:38.174738] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-09T17:13:38.175001] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-09T17:13:38.175059] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-09T17:13:38.332263] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T17:13:38.416072] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-09T17:13:38.568453] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:39.196752] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-09T17:13:39.612596] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-09T17:13:39.643860] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T17:13:39.996736] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-09T17:13:40.600772] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:13:40.796734] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-09T17:13:41.018497] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T17:13:41.596709] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-09T17:13:41.833481] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T17:13:42.396737] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-09T17:13:42.667089] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T17:13:43.196742] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-09T17:13:43.219003] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T17:13:43.996781] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-09T17:13:44.181841] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T17:13:44.184593] [INFO ] [REMOTE ] AMR: Full fetch complete (40342 records). [2025-10-09T17:13:44.184729] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-09T17:13:44.602840] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-09T17:13:44.602956] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-09T17:13:44.603417] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-09T17:13:44.603460] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-09T17:13:44.604293] [DEBUG] [LOCAL ] AMR: Trimmed 40342 records to 29174 (keeping 200 days of data) [2025-10-09T17:13:44.778119] [DEBUG] [LOCAL ] AMR: Primary data saved (29174 records). [2025-10-09T17:13:44.778255] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-09T17:13:44.778337] [INFO ] [MAIN ] Update Progress: 105/2373 symbols completed. AMR took 25.1s. Estimated remaining: 4h 55m 38s. Rate: 7.7 symbols/min [2025-10-09T17:13:44.802761] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-09T17:13:44.955195] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:44.955426] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-09T17:13:44.955469] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-09T17:13:44.955544] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-09T17:13:44.955582] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-09T17:13:44.955624] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-09T17:13:44.955695] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-09T17:13:45.311545] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:45.332537] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T17:13:45.596686] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-09T17:13:45.794186] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:13:45.794441] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-09T17:13:45.794530] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:13:45.794577] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-09T17:13:45.794638] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:13:45.794741] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-09T17:13:45.794828] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-09T17:13:45.794876] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-09T17:13:45.794931] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-09T17:13:45.795000] [INFO ] [MAIN ] Update Progress: 106/2373 symbols completed. AMRZ took 1.0s. Estimated remaining: 4h 53m 5s. Rate: 7.7 symbols/min [2025-10-09T17:13:45.960194] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:46.013120] [DEBUG] [LOCAL ] AMT: Loaded 52439 existing records from primary storage. [2025-10-09T17:13:46.013401] [INFO ] [MAIN ] AMT: Loaded 52439 existing records. [2025-10-09T17:13:46.193894] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:46.194090] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-09T17:13:46.194137] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-09T17:13:46.194507] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-09T17:13:46.194566] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-09T17:13:46.401970] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-09T17:13:46.543557] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:47.196705] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-09T17:13:47.268001] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-09T17:13:47.273852] [INFO ] [REMOTE ] AMPX: Full fetch complete (74994 records). [2025-10-09T17:13:47.274035] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-09T17:13:47.708878] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-09T17:13:47.708974] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-09T17:13:47.709847] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-09T17:13:47.709913] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-09T17:13:47.711898] [DEBUG] [LOCAL ] AMPX: Trimmed 74994 records to 52708 (keeping 200 days of data) [2025-10-09T17:13:47.928759] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T17:13:47.950782] [INFO ] [REMOTE ] AMPY: Full fetch complete (52176 records). [2025-10-09T17:13:47.955951] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-09T17:13:47.999491] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-09T17:13:48.478514] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-09T17:13:48.482632] [DEBUG] [LOCAL ] AMPX: Primary data saved (52708 records). [2025-10-09T17:13:48.482991] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-09T17:13:48.484405] [INFO ] [MAIN ] Update Progress: 107/2373 symbols completed. AMPX took 47.8s. Estimated remaining: 4h 51m 10s. Rate: 7.8 symbols/min [2025-10-09T17:13:48.482793] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-09T17:13:48.509243] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-09T17:13:48.548091] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-09T17:13:48.617501] [DEBUG] [LOCAL ] AMPY: Trimmed 52176 records to 38919 (keeping 200 days of data) [2025-10-09T17:13:48.684240] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:48.787884] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T17:13:48.804495] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-09T17:13:48.836538] [DEBUG] [LOCAL ] AMTB: Loaded 20507 existing records from primary storage. [2025-10-09T17:13:48.836832] [INFO ] [MAIN ] AMTB: Loaded 20507 existing records. [2025-10-09T17:13:49.100730] [DEBUG] [LOCAL ] AMPY: Primary data saved (38919 records). [2025-10-09T17:13:49.116166] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-09T17:13:49.135491] [INFO ] [MAIN ] Update Progress: 108/2373 symbols completed. AMPY took 33.4s. Estimated remaining: 4h 48m 34s. Rate: 7.8 symbols/min [2025-10-09T17:13:49.144878] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:49.205404] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-09T17:13:49.210966] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-09T17:13:49.232343] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-09T17:13:49.242681] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-09T17:13:49.442910] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:13:49.590852] [DEBUG] [LOCAL ] AMTD: Loaded 3706 existing records from primary storage. [2025-10-09T17:13:49.607625] [INFO ] [MAIN ] AMTD: Loaded 3706 existing records. [2025-10-09T17:13:49.818915] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:49.860703] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-09T17:13:49.892874] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:13:49.894307] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-09T17:13:49.894389] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-09T17:13:49.894625] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-09T17:13:49.894724] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-09T17:13:50.260975] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:13:50.290351] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-09T17:13:50.331546] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:13:50.396679] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-09T17:13:51.107701] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T17:13:51.196682] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-09T17:13:51.829272] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T17:13:51.996689] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-09T17:13:52.078225] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T17:13:52.796732] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-09T17:13:53.433589] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:13:53.477562] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T17:13:53.596703] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-09T17:13:54.396752] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-09T17:13:54.917179] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T17:13:55.196728] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-09T17:13:55.996755] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-09T17:13:56.060026] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T17:13:56.210596] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T17:13:56.641845] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T17:13:56.796723] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-09T17:13:57.375618] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T17:13:57.596703] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-09T17:13:58.396768] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-09T17:13:58.911080] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T17:13:59.074297] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T17:13:59.196712] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-09T17:13:59.996728] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-09T17:14:00.656753] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T17:14:00.796717] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-09T17:14:01.596714] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-09T17:14:01.880855] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T17:14:02.335123] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T17:14:02.338792] [INFO ] [REMOTE ] AMRC: Full fetch complete (53614 records). [2025-10-09T17:14:02.338932] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-09T17:14:02.401803] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-09T17:14:02.762042] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-09T17:14:02.762683] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-09T17:14:02.762584] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T17:14:02.763426] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-09T17:14:02.763513] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-09T17:14:02.769512] [DEBUG] [LOCAL ] AMRC: Trimmed 53614 records to 38412 (keeping 200 days of data) [2025-10-09T17:14:03.011667] [DEBUG] [LOCAL ] AMRC: Primary data saved (38412 records). [2025-10-09T17:14:03.011829] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-09T17:14:03.011930] [INFO ] [MAIN ] Update Progress: 109/2373 symbols completed. AMRC took 25.2s. Estimated remaining: 4h 50m 36s. Rate: 7.8 symbols/min [2025-10-09T17:14:03.177605] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:03.205942] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-09T17:14:03.226594] [DEBUG] [LOCAL ] AMTM: Loaded 50653 existing records from primary storage. [2025-10-09T17:14:03.226924] [INFO ] [MAIN ] AMTM: Loaded 50653 existing records. [2025-10-09T17:14:03.400419] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:14:03.400601] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-09T17:14:03.400670] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-09T17:14:03.400899] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-09T17:14:03.400956] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-09T17:14:03.783941] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:03.996722] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-09T17:14:04.158432] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T17:14:04.292544] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T17:14:04.796748] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-09T17:14:05.261276] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-09T17:14:05.596730] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-09T17:14:05.859574] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T17:14:06.104998] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T17:14:06.396773] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-09T17:14:07.196736] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-09T17:14:07.429074] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T17:14:07.996730] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-09T17:14:08.796709] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-09T17:14:09.010568] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T17:14:09.596696] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-09T17:14:09.713335] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:14:09.761856] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T17:14:10.396727] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-09T17:14:11.196686] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-09T17:14:11.463177] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T17:14:11.535495] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T17:14:11.996731] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-09T17:14:12.645208] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-09T17:14:12.693516] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T17:14:12.796713] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-09T17:14:13.596712] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-09T17:14:14.396704] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-09T17:14:14.497488] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:14:14.814732] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T17:14:15.196769] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-09T17:14:15.922773] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T17:14:15.942106] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T17:14:15.996679] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-09T17:14:16.796782] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-09T17:14:16.960908] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T17:14:16.963009] [INFO ] [REMOTE ] AMTB: Full fetch complete (29699 records). [2025-10-09T17:14:16.963082] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-09T17:14:17.324674] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-09T17:14:17.324765] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-09T17:14:17.325135] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-09T17:14:17.325175] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-09T17:14:17.326493] [DEBUG] [LOCAL ] AMTB: Trimmed 29699 records to 20610 (keeping 200 days of data) [2025-10-09T17:14:17.463867] [DEBUG] [LOCAL ] AMTB: Primary data saved (20610 records). [2025-10-09T17:14:17.464014] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-09T17:14:17.464110] [INFO ] [MAIN ] Update Progress: 110/2373 symbols completed. AMTB took 29.0s. Estimated remaining: 4h 52m 47s. Rate: 7.7 symbols/min [2025-10-09T17:14:17.602482] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-09T17:14:17.634252] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:17.644557] [DEBUG] [LOCAL ] AMWL: Loaded 9214 existing records from primary storage. [2025-10-09T17:14:17.644866] [INFO ] [MAIN ] AMWL: Loaded 9214 existing records. [2025-10-09T17:14:17.844843] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:14:17.845058] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-09T17:14:17.845104] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-09T17:14:17.845289] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-09T17:14:17.845345] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-09T17:14:18.194624] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:18.205337] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T17:14:18.396681] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-09T17:14:18.804190] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T17:14:19.196686] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-09T17:14:19.395967] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T17:14:19.996772] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-09T17:14:20.796731] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-09T17:14:20.863596] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-09T17:14:21.028799] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T17:14:21.596768] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-09T17:14:22.396691] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-09T17:14:22.490625] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T17:14:22.536757] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T17:14:23.196741] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-09T17:14:23.989376] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T17:14:23.999867] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-09T17:14:24.571708] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T17:14:24.796695] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-09T17:14:24.901363] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T17:14:25.596735] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-09T17:14:26.174913] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T17:14:26.396702] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-09T17:14:26.836005] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-09T17:14:27.196734] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-09T17:14:27.988482] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T17:14:27.998595] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-09T17:14:28.188587] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T17:14:28.796724] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-09T17:14:29.415120] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T17:14:29.596691] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-09T17:14:29.756128] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T17:14:29.760722] [INFO ] [REMOTE ] AMT: Full fetch complete (76028 records). [2025-10-09T17:14:29.760845] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-09T17:14:30.148786] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-09T17:14:30.148874] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-09T17:14:30.149607] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-09T17:14:30.149674] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-09T17:14:30.151083] [DEBUG] [LOCAL ] AMT: Trimmed 76028 records to 52828 (keeping 200 days of data) [2025-10-09T17:14:30.400301] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-09T17:14:30.501507] [DEBUG] [LOCAL ] AMT: Primary data saved (52828 records). [2025-10-09T17:14:30.501677] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-09T17:14:30.502581] [INFO ] [MAIN ] Update Progress: 111/2373 symbols completed. AMT took 44.7s. Estimated remaining: 4h 54m 27s. Rate: 7.7 symbols/min [2025-10-09T17:14:30.668575] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:30.715536] [DEBUG] [LOCAL ] AMX: Loaded 49124 existing records from primary storage. [2025-10-09T17:14:30.715867] [INFO ] [MAIN ] AMX: Loaded 49124 existing records. [2025-10-09T17:14:30.889105] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:14:30.889339] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-09T17:14:30.889386] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-09T17:14:30.889665] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-09T17:14:30.889724] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-09T17:14:31.211999] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-09T17:14:31.256906] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:31.436570] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T17:14:31.472686] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T17:14:31.988876] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T17:14:31.990110] [INFO ] [REMOTE ] AMTD: Full fetch complete (5607 records). [2025-10-09T17:14:31.990186] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-09T17:14:32.001914] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-09T17:14:32.383112] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-09T17:14:32.383192] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-09T17:14:32.383404] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-09T17:14:32.383468] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-09T17:14:32.383878] [DEBUG] [LOCAL ] AMTD: Trimmed 5607 records to 3770 (keeping 200 days of data) [2025-10-09T17:14:32.409870] [DEBUG] [LOCAL ] AMTD: Primary data saved (3770 records). [2025-10-09T17:14:32.409982] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-09T17:14:32.410117] [INFO ] [MAIN ] Update Progress: 112/2373 symbols completed. AMTD took 43.3s. Estimated remaining: 4h 52m 20s. Rate: 7.7 symbols/min [2025-10-09T17:14:32.614428] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:32.614782] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-10-09T17:14:32.614857] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-10-09T17:14:32.614984] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-09T17:14:32.615028] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-09T17:14:32.615071] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-09T17:14:32.615105] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-09T17:14:32.801014] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-09T17:14:32.806908] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T17:14:33.014794] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:33.596775] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-09T17:14:34.396695] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-09T17:14:34.560070] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T17:14:34.655638] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T17:14:35.196718] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-09T17:14:35.982901] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T17:14:35.986541] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T17:14:35.996661] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-09T17:14:36.796769] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-09T17:14:37.487473] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T17:14:37.596757] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-09T17:14:38.396727] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-09T17:14:38.531041] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T17:14:38.753803] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T17:14:39.194439] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T17:14:39.197050] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-09T17:14:39.996792] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-09T17:14:40.633056] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T17:14:40.796724] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-09T17:14:41.539036] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T17:14:41.540820] [INFO ] [REMOTE ] AMWL: Full fetch complete (14249 records). [2025-10-09T17:14:41.540920] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-09T17:14:41.599871] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-09T17:14:41.941960] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-09T17:14:41.934314] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-09T17:14:41.942092] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-09T17:14:41.946257] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-09T17:14:41.946334] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-09T17:14:41.946970] [DEBUG] [LOCAL ] AMWL: Trimmed 14249 records to 9317 (keeping 200 days of data) [2025-10-09T17:14:41.947157] [INFO ] [REMOTE ] AMTM: Full fetch complete (73895 records). [2025-10-09T17:14:41.947442] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-09T17:14:42.407681] [DEBUG] [LOCAL ] AMWL: Primary data saved (9317 records). [2025-10-09T17:14:42.426576] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-09T17:14:42.426820] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-09T17:14:42.407564] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-09T17:14:42.427760] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-09T17:14:42.428537] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-09T17:14:42.428741] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-09T17:14:42.428688] [INFO ] [MAIN ] Update Progress: 113/2373 symbols completed. AMWL took 25.0s. Estimated remaining: 4h 52m 58s. Rate: 7.7 symbols/min [2025-10-09T17:14:42.541734] [DEBUG] [LOCAL ] AMTM: Trimmed 73895 records to 51005 (keeping 200 days of data) [2025-10-09T17:14:42.718443] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:42.883830] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-09T17:14:42.888492] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-09T17:14:43.059439] [DEBUG] [LOCAL ] AMTM: Primary data saved (51005 records). [2025-10-09T17:14:43.062892] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-09T17:14:43.063110] [INFO ] [MAIN ] Update Progress: 114/2373 symbols completed. AMTM took 40.1s. Estimated remaining: 4h 50m 28s. Rate: 7.8 symbols/min [2025-10-09T17:14:43.271741] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:14:43.282772] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-09T17:14:43.288047] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-09T17:14:43.311108] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-09T17:14:43.311221] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-09T17:14:43.351520] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:14:43.505112] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T17:14:43.536753] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-09T17:14:43.815726] [DEBUG] [LOCAL ] ANF: Loaded 52101 existing records from primary storage. [2025-10-09T17:14:43.820767] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:43.821309] [INFO ] [MAIN ] ANF: Loaded 52101 existing records. [2025-10-09T17:14:44.000597] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-09T17:14:44.022792] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:14:44.023344] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-09T17:14:44.023476] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-09T17:14:44.024431] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-09T17:14:44.051553] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-09T17:14:44.101346] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T17:14:44.416701] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:14:44.796783] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-09T17:14:45.143462] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T17:14:45.596790] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-09T17:14:46.396752] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-09T17:14:46.446672] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-09T17:14:46.567843] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T17:14:47.092584] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T17:14:47.196726] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-09T17:14:47.824420] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T17:14:47.996815] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-09T17:14:48.796847] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-09T17:14:49.064382] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T17:14:49.596719] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-09T17:14:50.110160] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T17:14:50.265909] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-10-09T17:14:50.396787] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-09T17:14:51.049777] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T17:14:51.196700] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-09T17:14:51.996752] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-09T17:14:52.074531] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T17:14:52.796781] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-09T17:14:53.137444] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T17:14:53.371550] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T17:14:53.596770] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-09T17:14:54.396689] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-09T17:14:54.457275] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:14:55.196694] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-09T17:14:55.554704] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T17:14:55.589459] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T17:14:55.996765] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-09T17:14:56.796784] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-09T17:14:57.550710] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-09T17:14:57.596666] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-09T17:14:57.683159] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T17:14:57.940446] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T17:14:58.396770] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-09T17:14:59.196715] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-09T17:14:59.619740] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T17:14:59.622446] [INFO ] [REMOTE ] AN: Full fetch complete (47186 records). [2025-10-09T17:14:59.622557] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-09T17:14:59.996830] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-09T17:15:00.034043] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-09T17:15:00.034375] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-09T17:15:00.035025] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-09T17:15:00.035104] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-09T17:15:00.036401] [DEBUG] [LOCAL ] AN: Trimmed 47186 records to 31875 (keeping 200 days of data) [2025-10-09T17:15:00.067200] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-09T17:15:00.268524] [DEBUG] [LOCAL ] AN: Primary data saved (31875 records). [2025-10-09T17:15:00.268695] [INFO ] [MAIN ] AN: Full history saved. [2025-10-09T17:15:00.268798] [INFO ] [MAIN ] Update Progress: 115/2373 symbols completed. AN took 27.9s. Estimated remaining: 4h 53m 27s. Rate: 7.7 symbols/min [2025-10-09T17:15:00.438223] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:00.438436] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-09T17:15:00.438489] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-09T17:15:00.438612] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-09T17:15:00.438684] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-09T17:15:00.438748] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-09T17:15:00.438783] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-09T17:15:00.792911] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:00.796662] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-09T17:15:01.030314] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:15:01.030627] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-09T17:15:01.030747] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:15:01.030856] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-09T17:15:01.030910] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:15:01.030951] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-09T17:15:01.031006] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-09T17:15:01.031040] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-09T17:15:01.031078] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-09T17:15:01.031124] [INFO ] [MAIN ] Update Progress: 116/2373 symbols completed. ANGX took 0.8s. Estimated remaining: 4h 51m 2s. Rate: 7.8 symbols/min [2025-10-09T17:15:01.200843] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:01.219981] [DEBUG] [LOCAL ] ANRO: Loaded 19212 existing records from primary storage. [2025-10-09T17:15:01.220243] [INFO ] [MAIN ] ANRO: Loaded 19212 existing records. [2025-10-09T17:15:01.358183] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-09T17:15:01.451487] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:15:01.451802] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-09T17:15:01.451853] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-09T17:15:01.452080] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-09T17:15:01.452141] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-09T17:15:01.601844] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-09T17:15:01.871537] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:02.269881] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-09T17:15:02.396726] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-09T17:15:03.196696] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-09T17:15:03.995250] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-09T17:15:03.999759] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-09T17:15:04.063527] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T17:15:04.377262] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T17:15:04.796757] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-09T17:15:05.507483] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:15:05.596683] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-09T17:15:06.396723] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-09T17:15:06.595120] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T17:15:06.777510] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T17:15:07.196734] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-09T17:15:07.996694] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-09T17:15:08.151354] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T17:15:08.340347] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T17:15:08.796729] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-09T17:15:09.596695] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-09T17:15:09.868534] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:15:10.185049] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T17:15:10.396736] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-09T17:15:11.196724] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-09T17:15:11.996686] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-09T17:15:12.016547] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T17:15:12.020621] [INFO ] [REMOTE ] AMX: Full fetch complete (70354 records). [2025-10-09T17:15:12.020843] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-09T17:15:12.039549] [FATAL] [VALIDATOR ] AMX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:15:12.049902] [FATAL] [MAIN ] AMX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:15:12.049978] [WARN ] [MAIN ] AMX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:15:12.050267] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-09T17:15:12.050693] [DEBUG] [LOCAL ] AMX: No primary data file found to delete. [2025-10-09T17:15:12.051762] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-09T17:15:12.051820] [INFO ] [LOCAL ] AMX: Starting deletion of derivative data. [2025-10-09T17:15:12.063214] [DEBUG] [LOCAL ] AMX: Deleted derivative data file. [2025-10-09T17:15:12.063880] [INFO ] [MAIN ] Update Progress: 117/2373 symbols completed. AMX took 41.6s. Estimated remaining: 4h 51m 58s. Rate: 7.7 symbols/min [2025-10-09T17:15:12.115014] [DEBUG] [REMOTE ] ANF: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-09T17:15:12.115238] [WARN ] [REMOTE ] ANF: No data returned for month 2025-09 [2025-10-09T17:15:12.115326] [FATAL] [REMOTE ] ANF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:15:12.115397] [FATAL] [MAIN ] ANF: Failed to fetch primary data. [2025-10-09T17:15:12.115459] [WARN ] [MAIN ] ANF: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:15:12.115527] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-09T17:15:12.115586] [DEBUG] [LOCAL ] ANF: No primary data file found to delete. [2025-10-09T17:15:12.115621] [INFO ] [LOCAL ] ANF: Starting deletion of derivative data. [2025-10-09T17:15:12.115837] [DEBUG] [LOCAL ] ANF: Deleted derivative data file. [2025-10-09T17:15:12.115917] [INFO ] [MAIN ] Update Progress: 118/2373 symbols completed. ANF took 29.1s. Estimated remaining: 4h 49m 23s. Rate: 7.8 symbols/min [2025-10-09T17:15:12.416742] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T17:15:12.796737] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-09T17:15:13.596741] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-09T17:15:14.601751] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T17:15:14.606396] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-09T17:15:14.907358] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-09T17:15:15.196787] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-09T17:15:15.673354] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T17:15:15.996719] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-09T17:15:17.021683] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T17:15:17.026321] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-09T17:15:17.107408] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T17:15:17.596690] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-09T17:15:17.945131] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T17:15:18.396729] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-09T17:15:19.196496] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T17:15:19.199492] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-09T17:15:20.031040] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-09T17:15:20.043800] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-09T17:15:20.338661] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T17:15:20.341428] [INFO ] [REMOTE ] ANRO: Full fetch complete (29609 records). [2025-10-09T17:15:20.341503] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-09T17:15:20.701841] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-09T17:15:20.701929] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-09T17:15:20.702354] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-09T17:15:20.702402] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-09T17:15:20.703277] [DEBUG] [LOCAL ] ANRO: Trimmed 29609 records to 19411 (keeping 200 days of data) [2025-10-09T17:15:20.812069] [DEBUG] [LOCAL ] ANRO: Primary data saved (19411 records). [2025-10-09T17:15:20.812217] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-09T17:15:20.812301] [INFO ] [MAIN ] Update Progress: 119/2373 symbols completed. ANRO took 19.8s. Estimated remaining: 4h 49m 34s. Rate: 7.8 symbols/min [2025-10-09T17:15:22.462764] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-09T17:15:22.474316] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-09T17:15:24.842006] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-09T17:15:24.848810] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-09T17:15:24.849049] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-09T17:15:25.243824] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-09T17:15:25.243905] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-09T17:15:25.244667] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-09T17:15:25.244733] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-09T17:15:25.246196] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 54156 (keeping 200 days of data) [2025-10-09T17:15:25.579865] [DEBUG] [LOCAL ] ANET: Primary data saved (54156 records). [2025-10-09T17:15:25.579991] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-09T17:15:25.581032] [INFO ] [MAIN ] Update Progress: 120/2373 symbols completed. ANET took 43.2s. Estimated remaining: 4h 48m 31s. Rate: 7.8 symbols/min [2025-10-09T17:15:26.272618] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:26.341922] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:26.320454] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:26.343044] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:26.342200] [DEBUG] [LOCAL ] AOD: No existing data file found in primary storage. [2025-10-09T17:15:26.343556] [WARN ] [MAIN ] AOD: No existing data found, performing full refresh instead. [2025-10-09T17:15:26.343671] [DEBUG] [LOCAL ] ANVS: No existing data file found in primary storage. [2025-10-09T17:15:26.343795] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-09T17:15:26.343928] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-09T17:15:26.344110] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-10-09T17:15:26.343860] [WARN ] [MAIN ] ANVS: No existing data found, performing full refresh instead. [2025-10-09T17:15:26.344273] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-09T17:15:26.355371] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-09T17:15:26.344027] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-09T17:15:26.365178] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-09T17:15:26.379858] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-09T17:15:26.379976] [DEBUG] [LOCAL ] ANVS: No primary data file found to delete. [2025-10-09T17:15:26.386021] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-09T17:15:26.386089] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-09T17:15:26.400337] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-09T17:15:26.425207] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-09T17:15:26.443519] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-09T17:15:26.490489] [DEBUG] [LOCAL ] AOMR: Loaded 16437 existing records from primary storage. [2025-10-09T17:15:26.495906] [INFO ] [MAIN ] AOMR: Loaded 16437 existing records. [2025-10-09T17:15:27.381474] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:15:27.473556] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-09T17:15:27.522273] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:27.575714] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:27.588785] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-09T17:15:27.593826] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-09T17:15:27.487570] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-09T17:15:27.629850] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:27.630270] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-09T17:15:27.631219] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-09T17:15:27.631282] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-09T17:15:27.901889] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:15:27.904524] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-09T17:15:27.915058] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:15:27.925440] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-09T17:15:27.943470] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:15:27.961261] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-09T17:15:27.961978] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-09T17:15:27.962375] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-09T17:15:27.982390] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-09T17:15:27.982340] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:27.982513] [INFO ] [MAIN ] Update Progress: 121/2373 symbols completed. AOMD took 2.4s. Estimated remaining: 4h 46m 45s. Rate: 7.9 symbols/min [2025-10-09T17:15:27.982780] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-09T17:15:28.149457] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:28.149597] [DEBUG] [LOCAL ] AON: No existing data file found in primary storage. [2025-10-09T17:15:28.149634] [WARN ] [MAIN ] AON: No existing data found, performing full refresh instead. [2025-10-09T17:15:28.149793] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-09T17:15:28.149849] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-09T17:15:28.149894] [DEBUG] [LOCAL ] AON: No primary data file found to delete. [2025-10-09T17:15:28.149926] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-09T17:15:28.495957] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:28.496257] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-09T17:15:29.002419] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:15:29.015387] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-09T17:15:29.016910] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T17:15:29.020065] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-09T17:15:29.053962] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T17:15:29.060075] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-09T17:15:29.765297] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T17:15:29.768088] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-09T17:15:30.226231] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T17:15:30.234969] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-09T17:15:30.265387] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T17:15:30.272982] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-09T17:15:30.337076] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T17:15:30.396668] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-09T17:15:30.880589] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T17:15:31.196690] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-09T17:15:31.520808] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T17:15:31.704872] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:15:31.734447] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T17:15:31.892933] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-09T17:15:31.996691] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-09T17:15:32.796776] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-09T17:15:32.953719] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T17:15:33.596767] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-09T17:15:34.075308] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T17:15:34.396695] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-09T17:15:34.493212] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T17:15:35.196793] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-09T17:15:35.814687] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T17:15:35.996689] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-09T17:15:36.041973] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T17:15:36.796709] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-09T17:15:37.200382] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T17:15:37.596723] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-09T17:15:38.002107] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T17:15:38.396731] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-09T17:15:39.160462] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T17:15:39.196677] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-09T17:15:39.726483] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T17:15:39.996738] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-09T17:15:40.796683] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-09T17:15:40.949773] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T17:15:41.355682] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T17:15:41.596725] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-09T17:15:41.760066] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T17:15:42.396770] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-09T17:15:43.196688] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-09T17:15:43.392758] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:15:43.712241] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T17:15:43.996739] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-09T17:15:44.224438] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T17:15:44.796732] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-09T17:15:45.477325] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T17:15:45.596696] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-09T17:15:45.736730] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T17:15:46.396721] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-09T17:15:46.517078] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T17:15:47.196729] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-09T17:15:47.704995] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T17:15:47.996763] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-09T17:15:48.332990] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T17:15:48.552937] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T17:15:48.796735] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-09T17:15:49.596714] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-09T17:15:50.122987] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T17:15:50.126169] [INFO ] [REMOTE ] AOD: Full fetch complete (44450 records). [2025-10-09T17:15:50.126267] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-09T17:15:50.402565] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-09T17:15:50.501219] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-09T17:15:50.501303] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-09T17:15:50.501823] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-09T17:15:50.501887] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-09T17:15:50.502900] [DEBUG] [LOCAL ] AOD: Trimmed 44450 records to 30853 (keeping 200 days of data) [2025-10-09T17:15:50.681516] [DEBUG] [LOCAL ] AOD: Primary data saved (30853 records). [2025-10-09T17:15:50.681685] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-09T17:15:50.681777] [INFO ] [MAIN ] Update Progress: 122/2373 symbols completed. AOD took 25.1s. Estimated remaining: 4h 51m 15s. Rate: 7.7 symbols/min [2025-10-09T17:15:50.845534] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:50.874141] [DEBUG] [LOCAL ] AORT: Loaded 29234 existing records from primary storage. [2025-10-09T17:15:50.874401] [INFO ] [MAIN ] AORT: Loaded 29234 existing records. [2025-10-09T17:15:51.073827] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:15:51.074260] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-09T17:15:51.074316] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-09T17:15:51.074706] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-09T17:15:51.074767] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-09T17:15:51.203101] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-09T17:15:51.428258] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T17:15:51.512958] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:51.624842] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T17:15:51.996730] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-09T17:15:52.117101] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T17:15:52.796708] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-09T17:15:52.935393] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T17:15:53.596746] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-09T17:15:53.746778] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T17:15:54.396777] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-09T17:15:54.988876] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T17:15:55.196679] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-09T17:15:55.508883] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T17:15:55.996708] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-09T17:15:56.466828] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T17:15:56.796774] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-09T17:15:56.931012] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T17:15:56.932946] [INFO ] [REMOTE ] AOMR: Full fetch complete (23044 records). [2025-10-09T17:15:56.933072] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-09T17:15:56.933584] [FATAL] [VALIDATOR ] AOMR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:15:56.933727] [FATAL] [MAIN ] AOMR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:15:56.933806] [WARN ] [MAIN ] AOMR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:15:56.933900] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-09T17:15:56.933999] [DEBUG] [LOCAL ] AOMR: No primary data file found to delete. [2025-10-09T17:15:56.934048] [INFO ] [LOCAL ] AOMR: Starting deletion of derivative data. [2025-10-09T17:15:56.934285] [DEBUG] [LOCAL ] AOMR: Deleted derivative data file. [2025-10-09T17:15:56.934389] [INFO ] [MAIN ] Update Progress: 123/2373 symbols completed. AOMR took 31.3s. Estimated remaining: 4h 50m 40s. Rate: 7.7 symbols/min [2025-10-09T17:15:57.199403] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:57.199625] [DEBUG] [LOCAL ] AOS: No existing data file found in primary storage. [2025-10-09T17:15:57.199719] [WARN ] [MAIN ] AOS: No existing data found, performing full refresh instead. [2025-10-09T17:15:57.199872] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-09T17:15:57.199937] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-09T17:15:57.199998] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-10-09T17:15:57.200040] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-09T17:15:57.608905] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-09T17:15:57.651316] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:57.735134] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T17:15:58.396726] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-09T17:15:59.062582] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T17:15:59.065908] [INFO ] [REMOTE ] AON: Full fetch complete (64331 records). [2025-10-09T17:15:59.066047] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-09T17:15:59.066754] [FATAL] [VALIDATOR ] AON: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:15:59.066840] [FATAL] [MAIN ] AON: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:15:59.066894] [WARN ] [MAIN ] AON: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:15:59.066981] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-09T17:15:59.067083] [DEBUG] [LOCAL ] AON: No primary data file found to delete. [2025-10-09T17:15:59.067149] [INFO ] [LOCAL ] AON: Starting deletion of derivative data. [2025-10-09T17:15:59.067229] [DEBUG] [LOCAL ] AON: No derivative data file found to delete. [2025-10-09T17:15:59.067328] [INFO ] [MAIN ] Update Progress: 124/2373 symbols completed. AON took 31.1s. Estimated remaining: 4h 48m 50s. Rate: 7.8 symbols/min [2025-10-09T17:15:59.209842] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-09T17:15:59.242574] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:15:59.251757] [DEBUG] [LOCAL ] AP: Loaded 7216 existing records from primary storage. [2025-10-09T17:15:59.252407] [INFO ] [MAIN ] AP: Loaded 7216 existing records. [2025-10-09T17:15:59.430508] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:15:59.430747] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-09T17:15:59.430817] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-09T17:15:59.431054] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-09T17:15:59.431112] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-09T17:15:59.805463] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:15:59.918623] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T17:15:59.996740] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-09T17:16:00.258036] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T17:16:00.260567] [INFO ] [REMOTE ] ANVS: Full fetch complete (36149 records). [2025-10-09T17:16:00.260688] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-09T17:16:00.632245] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-09T17:16:00.632320] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-09T17:16:00.632753] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-09T17:16:00.632816] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-09T17:16:00.633611] [DEBUG] [LOCAL ] ANVS: Trimmed 36149 records to 23421 (keeping 200 days of data) [2025-10-09T17:16:00.768740] [DEBUG] [LOCAL ] ANVS: Primary data saved (23421 records). [2025-10-09T17:16:00.768906] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-09T17:16:00.769025] [INFO ] [MAIN ] Update Progress: 125/2373 symbols completed. ANVS took 35.2s. Estimated remaining: 4h 46m 55s. Rate: 7.8 symbols/min [2025-10-09T17:16:00.802280] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-09T17:16:00.943171] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:16:00.977916] [DEBUG] [LOCAL ] APAM: Loaded 36012 existing records from primary storage. [2025-10-09T17:16:00.978242] [INFO ] [MAIN ] APAM: Loaded 36012 existing records. [2025-10-09T17:16:01.153310] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:16:01.153579] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-09T17:16:01.153629] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-09T17:16:01.155139] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-09T17:16:01.155202] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-09T17:16:01.526194] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:16:01.530814] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T17:16:01.596925] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-09T17:16:01.759572] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T17:16:02.396737] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-09T17:16:03.003445] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:16:03.196780] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-09T17:16:03.622126] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T17:16:03.996751] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-09T17:16:04.063083] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T17:16:04.796736] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-09T17:16:05.397540] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T17:16:05.596728] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-09T17:16:06.318123] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T17:16:06.396731] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-09T17:16:06.536597] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:16:07.196741] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-09T17:16:07.996692] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-09T17:16:08.098716] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T17:16:08.606192] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:16:08.796736] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-09T17:16:09.491684] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T17:16:09.524951] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:16:09.596704] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-09T17:16:10.396705] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-09T17:16:10.950595] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T17:16:11.196748] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-09T17:16:11.998706] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-09T17:16:12.001056] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-09T17:16:12.057411] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T17:16:12.796809] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-09T17:16:13.387099] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T17:16:13.600254] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-09T17:16:13.603173] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T17:16:14.396773] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-09T17:16:15.196703] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-09T17:16:15.336979] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T17:16:16.003017] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-09T17:16:16.019706] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T17:16:16.617879] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T17:16:16.796755] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-09T17:16:17.419823] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T17:16:17.596698] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-09T17:16:17.709126] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T17:16:18.388445] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-09T17:16:18.396684] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-09T17:16:19.159391] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-09T17:16:19.196697] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-09T17:16:19.943846] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T17:16:19.996710] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-09T17:16:20.796761] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-09T17:16:21.449040] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T17:16:21.449958] [INFO ] [REMOTE ] AP: Full fetch complete (8939 records). [2025-10-09T17:16:21.450025] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-09T17:16:21.450399] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:16:21.450478] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:16:21.450522] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:16:21.450588] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-09T17:16:21.450670] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-10-09T17:16:21.450726] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-10-09T17:16:21.450905] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-10-09T17:16:21.450989] [INFO ] [MAIN ] Update Progress: 126/2373 symbols completed. AP took 22.4s. Estimated remaining: 4h 50m 39s. Rate: 7.7 symbols/min [2025-10-09T17:16:21.604112] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-09T17:16:21.623385] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:16:21.666110] [DEBUG] [LOCAL ] APD: Loaded 45285 existing records from primary storage. [2025-10-09T17:16:21.666414] [INFO ] [MAIN ] APD: Loaded 45285 existing records. [2025-10-09T17:16:21.848751] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:16:21.849081] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-09T17:16:21.849144] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-09T17:16:21.850615] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-09T17:16:21.850697] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-09T17:16:22.144031] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-09T17:16:22.258067] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:16:22.396710] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-09T17:16:22.628854] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T17:16:23.196704] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-09T17:16:23.774575] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:16:23.996725] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-09T17:16:24.368100] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T17:16:24.796745] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-09T17:16:25.123487] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T17:16:25.596716] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-09T17:16:26.396730] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-09T17:16:26.546113] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T17:16:26.572921] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T17:16:27.196716] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-09T17:16:27.755571] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:16:27.996710] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-09T17:16:28.675063] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T17:16:28.796718] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-09T17:16:29.099274] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:16:29.103276] [INFO ] [REMOTE ] AOS: Full fetch complete (70655 records). [2025-10-09T17:16:29.103392] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-09T17:16:29.479722] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-09T17:16:29.479813] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-09T17:16:29.480516] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-09T17:16:29.480561] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-09T17:16:29.481955] [DEBUG] [LOCAL ] AOS: Trimmed 70655 records to 49043 (keeping 200 days of data) [2025-10-09T17:16:29.596895] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-09T17:16:29.791182] [DEBUG] [LOCAL ] AOS: Primary data saved (49043 records). [2025-10-09T17:16:29.791326] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-09T17:16:29.791400] [INFO ] [MAIN ] Update Progress: 127/2373 symbols completed. AOS took 32.9s. Estimated remaining: 4h 50m 42s. Rate: 7.7 symbols/min [2025-10-09T17:16:29.959380] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:16:30.007974] [DEBUG] [LOCAL ] APG: Loaded 50463 existing records from primary storage. [2025-10-09T17:16:30.008297] [INFO ] [MAIN ] APG: Loaded 50463 existing records. [2025-10-09T17:16:30.186174] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:16:30.186440] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-09T17:16:30.186612] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-09T17:16:30.193225] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-09T17:16:30.203189] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-09T17:16:30.248315] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T17:16:30.405156] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-09T17:16:30.577599] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:16:30.828247] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:16:31.196722] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-09T17:16:31.753142] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T17:16:31.755697] [INFO ] [REMOTE ] AORT: Full fetch complete (42044 records). [2025-10-09T17:16:31.755794] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-09T17:16:32.004967] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-09T17:16:32.147883] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-09T17:16:32.148046] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-09T17:16:32.148703] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-09T17:16:32.148787] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-09T17:16:32.149954] [DEBUG] [LOCAL ] AORT: Trimmed 42044 records to 29364 (keeping 200 days of data) [2025-10-09T17:16:32.332399] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T17:16:32.353084] [DEBUG] [LOCAL ] AORT: Primary data saved (29364 records). [2025-10-09T17:16:32.353205] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-09T17:16:32.353284] [INFO ] [MAIN ] Update Progress: 128/2373 symbols completed. AORT took 41.7s. Estimated remaining: 4h 49m 3s. Rate: 7.8 symbols/min [2025-10-09T17:16:32.526488] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:16:32.579256] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-09T17:16:32.579561] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-09T17:16:32.756838] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:16:32.757047] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-09T17:16:32.757093] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-09T17:16:32.758576] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-09T17:16:32.758634] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-09T17:16:32.802213] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-09T17:16:33.126082] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:16:33.596689] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-09T17:16:33.777220] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:16:34.162554] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T17:16:34.165348] [INFO ] [REMOTE ] APAM: Full fetch complete (51577 records). [2025-10-09T17:16:34.165431] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-09T17:16:34.166360] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:16:34.166447] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:16:34.166490] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:16:34.166556] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-09T17:16:34.166619] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-09T17:16:34.166699] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-10-09T17:16:34.166947] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-10-09T17:16:34.167620] [INFO ] [MAIN ] Update Progress: 129/2373 symbols completed. APAM took 33.4s. Estimated remaining: 4h 47m 12s. Rate: 7.8 symbols/min [2025-10-09T17:16:34.335421] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:16:34.392048] [DEBUG] [LOCAL ] APLE: Loaded 51926 existing records from primary storage. [2025-10-09T17:16:34.392352] [INFO ] [MAIN ] APLE: Loaded 51926 existing records. [2025-10-09T17:16:34.403458] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-09T17:16:34.571906] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:16:34.572133] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-09T17:16:34.572180] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-09T17:16:34.572432] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-09T17:16:34.572489] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-09T17:16:34.956703] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:16:35.196682] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-09T17:16:35.996703] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-09T17:16:36.049204] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-09T17:16:36.415345] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T17:16:36.796708] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-09T17:16:36.848672] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T17:16:37.463054] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:16:37.596677] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-09T17:16:38.396714] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-09T17:16:38.479706] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:16:39.196718] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-09T17:16:39.247462] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T17:16:39.846605] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T17:16:39.996730] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-09T17:16:40.796722] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-09T17:16:40.911407] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T17:16:41.557116] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T17:16:41.596679] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-09T17:16:42.396701] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-09T17:16:42.435441] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:16:43.200055] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-09T17:16:43.205419] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:16:43.962927] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:16:43.996668] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-09T17:16:44.796687] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-09T17:16:44.923049] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T17:16:45.596708] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-09T17:16:45.839224] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T17:16:46.396702] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-09T17:16:46.840547] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-09T17:16:46.875827] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T17:16:47.196775] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-09T17:16:47.938227] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T17:16:47.996701] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-09T17:16:48.680704] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T17:16:48.796738] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-09T17:16:49.596825] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-09T17:16:49.676051] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:16:50.396755] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-09T17:16:50.701216] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T17:16:51.196773] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-09T17:16:51.423196] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T17:16:51.996699] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-09T17:16:52.155530] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T17:16:52.796681] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-09T17:16:53.013350] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T17:16:53.603851] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-09T17:16:53.629623] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:16:54.396733] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-09T17:16:54.505330] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T17:16:55.196686] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-09T17:16:55.996686] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-09T17:16:56.175560] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-09T17:16:56.796698] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-09T17:16:57.090159] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T17:16:57.387272] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-10-09T17:16:57.596756] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-09T17:16:57.796488] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T17:16:58.270804] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T17:16:58.396681] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-09T17:16:59.196766] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-09T17:16:59.422523] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T17:16:59.609739] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T17:16:59.996736] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-09T17:17:00.549514] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T17:17:00.796718] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-09T17:17:01.596811] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-09T17:17:01.788145] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T17:17:02.396750] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-09T17:17:02.534862] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T17:17:02.538914] [INFO ] [REMOTE ] APD: Full fetch complete (66888 records). [2025-10-09T17:17:02.539013] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-09T17:17:02.930062] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-09T17:17:02.930222] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-09T17:17:02.931084] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-09T17:17:02.931152] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-09T17:17:02.932573] [DEBUG] [LOCAL ] APD: Trimmed 66888 records to 45648 (keeping 200 days of data) [2025-10-09T17:17:03.196834] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-09T17:17:03.285232] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T17:17:03.299593] [DEBUG] [LOCAL ] APD: Primary data saved (45648 records). [2025-10-09T17:17:03.299770] [INFO ] [MAIN ] APD: Full history saved. [2025-10-09T17:17:03.300734] [INFO ] [MAIN ] Update Progress: 130/2373 symbols completed. APD took 41.8s. Estimated remaining: 4h 53m 15s. Rate: 7.6 symbols/min [2025-10-09T17:17:03.477724] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:03.535900] [DEBUG] [LOCAL ] APO: Loaded 53383 existing records from primary storage. [2025-10-09T17:17:03.536251] [INFO ] [MAIN ] APO: Loaded 53383 existing records. [2025-10-09T17:17:03.728080] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:03.728304] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-09T17:17:03.728349] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-09T17:17:03.730008] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-09T17:17:03.730067] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-09T17:17:04.001815] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-09T17:17:04.125579] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:04.415671] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T17:17:04.796771] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-09T17:17:05.092335] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T17:17:05.556454] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T17:17:05.560401] [INFO ] [REMOTE ] APG: Full fetch complete (71425 records). [2025-10-09T17:17:05.560510] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-09T17:17:05.561274] [FATAL] [VALIDATOR ] APG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:17:05.561413] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:17:05.561487] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:17:05.561555] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-09T17:17:05.561621] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-09T17:17:05.561697] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-10-09T17:17:05.561936] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-10-09T17:17:05.562529] [INFO ] [MAIN ] Update Progress: 131/2373 symbols completed. APG took 35.8s. Estimated remaining: 4h 51m 31s. Rate: 7.7 symbols/min [2025-10-09T17:17:05.606221] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-09T17:17:05.734137] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:05.744579] [DEBUG] [LOCAL ] APOS: Loaded 7519 existing records from primary storage. [2025-10-09T17:17:05.744824] [INFO ] [MAIN ] APOS: Loaded 7519 existing records. [2025-10-09T17:17:05.917086] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:05.917284] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-09T17:17:05.917329] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-09T17:17:05.917749] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-09T17:17:05.917809] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-09T17:17:06.266678] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:06.396692] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-09T17:17:06.695340] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T17:17:07.068561] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T17:17:07.196752] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-09T17:17:07.649535] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-09T17:17:07.996776] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-09T17:17:08.378815] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-09T17:17:08.796748] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-09T17:17:09.338331] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T17:17:09.596709] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-09T17:17:09.809805] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-09T17:17:10.396797] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-09T17:17:11.196689] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-09T17:17:11.404706] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T17:17:11.930440] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T17:17:11.996674] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-09T17:17:12.075065] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:17:12.079415] [INFO ] [REMOTE ] APLE: Full fetch complete (74401 records). [2025-10-09T17:17:12.079520] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-09T17:17:12.466588] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-09T17:17:12.466698] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-09T17:17:12.467437] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-09T17:17:12.467482] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-09T17:17:12.468921] [DEBUG] [LOCAL ] APLE: Trimmed 74401 records to 52309 (keeping 200 days of data) [2025-10-09T17:17:12.792934] [DEBUG] [LOCAL ] APLE: Primary data saved (52309 records). [2025-10-09T17:17:12.793160] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-09T17:17:12.793976] [INFO ] [MAIN ] Update Progress: 132/2373 symbols completed. APLE took 38.6s. Estimated remaining: 4h 51m 14s. Rate: 7.7 symbols/min [2025-10-09T17:17:12.805103] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-09T17:17:12.978611] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:13.048791] [DEBUG] [LOCAL ] APTV: Loaded 52044 existing records from primary storage. [2025-10-09T17:17:13.049299] [INFO ] [MAIN ] APTV: Loaded 52044 existing records. [2025-10-09T17:17:13.232318] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:13.232678] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-09T17:17:13.232745] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-09T17:17:13.233077] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-09T17:17:13.233136] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-09T17:17:13.608692] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-09T17:17:13.617306] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:13.759540] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:17:13.813612] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T17:17:14.396816] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-09T17:17:15.154611] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T17:17:15.196712] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-09T17:17:15.803798] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-09T17:17:15.808543] [INFO ] [REMOTE ] APH: Full fetch complete (77691 records). [2025-10-09T17:17:15.808776] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-09T17:17:16.010298] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T17:17:16.007836] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-09T17:17:16.237476] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-09T17:17:16.237559] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-09T17:17:16.238349] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-09T17:17:16.238417] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-09T17:17:16.239866] [DEBUG] [LOCAL ] APH: Trimmed 77691 records to 54081 (keeping 200 days of data) [2025-10-09T17:17:16.586812] [DEBUG] [LOCAL ] APH: Primary data saved (54081 records). [2025-10-09T17:17:16.586967] [INFO ] [MAIN ] APH: Full history saved. [2025-10-09T17:17:16.587050] [INFO ] [MAIN ] Update Progress: 133/2373 symbols completed. APH took 44.2s. Estimated remaining: 4h 49m 58s. Rate: 7.7 symbols/min [2025-10-09T17:17:16.755104] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:16.801392] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-09T17:17:16.803315] [DEBUG] [LOCAL ] AQN: Loaded 51841 existing records from primary storage. [2025-10-09T17:17:16.803635] [INFO ] [MAIN ] AQN: Loaded 51841 existing records. [2025-10-09T17:17:16.982817] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:16.983110] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-09T17:17:16.983165] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-09T17:17:16.983388] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-09T17:17:16.983447] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-09T17:17:17.352565] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:17.596750] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-09T17:17:17.640964] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T17:17:18.013176] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T17:17:18.396750] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-09T17:17:19.196760] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-09T17:17:19.617514] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T17:17:19.996705] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-09T17:17:20.174089] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T17:17:20.608241] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:17:20.623745] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T17:17:20.796773] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-09T17:17:21.596725] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-09T17:17:22.363168] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T17:17:22.396673] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-09T17:17:22.553239] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:17:23.185634] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T17:17:23.187261] [INFO ] [REMOTE ] APOS: Full fetch complete (10376 records). [2025-10-09T17:17:23.187361] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-09T17:17:23.203724] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-09T17:17:23.668955] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-09T17:17:23.669162] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-09T17:17:23.669418] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-09T17:17:23.669480] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-09T17:17:23.669981] [DEBUG] [LOCAL ] APOS: Trimmed 10376 records to 7556 (keeping 200 days of data) [2025-10-09T17:17:23.716537] [DEBUG] [LOCAL ] APOS: Primary data saved (7556 records). [2025-10-09T17:17:23.716702] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-09T17:17:23.716845] [INFO ] [MAIN ] Update Progress: 134/2373 symbols completed. APOS took 18.2s. Estimated remaining: 4h 49m 40s. Rate: 7.7 symbols/min [2025-10-09T17:17:23.883767] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:23.891142] [DEBUG] [LOCAL ] AQNB: Loaded 4147 existing records from primary storage. [2025-10-09T17:17:23.891331] [INFO ] [MAIN ] AQNB: Loaded 4147 existing records. [2025-10-09T17:17:24.001922] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-09T17:17:24.068429] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:24.068685] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-09T17:17:24.068744] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-09T17:17:24.068951] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-09T17:17:24.069009] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-09T17:17:24.418424] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:24.796721] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-09T17:17:25.451614] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-09T17:17:25.596701] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-09T17:17:25.888738] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T17:17:26.396702] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-09T17:17:26.918835] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-09T17:17:27.162108] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:17:27.196711] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-09T17:17:27.954277] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T17:17:27.996726] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-09T17:17:28.546281] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T17:17:28.796742] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-09T17:17:29.016254] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T17:17:29.596776] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-09T17:17:30.294345] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:17:30.396751] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-09T17:17:30.816206] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T17:17:31.196677] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-09T17:17:31.708262] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T17:17:31.738090] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-09T17:17:31.996737] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-09T17:17:32.796718] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-09T17:17:33.596749] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-09T17:17:33.820587] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:17:34.174487] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T17:17:34.396703] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-09T17:17:34.534248] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T17:17:35.014708] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T17:17:35.196747] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-09T17:17:35.774699] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T17:17:35.996733] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-09T17:17:36.796775] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-09T17:17:37.446892] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:17:37.596718] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-09T17:17:38.396772] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-09T17:17:39.079459] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T17:17:39.198184] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-09T17:17:39.201027] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-09T17:17:39.477676] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T17:17:39.826366] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T17:17:39.996774] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-09T17:17:40.796723] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-09T17:17:41.596791] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-09T17:17:41.853227] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T17:17:41.943754] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-09T17:17:42.396743] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-09T17:17:42.862749] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-09T17:17:42.972602] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T17:17:43.196718] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-09T17:17:43.996731] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-09T17:17:44.524778] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T17:17:44.525841] [INFO ] [REMOTE ] AQNB: Full fetch complete (5557 records). [2025-10-09T17:17:44.525971] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-09T17:17:44.810118] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-09T17:17:44.896253] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-09T17:17:44.896328] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-09T17:17:44.896481] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-09T17:17:44.896520] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-09T17:17:44.896918] [DEBUG] [LOCAL ] AQNB: Trimmed 5557 records to 4155 (keeping 200 days of data) [2025-10-09T17:17:44.922902] [DEBUG] [LOCAL ] AQNB: Primary data saved (4155 records). [2025-10-09T17:17:44.922988] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-09T17:17:44.923060] [INFO ] [MAIN ] Update Progress: 135/2373 symbols completed. AQNB took 21.2s. Estimated remaining: 4h 53m 15s. Rate: 7.6 symbols/min [2025-10-09T17:17:45.092513] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:45.143738] [DEBUG] [LOCAL ] AR: Loaded 53590 existing records from primary storage. [2025-10-09T17:17:45.170217] [INFO ] [MAIN ] AR: Loaded 53590 existing records. [2025-10-09T17:17:45.239855] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T17:17:45.366689] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:45.366916] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-09T17:17:45.366963] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-09T17:17:45.367908] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-09T17:17:45.367981] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-09T17:17:45.604156] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-09T17:17:45.718519] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:46.396693] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-09T17:17:46.540214] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T17:17:47.196700] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-09T17:17:47.374622] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T17:17:47.996787] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-09T17:17:48.376328] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T17:17:48.624788] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T17:17:48.796714] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-09T17:17:49.596692] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-09T17:17:49.680937] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:17:49.684816] [INFO ] [REMOTE ] APTV: Full fetch complete (75484 records). [2025-10-09T17:17:49.684909] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-09T17:17:49.685681] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:17:49.685770] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:17:49.685813] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:17:49.685878] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-09T17:17:49.685942] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-09T17:17:49.685978] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-10-09T17:17:49.686185] [DEBUG] [LOCAL ] APTV: Deleted derivative data file. [2025-10-09T17:17:49.686731] [INFO ] [MAIN ] Update Progress: 136/2373 symbols completed. APTV took 36.9s. Estimated remaining: 4h 52m 16s. Rate: 7.7 symbols/min [2025-10-09T17:17:49.850535] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:49.850729] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-09T17:17:49.850777] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-09T17:17:49.850884] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-09T17:17:49.850926] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-09T17:17:49.850967] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-09T17:17:49.850998] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-09T17:17:50.200493] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:50.396709] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-09T17:17:50.561175] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T17:17:51.196760] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-09T17:17:51.357158] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T17:17:51.731829] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T17:17:51.996727] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-09T17:17:52.796708] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-09T17:17:52.920195] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T17:17:53.596695] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-09T17:17:53.691113] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T17:17:53.870406] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:17:54.396728] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-09T17:17:55.196727] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-09T17:17:55.317881] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T17:17:55.690808] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T17:17:55.996770] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-09T17:17:56.796725] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-09T17:17:56.980600] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T17:17:57.603735] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-09T17:17:57.605483] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T17:17:57.609780] [INFO ] [REMOTE ] AQN: Full fetch complete (74878 records). [2025-10-09T17:17:57.609898] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-09T17:17:57.610854] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:17:57.611244] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:17:57.611331] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:17:57.611407] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-09T17:17:57.611491] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-09T17:17:57.611548] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-09T17:17:57.611763] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-09T17:17:57.611859] [INFO ] [MAIN ] Update Progress: 137/2373 symbols completed. AQN took 41.0s. Estimated remaining: 4h 52m 10s. Rate: 7.7 symbols/min [2025-10-09T17:17:57.795492] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:17:57.811326] [DEBUG] [LOCAL ] ARDC: Loaded 15046 existing records from primary storage. [2025-10-09T17:17:57.811550] [INFO ] [MAIN ] ARDC: Loaded 15046 existing records. [2025-10-09T17:17:57.988514] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:17:57.988778] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-09T17:17:57.988829] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-09T17:17:57.989352] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-09T17:17:57.989409] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-09T17:17:58.354632] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:17:58.397073] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-09T17:17:58.398101] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T17:17:59.196711] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-09T17:17:59.279052] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:17:59.534755] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T17:17:59.996775] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-09T17:18:00.639494] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:18:00.685411] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T17:18:00.796703] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-09T17:18:01.451069] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T17:18:01.596700] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-09T17:18:02.396742] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-09T17:18:02.658166] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T17:18:03.196707] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-09T17:18:03.996713] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-09T17:18:04.371950] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T17:18:04.796689] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-09T17:18:04.982014] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:18:05.078576] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T17:18:05.596703] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-09T17:18:06.396713] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-09T17:18:06.463787] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:18:06.636625] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T17:18:06.641260] [INFO ] [REMOTE ] APO: Full fetch complete (77290 records). [2025-10-09T17:18:06.641369] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-09T17:18:07.043995] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-09T17:18:07.044100] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-09T17:18:07.044870] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-09T17:18:07.044933] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-09T17:18:07.046674] [DEBUG] [LOCAL ] APO: Trimmed 77290 records to 53773 (keeping 200 days of data) [2025-10-09T17:18:07.229719] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-09T17:18:07.382672] [DEBUG] [LOCAL ] APO: Primary data saved (53773 records). [2025-10-09T17:18:07.382829] [INFO ] [MAIN ] APO: Full history saved. [2025-10-09T17:18:07.384046] [INFO ] [MAIN ] Update Progress: 138/2373 symbols completed. APO took 1m 4s. Estimated remaining: 4h 52m 33s. Rate: 7.6 symbols/min [2025-10-09T17:18:07.553524] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:07.585632] [DEBUG] [LOCAL ] ARDT: Loaded 27723 existing records from primary storage. [2025-10-09T17:18:07.585950] [INFO ] [MAIN ] ARDT: Loaded 27723 existing records. [2025-10-09T17:18:07.776897] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:07.777189] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-09T17:18:07.777240] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-09T17:18:07.778032] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-09T17:18:07.778093] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-09T17:18:08.002826] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-09T17:18:08.168872] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T17:18:08.208192] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:08.796702] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-09T17:18:08.990906] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:18:09.296253] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-09T17:18:09.596723] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-09T17:18:10.044163] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T17:18:10.353276] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T17:18:10.396678] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-09T17:18:11.191014] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T17:18:11.196672] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-09T17:18:11.996714] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-09T17:18:12.796700] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-09T17:18:12.934106] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T17:18:13.596710] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-09T17:18:13.720886] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T17:18:13.858577] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T17:18:14.396737] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-09T17:18:14.507717] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T17:18:15.196709] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-09T17:18:15.435023] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T17:18:15.996735] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-09T17:18:16.796754] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-09T17:18:16.946264] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T17:18:16.979520] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T17:18:17.596719] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-09T17:18:18.396698] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-09T17:18:18.675283] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T17:18:19.196700] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-09T17:18:19.460279] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T17:18:19.458538] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T17:18:19.476204] [INFO ] [REMOTE ] ARDC: Full fetch complete (20988 records). [2025-10-09T17:18:19.476703] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-09T17:18:19.477683] [FATAL] [VALIDATOR ] ARDC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:18:19.477772] [FATAL] [MAIN ] ARDC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:18:19.477816] [WARN ] [MAIN ] ARDC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:18:19.477885] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-09T17:18:19.477949] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-09T17:18:19.478025] [INFO ] [LOCAL ] ARDC: Starting deletion of derivative data. [2025-10-09T17:18:19.478234] [DEBUG] [LOCAL ] ARDC: Deleted derivative data file. [2025-10-09T17:18:19.478332] [INFO ] [MAIN ] Update Progress: 139/2373 symbols completed. ARDC took 21.9s. Estimated remaining: 4h 53m 34s. Rate: 7.6 symbols/min [2025-10-09T17:18:19.642371] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:19.689087] [DEBUG] [LOCAL ] ARE: Loaded 50757 existing records from primary storage. [2025-10-09T17:18:19.689436] [INFO ] [MAIN ] ARE: Loaded 50757 existing records. [2025-10-09T17:18:19.866102] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:19.866302] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-09T17:18:19.866348] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-09T17:18:19.867857] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-09T17:18:19.867918] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-09T17:18:20.003414] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-09T17:18:20.219732] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:20.478004] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T17:18:20.796710] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-09T17:18:21.596687] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-09T17:18:21.751873] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T17:18:21.755824] [INFO ] [REMOTE ] AR: Full fetch complete (77162 records). [2025-10-09T17:18:21.755932] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-09T17:18:21.756720] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:18:21.756811] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:18:21.756854] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:18:21.756894] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-09T17:18:21.756948] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-09T17:18:21.756986] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-09T17:18:21.757153] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-10-09T17:18:21.758172] [INFO ] [MAIN ] Update Progress: 140/2373 symbols completed. AR took 36.8s. Estimated remaining: 4h 51m 56s. Rate: 7.6 symbols/min [2025-10-09T17:18:21.925151] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:21.975380] [DEBUG] [LOCAL ] ARES: Loaded 49647 existing records from primary storage. [2025-10-09T17:18:21.975726] [INFO ] [MAIN ] ARES: Loaded 49647 existing records. [2025-10-09T17:18:22.153972] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:22.154187] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-09T17:18:22.154239] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-09T17:18:22.155858] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-09T17:18:22.155918] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-09T17:18:22.397704] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-09T17:18:22.423853] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T17:18:22.450444] [INFO ] [REMOTE ] ARCO: Full fetch complete (65210 records). [2025-10-09T17:18:22.462757] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-09T17:18:22.668334] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:22.936180] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-09T17:18:22.936285] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-09T17:18:22.937092] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-09T17:18:22.937256] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-09T17:18:22.938983] [DEBUG] [LOCAL ] ARCO: Trimmed 65210 records to 44723 (keeping 200 days of data) [2025-10-09T17:18:23.040369] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:18:23.206927] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-09T17:18:23.224020] [DEBUG] [LOCAL ] ARCO: Primary data saved (44723 records). [2025-10-09T17:18:23.224154] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-09T17:18:23.224226] [INFO ] [MAIN ] Update Progress: 141/2373 symbols completed. ARCO took 33.5s. Estimated remaining: 4h 50m 8s. Rate: 7.7 symbols/min [2025-10-09T17:18:23.390483] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:23.429589] [DEBUG] [LOCAL ] ARI: Loaded 43669 existing records from primary storage. [2025-10-09T17:18:23.429929] [INFO ] [MAIN ] ARI: Loaded 43669 existing records. [2025-10-09T17:18:23.601584] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:23.601832] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-09T17:18:23.601880] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-09T17:18:23.603125] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-09T17:18:23.603184] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-09T17:18:23.954154] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:23.996670] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-09T17:18:24.041841] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:18:24.796704] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-09T17:18:25.007032] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T17:18:25.596754] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-09T17:18:25.749537] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T17:18:25.895080] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T17:18:26.396767] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-09T17:18:27.042414] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T17:18:27.196678] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-09T17:18:27.843103] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T17:18:27.996691] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-09T17:18:28.796747] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-09T17:18:28.824304] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T17:18:29.451713] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T17:18:29.596694] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-09T17:18:29.860059] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T17:18:30.396724] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-09T17:18:30.857115] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T17:18:31.196710] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-09T17:18:31.996694] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-09T17:18:32.200378] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T17:18:32.695955] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T17:18:32.796720] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-09T17:18:33.266375] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T17:18:33.596709] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-09T17:18:34.396756] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-09T17:18:34.794052] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T17:18:34.792906] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T17:18:35.196703] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-09T17:18:35.835887] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T17:18:35.996671] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-09T17:18:36.187708] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T17:18:36.796710] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-09T17:18:37.596690] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-09T17:18:37.713773] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T17:18:37.998637] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T17:18:38.001549] [INFO ] [REMOTE ] ARDT: Full fetch complete (41603 records). [2025-10-09T17:18:38.001624] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-09T17:18:38.370424] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-09T17:18:38.370508] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-09T17:18:38.370997] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-09T17:18:38.371061] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-09T17:18:38.372095] [DEBUG] [LOCAL ] ARDT: Trimmed 41603 records to 27921 (keeping 200 days of data) [2025-10-09T17:18:38.424365] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-09T17:18:38.550669] [DEBUG] [LOCAL ] ARDT: Primary data saved (27921 records). [2025-10-09T17:18:38.550814] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-09T17:18:38.550896] [INFO ] [MAIN ] Update Progress: 142/2373 symbols completed. ARDT took 31.2s. Estimated remaining: 4h 51m 58s. Rate: 7.6 symbols/min [2025-10-09T17:18:38.722896] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:38.770061] [DEBUG] [LOCAL ] ARIS: Loaded 42358 existing records from primary storage. [2025-10-09T17:18:38.770394] [INFO ] [MAIN ] ARIS: Loaded 42358 existing records. [2025-10-09T17:18:38.948580] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:38.948897] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-09T17:18:38.948990] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-09T17:18:38.949749] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-09T17:18:38.949809] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-09T17:18:39.203865] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-09T17:18:39.324866] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:39.382769] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:18:39.996724] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-09T17:18:40.341772] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T17:18:40.765048] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T17:18:40.796666] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-09T17:18:41.466330] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T17:18:41.596724] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-09T17:18:42.396691] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-09T17:18:42.542356] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T17:18:43.196746] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-09T17:18:43.288326] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T17:18:43.687699] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T17:18:43.996739] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-09T17:18:44.761373] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T17:18:44.796734] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-09T17:18:45.596708] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-09T17:18:45.675872] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:18:46.371777] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T17:18:46.396667] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-09T17:18:47.196691] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-09T17:18:47.622553] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T17:18:47.936410] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T17:18:47.996728] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-09T17:18:48.796691] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-09T17:18:48.847541] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T17:18:49.198788] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T17:18:49.596727] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-09T17:18:50.095988] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T17:18:50.396689] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-09T17:18:51.081935] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T17:18:51.196681] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-09T17:18:51.996689] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-09T17:18:52.162955] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T17:18:52.796684] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-09T17:18:52.827305] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:18:53.516052] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:18:53.596696] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-09T17:18:54.374072] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T17:18:54.396667] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-09T17:18:55.009276] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T17:18:55.196700] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-09T17:18:55.996693] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-09T17:18:56.014411] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T17:18:56.019536] [INFO ] [REMOTE ] ARE: Full fetch complete (72719 records). [2025-10-09T17:18:56.019677] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-09T17:18:56.434308] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-09T17:18:56.434421] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-09T17:18:56.435445] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-09T17:18:56.435524] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-09T17:18:56.436982] [DEBUG] [LOCAL ] ARE: Trimmed 72719 records to 51142 (keeping 200 days of data) [2025-10-09T17:18:56.721122] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T17:18:56.796671] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-09T17:18:56.800039] [DEBUG] [LOCAL ] ARE: Primary data saved (51142 records). [2025-10-09T17:18:56.800116] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-09T17:18:56.800203] [INFO ] [MAIN ] Update Progress: 143/2373 symbols completed. ARE took 37.3s. Estimated remaining: 4h 54m 32s. Rate: 7.6 symbols/min [2025-10-09T17:18:56.965777] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:56.965953] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-09T17:18:56.965990] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-09T17:18:56.966098] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-09T17:18:56.966139] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-09T17:18:56.966181] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-09T17:18:56.966214] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-09T17:18:57.332481] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:18:57.355339] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T17:18:57.596772] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-09T17:18:58.396753] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-09T17:18:58.631525] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T17:18:58.636016] [INFO ] [REMOTE ] ARES: Full fetch complete (70929 records). [2025-10-09T17:18:58.636124] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-09T17:18:59.028568] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-09T17:18:59.028746] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-09T17:18:59.029616] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-09T17:18:59.029863] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-09T17:18:59.031391] [DEBUG] [LOCAL ] ARES: Trimmed 70929 records to 50035 (keeping 200 days of data) [2025-10-09T17:18:59.221253] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-09T17:18:59.286225] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:18:59.396682] [DEBUG] [LOCAL ] ARES: Primary data saved (50035 records). [2025-10-09T17:18:59.396821] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-09T17:18:59.397701] [INFO ] [MAIN ] Update Progress: 144/2373 symbols completed. ARES took 37.6s. Estimated remaining: 4h 53m 2s. Rate: 7.6 symbols/min [2025-10-09T17:18:59.578787] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:18:59.642736] [DEBUG] [LOCAL ] ARMK: Loaded 50319 existing records from primary storage. [2025-10-09T17:18:59.643137] [INFO ] [MAIN ] ARMK: Loaded 50319 existing records. [2025-10-09T17:18:59.826925] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:18:59.827165] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-09T17:18:59.827212] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-09T17:18:59.827409] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-09T17:18:59.827464] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-09T17:19:00.012699] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-09T17:19:00.205003] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:00.219514] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T17:19:00.796705] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-09T17:19:00.935975] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T17:19:01.596690] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-09T17:19:01.740218] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T17:19:02.136507] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T17:19:02.396755] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-09T17:19:03.196704] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-09T17:19:03.327160] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T17:19:03.497190] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T17:19:03.996725] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-09T17:19:04.803696] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-09T17:19:04.806532] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T17:19:05.261146] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T17:19:05.596735] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-09T17:19:06.071119] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T17:19:06.396735] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-09T17:19:07.126189] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:19:07.196677] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-09T17:19:07.673003] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T17:19:07.677137] [INFO ] [REMOTE ] ARIS: Full fetch complete (61193 records). [2025-10-09T17:19:07.677244] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-09T17:19:08.001950] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-09T17:19:08.079303] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-10-09T17:19:08.079382] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-10-09T17:19:08.080055] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-10-09T17:19:08.080120] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-10-09T17:19:08.081413] [DEBUG] [LOCAL ] ARIS: Trimmed 61193 records to 42740 (keeping 200 days of data) [2025-10-09T17:19:08.343094] [DEBUG] [LOCAL ] ARIS: Primary data saved (42740 records). [2025-10-09T17:19:08.343225] [INFO ] [MAIN ] ARIS: Full history saved. [2025-10-09T17:19:08.344040] [INFO ] [MAIN ] Update Progress: 145/2373 symbols completed. ARIS took 29.8s. Estimated remaining: 4h 53m 10s. Rate: 7.6 symbols/min [2025-10-09T17:19:08.519338] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:08.565396] [DEBUG] [LOCAL ] AROC: Loaded 48975 existing records from primary storage. [2025-10-09T17:19:08.565758] [INFO ] [MAIN ] AROC: Loaded 48975 existing records. [2025-10-09T17:19:08.687791] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T17:19:08.727462] [INFO ] [REMOTE ] ARI: Full fetch complete (62576 records). [2025-10-09T17:19:08.748103] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-09T17:19:08.769680] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:19:08.801372] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-09T17:19:08.850505] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-09T17:19:08.861403] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-09T17:19:08.871919] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-09T17:19:08.872199] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-09T17:19:09.510283] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-09T17:19:09.541459] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-09T17:19:09.542414] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-09T17:19:09.541386] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:09.542611] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-09T17:19:09.544613] [DEBUG] [LOCAL ] ARI: Trimmed 62576 records to 43991 (keeping 200 days of data) [2025-10-09T17:19:09.609965] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-09T17:19:09.659879] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T17:19:09.847800] [DEBUG] [LOCAL ] ARI: Primary data saved (43991 records). [2025-10-09T17:19:09.847946] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-09T17:19:09.848567] [INFO ] [MAIN ] Update Progress: 146/2373 symbols completed. ARI took 46.6s. Estimated remaining: 4h 51m 25s. Rate: 7.6 symbols/min [2025-10-09T17:19:10.015697] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:10.015907] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-09T17:19:10.015944] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-09T17:19:10.016056] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-09T17:19:10.016097] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-09T17:19:10.016140] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-09T17:19:10.016216] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-09T17:19:10.378927] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:10.396668] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-09T17:19:10.610936] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T17:19:11.102897] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T17:19:11.196715] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-09T17:19:11.996731] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-09T17:19:12.146419] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T17:19:12.362375] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T17:19:12.796770] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-09T17:19:13.596706] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-09T17:19:13.768264] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T17:19:14.396714] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-09T17:19:14.480949] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:19:15.196678] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-09T17:19:15.537356] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T17:19:15.905045] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T17:19:15.996675] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-09T17:19:16.796753] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-09T17:19:16.994484] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:19:17.571276] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T17:19:17.596664] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-09T17:19:18.329531] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T17:19:18.396680] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-09T17:19:19.196686] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-09T17:19:19.254221] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T17:19:19.832530] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:19:19.996690] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-09T17:19:20.796697] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-09T17:19:20.996090] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T17:19:21.596704] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-09T17:19:21.736546] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T17:19:22.107983] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T17:19:22.396775] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-09T17:19:23.108711] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:19:23.196683] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-09T17:19:23.996750] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-09T17:19:24.560412] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-09T17:19:24.716955] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:19:24.796691] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-09T17:19:25.596693] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-09T17:19:25.759287] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T17:19:26.373340] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T17:19:26.396678] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-09T17:19:27.196696] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-09T17:19:27.254785] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T17:19:27.996702] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-09T17:19:28.206669] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T17:19:28.539630] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T17:19:28.796722] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-09T17:19:29.594618] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:19:29.596683] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-09T17:19:30.398058] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:19:30.396994] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-09T17:19:31.196684] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-09T17:19:31.243747] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T17:19:31.996694] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-09T17:19:32.446213] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-09T17:19:32.501579] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:19:32.796738] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-09T17:19:33.472764] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T17:19:33.476363] [INFO ] [REMOTE ] ARLO: Full fetch complete (62822 records). [2025-10-09T17:19:33.476458] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-09T17:19:33.601883] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-09T17:19:33.869465] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-09T17:19:33.869609] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-09T17:19:33.870918] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-09T17:19:33.870984] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-09T17:19:33.872283] [DEBUG] [LOCAL ] ARLO: Trimmed 62822 records to 43989 (keeping 200 days of data) [2025-10-09T17:19:33.966342] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T17:19:33.972279] [INFO ] [REMOTE ] ARMK: Full fetch complete (72644 records). [2025-10-09T17:19:33.973193] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-09T17:19:34.461267] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-09T17:19:34.457637] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-09T17:19:34.461384] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-09T17:19:34.463664] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-09T17:19:34.473800] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-09T17:19:34.503271] [DEBUG] [LOCAL ] ARMK: Trimmed 72644 records to 50707 (keeping 200 days of data) [2025-10-09T17:19:34.741685] [DEBUG] [LOCAL ] ARLO: Primary data saved (43989 records). [2025-10-09T17:19:34.767780] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-09T17:19:34.769371] [INFO ] [MAIN ] Update Progress: 147/2373 symbols completed. ARLO took 38.0s. Estimated remaining: 4h 55m 36s. Rate: 7.5 symbols/min [2025-10-09T17:19:34.967701] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:35.039855] [DEBUG] [LOCAL ] ARMK: Primary data saved (50707 records). [2025-10-09T17:19:35.040004] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-09T17:19:35.040633] [INFO ] [MAIN ] Update Progress: 148/2373 symbols completed. ARMK took 35.6s. Estimated remaining: 4h 53m 32s. Rate: 7.6 symbols/min [2025-10-09T17:19:35.165929] [DEBUG] [LOCAL ] ARW: Loaded 32823 existing records from primary storage. [2025-10-09T17:19:35.187304] [INFO ] [MAIN ] ARW: Loaded 32823 existing records. [2025-10-09T17:19:35.299307] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:35.311091] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-09T17:19:35.321457] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-09T17:19:35.338012] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-09T17:19:35.353944] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-09T17:19:35.387602] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-09T17:19:35.418027] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:19:35.418189] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-09T17:19:35.453570] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-09T17:19:35.492117] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-09T17:19:35.518810] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-09T17:19:35.518967] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-09T17:19:35.905121] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-09T17:19:36.075253] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-09T17:19:36.068067] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:36.097838] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-09T17:19:36.223727] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:36.355220] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:19:36.355470] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-09T17:19:36.355569] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:19:36.355637] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-09T17:19:36.355724] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:19:36.355797] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-09T17:19:36.355859] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-09T17:19:36.355895] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-09T17:19:36.355934] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-09T17:19:36.355979] [INFO ] [MAIN ] Update Progress: 149/2373 symbols completed. ARX took 1.3s. Estimated remaining: 4h 51m 45s. Rate: 7.6 symbols/min [2025-10-09T17:19:36.527606] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:36.578722] [DEBUG] [LOCAL ] AS: Loaded 53122 existing records from primary storage. [2025-10-09T17:19:36.579045] [INFO ] [MAIN ] AS: Loaded 53122 existing records. [2025-10-09T17:19:36.784668] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:19:36.787398] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-09T17:19:36.787487] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-09T17:19:36.788060] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-09T17:19:36.788121] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-09T17:19:36.789212] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-09T17:19:36.801868] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-09T17:19:37.152358] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:37.507709] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:19:37.511919] [INFO ] [REMOTE ] AROC: Full fetch complete (70993 records). [2025-10-09T17:19:37.512022] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-09T17:19:37.605081] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-09T17:19:37.915412] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-09T17:19:37.915496] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-09T17:19:37.916285] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-09T17:19:37.916353] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-09T17:19:37.917768] [DEBUG] [LOCAL ] AROC: Trimmed 70993 records to 49324 (keeping 200 days of data) [2025-10-09T17:19:38.233577] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:19:38.251310] [DEBUG] [LOCAL ] AROC: Primary data saved (49324 records). [2025-10-09T17:19:38.251470] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-09T17:19:38.252487] [INFO ] [MAIN ] Update Progress: 150/2373 symbols completed. AROC took 29.9s. Estimated remaining: 4h 50m 9s. Rate: 7.7 symbols/min [2025-10-09T17:19:38.402834] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-09T17:19:38.420556] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:38.420813] [DEBUG] [LOCAL ] ASA: No existing data file found in primary storage. [2025-10-09T17:19:38.420860] [WARN ] [MAIN ] ASA: No existing data found, performing full refresh instead. [2025-10-09T17:19:38.420988] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-09T17:19:38.421029] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-09T17:19:38.421069] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-09T17:19:38.421101] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-09T17:19:38.769504] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:39.196754] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-09T17:19:39.747951] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-09T17:19:39.856340] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T17:19:39.996715] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-09T17:19:40.432179] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:19:40.796766] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-09T17:19:41.432512] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T17:19:41.436996] [INFO ] [REMOTE ] ARR: Full fetch complete (75275 records). [2025-10-09T17:19:41.437143] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-09T17:19:41.610903] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-09T17:19:41.678075] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:19:41.839018] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-09T17:19:41.839096] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-09T17:19:41.839831] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-09T17:19:41.839895] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-09T17:19:41.841266] [DEBUG] [LOCAL ] ARR: Trimmed 75275 records to 52462 (keeping 200 days of data) [2025-10-09T17:19:42.161260] [DEBUG] [LOCAL ] ARR: Primary data saved (52462 records). [2025-10-09T17:19:42.161395] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-09T17:19:42.161478] [INFO ] [MAIN ] Update Progress: 151/2373 symbols completed. ARR took 32.3s. Estimated remaining: 4h 49m 4s. Rate: 7.7 symbols/min [2025-10-09T17:19:42.329474] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:42.379510] [DEBUG] [LOCAL ] ASAN: Loaded 52721 existing records from primary storage. [2025-10-09T17:19:42.379864] [INFO ] [MAIN ] ASAN: Loaded 52721 existing records. [2025-10-09T17:19:42.401842] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-09T17:19:42.560532] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:19:42.560858] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-09T17:19:42.560914] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-09T17:19:42.561134] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-09T17:19:42.561191] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-09T17:19:42.992890] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:43.020458] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:19:43.196784] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-09T17:19:43.977135] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T17:19:43.996726] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-09T17:19:44.796764] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-09T17:19:44.809933] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T17:19:45.387713] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-09T17:19:45.596725] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-09T17:19:46.098922] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T17:19:46.388997] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T17:19:46.396670] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-09T17:19:47.196778] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-09T17:19:47.767709] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T17:19:47.842546] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-09T17:19:47.996721] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-09T17:19:48.689013] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T17:19:48.796701] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-09T17:19:49.601377] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-09T17:19:49.603087] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T17:19:50.396710] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-09T17:19:51.196689] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-09T17:19:51.379477] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T17:19:51.825848] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T17:19:51.996697] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-09T17:19:52.031475] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T17:19:52.796735] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-09T17:19:53.194515] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T17:19:53.596720] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-09T17:19:54.044408] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T17:19:54.396760] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-09T17:19:54.941065] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T17:19:55.182449] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-09T17:19:55.196673] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-09T17:19:55.941499] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T17:19:55.996675] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-09T17:19:56.796735] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-09T17:19:57.050002] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:19:57.596748] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-09T17:19:58.286824] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T17:19:58.396749] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-09T17:19:58.782765] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T17:19:58.785051] [INFO ] [REMOTE ] ASA: Full fetch complete (19597 records). [2025-10-09T17:19:58.785137] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-09T17:19:59.143634] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-09T17:19:59.143740] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-09T17:19:59.144005] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-09T17:19:59.144053] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-09T17:19:59.144619] [DEBUG] [LOCAL ] ASA: Trimmed 19597 records to 14879 (keeping 200 days of data) [2025-10-09T17:19:59.207937] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-09T17:19:59.233809] [DEBUG] [LOCAL ] ASA: Primary data saved (14879 records). [2025-10-09T17:19:59.233905] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-09T17:19:59.233985] [INFO ] [MAIN ] Update Progress: 152/2373 symbols completed. ASA took 21.0s. Estimated remaining: 4h 51m 11s. Rate: 7.6 symbols/min [2025-10-09T17:19:59.402446] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:19:59.447822] [DEBUG] [LOCAL ] ASB: Loaded 49541 existing records from primary storage. [2025-10-09T17:19:59.448204] [INFO ] [MAIN ] ASB: Loaded 49541 existing records. [2025-10-09T17:19:59.622207] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:19:59.622425] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-09T17:19:59.622471] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-09T17:19:59.622808] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-09T17:19:59.622866] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-09T17:19:59.977569] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:19:59.996663] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-09T17:20:00.172608] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T17:20:00.587547] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T17:20:00.796768] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-09T17:20:01.608619] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-09T17:20:01.616557] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:20:02.260407] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:20:02.396785] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-09T17:20:03.196725] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-09T17:20:03.484487] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T17:20:04.001808] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-09T17:20:04.018206] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T17:20:04.796689] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-09T17:20:04.894985] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T17:20:05.596751] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-09T17:20:05.931966] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T17:20:05.967976] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T17:20:06.396731] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-09T17:20:06.715824] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T17:20:07.196739] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-09T17:20:07.998349] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-09T17:20:08.003936] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:20:08.796689] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-09T17:20:08.983165] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:20:09.111816] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T17:20:09.114732] [INFO ] [REMOTE ] ARW: Full fetch complete (48008 records). [2025-10-09T17:20:09.114819] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-09T17:20:09.511899] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-09T17:20:09.511978] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-09T17:20:09.512485] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-09T17:20:09.512524] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-09T17:20:09.513456] [DEBUG] [LOCAL ] ARW: Trimmed 48008 records to 33052 (keeping 200 days of data) [2025-10-09T17:20:09.601563] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-09T17:20:09.717334] [DEBUG] [LOCAL ] ARW: Primary data saved (33052 records). [2025-10-09T17:20:09.717471] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-09T17:20:09.717553] [INFO ] [MAIN ] Update Progress: 153/2373 symbols completed. ARW took 34.9s. Estimated remaining: 4h 51m 41s. Rate: 7.6 symbols/min [2025-10-09T17:20:09.895194] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:09.901286] [DEBUG] [LOCAL ] ASBA: Loaded 3456 existing records from primary storage. [2025-10-09T17:20:09.901467] [INFO ] [MAIN ] ASBA: Loaded 3456 existing records. [2025-10-09T17:20:10.100339] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:20:10.100705] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-09T17:20:10.100774] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-09T17:20:10.101003] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-09T17:20:10.101131] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-09T17:20:10.400376] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-09T17:20:10.463577] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:20:10.492876] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T17:20:11.196682] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-09T17:20:11.643218] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-09T17:20:11.996734] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-09T17:20:12.035263] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:20:12.796788] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-09T17:20:13.596710] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-09T17:20:13.925122] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-09T17:20:13.990420] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-09T17:20:14.139538] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T17:20:14.396729] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-09T17:20:14.900141] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-09T17:20:15.196744] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-09T17:20:15.241699] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-09T17:20:15.996730] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-09T17:20:16.459776] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T17:20:16.796741] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-09T17:20:17.069401] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:20:17.348271] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T17:20:17.596794] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-09T17:20:18.396875] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-09T17:20:18.884228] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T17:20:18.954051] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T17:20:19.196742] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-09T17:20:19.996721] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-09T17:20:20.796690] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-09T17:20:20.896271] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T17:20:21.596692] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-09T17:20:21.894948] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T17:20:22.159300] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T17:20:22.396712] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-09T17:20:22.905425] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-09T17:20:23.196719] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-09T17:20:23.866520] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T17:20:23.996709] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-09T17:20:24.796696] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-09T17:20:24.999717] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:20:25.004351] [INFO ] [REMOTE ] ASAN: Full fetch complete (76527 records). [2025-10-09T17:20:25.004478] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-09T17:20:25.381293] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T17:20:25.415157] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-09T17:20:25.415247] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-09T17:20:25.416003] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-09T17:20:25.416066] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-09T17:20:25.417461] [DEBUG] [LOCAL ] ASAN: Trimmed 76527 records to 53111 (keeping 200 days of data) [2025-10-09T17:20:25.618720] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-09T17:20:25.740879] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T17:20:25.746868] [INFO ] [REMOTE ] AS: Full fetch complete (76561 records). [2025-10-09T17:20:25.747510] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-09T17:20:25.870988] [DEBUG] [LOCAL ] ASAN: Primary data saved (53111 records). [2025-10-09T17:20:25.881349] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-09T17:20:25.900464] [INFO ] [MAIN ] Update Progress: 154/2373 symbols completed. ASAN took 43.7s. Estimated remaining: 4h 53m 33s. Rate: 7.6 symbols/min [2025-10-09T17:20:26.248356] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:26.334998] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-09T17:20:26.335080] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-09T17:20:26.335841] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-09T17:20:26.335924] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-09T17:20:26.338553] [DEBUG] [LOCAL ] AS: Trimmed 76561 records to 53512 (keeping 200 days of data) [2025-10-09T17:20:26.396758] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-09T17:20:26.459979] [DEBUG] [LOCAL ] ASC: Loaded 37471 existing records from primary storage. [2025-10-09T17:20:26.461886] [INFO ] [MAIN ] ASC: Loaded 37471 existing records. [2025-10-09T17:20:26.659569] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:20:26.663502] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-09T17:20:26.665537] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-09T17:20:26.673997] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-09T17:20:26.674064] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-09T17:20:26.990528] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T17:20:27.201480] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-09T17:20:27.221671] [DEBUG] [LOCAL ] AS: Primary data saved (53512 records). [2025-10-09T17:20:27.239126] [INFO ] [MAIN ] AS: Full history saved. [2025-10-09T17:20:27.260433] [INFO ] [MAIN ] Update Progress: 155/2373 symbols completed. AS took 50.9s. Estimated remaining: 4h 51m 51s. Rate: 7.6 symbols/min [2025-10-09T17:20:27.280010] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:20:27.459628] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:27.488749] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:20:27.512315] [DEBUG] [LOCAL ] ASG: Loaded 19553 existing records from primary storage. [2025-10-09T17:20:27.512556] [INFO ] [MAIN ] ASG: Loaded 19553 existing records. [2025-10-09T17:20:27.635435] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-09T17:20:27.705754] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:20:27.705948] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-09T17:20:27.705996] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-09T17:20:27.706201] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-09T17:20:27.706258] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-09T17:20:28.000022] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-09T17:20:28.079986] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:20:28.348314] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T17:20:28.796786] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-09T17:20:29.596737] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-09T17:20:30.402164] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-09T17:20:30.407600] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T17:20:31.094610] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:20:31.095455] [INFO ] [REMOTE ] ASBA: Full fetch complete (5192 records). [2025-10-09T17:20:31.095525] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-09T17:20:31.200848] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-09T17:20:31.347172] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T17:20:31.489457] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-09T17:20:31.489541] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-09T17:20:31.489737] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-09T17:20:31.489799] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-09T17:20:31.490159] [DEBUG] [LOCAL ] ASBA: Trimmed 5192 records to 3471 (keeping 200 days of data) [2025-10-09T17:20:31.511364] [DEBUG] [LOCAL ] ASBA: Primary data saved (3471 records). [2025-10-09T17:20:31.511452] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-09T17:20:31.511529] [INFO ] [MAIN ] Update Progress: 156/2373 symbols completed. ASBA took 21.8s. Estimated remaining: 4h 50m 51s. Rate: 7.6 symbols/min [2025-10-09T17:20:31.675767] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:31.701943] [DEBUG] [LOCAL ] ASGI: Loaded 22731 existing records from primary storage. [2025-10-09T17:20:31.702282] [INFO ] [MAIN ] ASGI: Loaded 22731 existing records. [2025-10-09T17:20:31.951512] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:20:31.951775] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-09T17:20:31.951824] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-09T17:20:31.952036] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-09T17:20:31.952092] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-09T17:20:32.004580] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-09T17:20:32.298320] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:20:32.796719] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-09T17:20:32.811868] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T17:20:32.816280] [INFO ] [REMOTE ] ASB: Full fetch complete (71749 records). [2025-10-09T17:20:32.816396] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-09T17:20:33.215438] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-09T17:20:33.215967] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:20:33.216180] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-09T17:20:33.222076] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-09T17:20:33.222141] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-09T17:20:33.223616] [DEBUG] [LOCAL ] ASB: Trimmed 71749 records to 49923 (keeping 200 days of data) [2025-10-09T17:20:33.530959] [DEBUG] [LOCAL ] ASB: Primary data saved (49923 records). [2025-10-09T17:20:33.531108] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-09T17:20:33.531979] [INFO ] [MAIN ] Update Progress: 157/2373 symbols completed. ASB took 34.3s. Estimated remaining: 4h 49m 21s. Rate: 7.7 symbols/min [2025-10-09T17:20:33.596743] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-09T17:20:33.958018] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T17:20:34.396739] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-09T17:20:34.764955] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T17:20:35.196726] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-09T17:20:35.982220] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T17:20:35.996699] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-09T17:20:36.314946] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T17:20:36.796781] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-09T17:20:37.325584] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T17:20:37.596694] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-09T17:20:37.839384] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T17:20:38.396755] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-09T17:20:38.586207] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T17:20:39.196701] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-09T17:20:39.511115] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T17:20:39.996695] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-09T17:20:40.370555] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T17:20:40.796784] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-09T17:20:41.546521] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T17:20:41.596683] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-09T17:20:41.894721] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T17:20:42.396730] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-09T17:20:43.065044] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:20:43.196682] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-09T17:20:43.586754] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T17:20:43.996726] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-09T17:20:44.406095] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T17:20:44.796712] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-09T17:20:44.833790] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-09T17:20:45.596731] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-09T17:20:45.704184] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T17:20:46.396721] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-09T17:20:46.612260] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T17:20:47.196686] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-09T17:20:47.495865] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T17:20:47.809466] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T17:20:47.996711] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-09T17:20:48.796761] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-09T17:20:49.027617] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T17:20:49.596773] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-09T17:20:50.251046] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T17:20:50.396676] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-09T17:20:50.595484] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T17:20:51.196800] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-09T17:20:51.861245] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:20:51.996707] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-09T17:20:52.113045] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T17:20:52.114856] [INFO ] [REMOTE ] ASG: Full fetch complete (30969 records). [2025-10-09T17:20:52.114933] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-09T17:20:52.484715] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-09T17:20:52.484801] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-09T17:20:52.485178] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-09T17:20:52.485218] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-09T17:20:52.485935] [DEBUG] [LOCAL ] ASG: Trimmed 30969 records to 19644 (keeping 200 days of data) [2025-10-09T17:20:52.596859] [DEBUG] [LOCAL ] ASG: Primary data saved (19644 records). [2025-10-09T17:20:52.597054] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-09T17:20:52.597141] [INFO ] [MAIN ] Update Progress: 158/2373 symbols completed. ASG took 25.3s. Estimated remaining: 4h 51m 50s. Rate: 7.6 symbols/min [2025-10-09T17:20:52.796787] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-09T17:20:53.242972] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T17:20:53.534128] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T17:20:53.596680] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-09T17:20:54.396727] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-09T17:20:54.742702] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T17:20:55.196736] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-09T17:20:55.768823] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T17:20:55.772061] [INFO ] [REMOTE ] ASC: Full fetch complete (56330 records). [2025-10-09T17:20:55.772166] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-09T17:20:56.148039] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-09T17:20:56.148150] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-09T17:20:56.149117] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-09T17:20:56.149231] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-09T17:20:56.150461] [DEBUG] [LOCAL ] ASC: Trimmed 56330 records to 37693 (keeping 200 days of data) [2025-10-09T17:20:56.393763] [DEBUG] [LOCAL ] ASC: Primary data saved (37693 records). [2025-10-09T17:20:56.394276] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-09T17:20:56.394969] [INFO ] [MAIN ] Update Progress: 159/2373 symbols completed. ASC took 30.5s. Estimated remaining: 4h 50m 45s. Rate: 7.6 symbols/min [2025-10-09T17:20:56.396637] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T17:20:56.402901] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-09T17:20:57.521083] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T17:20:57.526833] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-09T17:20:58.549994] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T17:20:58.552226] [INFO ] [REMOTE ] ASGI: Full fetch complete (33295 records). [2025-10-09T17:20:58.552317] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-09T17:20:58.918800] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-09T17:20:58.918945] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-09T17:20:58.919353] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-09T17:20:58.919395] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-09T17:20:58.920154] [DEBUG] [LOCAL ] ASGI: Trimmed 33295 records to 22863 (keeping 200 days of data) [2025-10-09T17:20:59.055470] [DEBUG] [LOCAL ] ASGI: Primary data saved (22863 records). [2025-10-09T17:20:59.055600] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-09T17:20:59.055698] [INFO ] [MAIN ] Update Progress: 160/2373 symbols completed. ASGI took 27.5s. Estimated remaining: 4h 49m 25s. Rate: 7.6 symbols/min [2025-10-09T17:20:59.739380] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:59.704976] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:59.782140] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:59.808865] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:20:59.864253] [DEBUG] [LOCAL ] ASH: Loaded 37603 existing records from primary storage. [2025-10-09T17:20:59.863579] [DEBUG] [LOCAL ] ASIX: Loaded 22842 existing records from primary storage. [2025-10-09T17:20:59.864960] [INFO ] [MAIN ] ASH: Loaded 37603 existing records. [2025-10-09T17:20:59.865166] [INFO ] [MAIN ] ASIX: Loaded 22842 existing records. [2025-10-09T17:20:59.968299] [DEBUG] [LOCAL ] ASGN: Loaded 36282 existing records from primary storage. [2025-10-09T17:21:00.025379] [INFO ] [MAIN ] ASGN: Loaded 36282 existing records. [2025-10-09T17:21:00.152982] [DEBUG] [LOCAL ] ASPN: Loaded 49736 existing records from primary storage. [2025-10-09T17:21:00.278311] [INFO ] [MAIN ] ASPN: Loaded 49736 existing records. [2025-10-09T17:21:00.427588] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:00.382547] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:00.481160] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-09T17:21:00.495838] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-09T17:21:00.501220] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-09T17:21:00.519364] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-09T17:21:00.519538] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-09T17:21:00.524850] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-09T17:21:00.590802] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:00.610499] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-09T17:21:00.572060] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-09T17:21:00.632966] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-09T17:21:00.618866] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-09T17:21:00.757040] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-09T17:21:00.858353] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:00.855028] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-09T17:21:00.926164] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-09T17:21:00.991620] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-09T17:21:01.229139] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-09T17:21:01.252596] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-09T17:21:01.529889] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:01.614957] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-09T17:21:01.781618] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:01.861431] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-09T17:21:02.188483] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:02.184923] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:02.188867] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-09T17:21:02.189883] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-09T17:21:02.908958] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T17:21:02.912404] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-09T17:21:03.161492] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T17:21:03.168452] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-09T17:21:03.592113] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T17:21:03.596082] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-09T17:21:03.698213] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:21:03.704424] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-09T17:21:04.136071] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T17:21:04.146447] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-09T17:21:04.211746] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T17:21:04.240559] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-09T17:21:04.796741] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-09T17:21:05.143244] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T17:21:05.527553] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T17:21:05.596686] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-09T17:21:05.872252] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T17:21:06.396704] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-09T17:21:06.789995] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:21:07.196809] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-09T17:21:07.996717] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-09T17:21:08.201601] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T17:21:08.642324] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T17:21:08.796694] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-09T17:21:09.324151] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T17:21:09.596845] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-09T17:21:10.071622] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T17:21:10.396719] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-09T17:21:11.196705] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-09T17:21:11.301499] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:21:11.540097] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T17:21:11.996746] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-09T17:21:12.309988] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T17:21:12.796771] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-09T17:21:13.454328] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T17:21:13.596682] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-09T17:21:14.068905] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T17:21:14.396748] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-09T17:21:15.196733] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-09T17:21:15.617190] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T17:21:15.984346] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T17:21:15.996684] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-09T17:21:16.716099] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T17:21:16.796687] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-09T17:21:17.385692] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T17:21:17.596714] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-09T17:21:18.396706] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-09T17:21:18.461474] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:21:19.045926] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:21:19.196707] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-09T17:21:19.258100] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-09T17:21:19.996741] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-09T17:21:20.731517] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T17:21:20.796682] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-09T17:21:21.189023] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T17:21:21.596726] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-09T17:21:22.178189] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T17:21:22.396725] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-09T17:21:23.116464] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T17:21:23.196697] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-09T17:21:23.248277] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T17:21:23.996785] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-09T17:21:24.796744] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-09T17:21:25.098344] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T17:21:25.374374] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T17:21:25.493877] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T17:21:25.596685] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-09T17:21:26.396790] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-09T17:21:26.868984] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T17:21:26.872537] [INFO ] [REMOTE ] ASH: Full fetch complete (55173 records). [2025-10-09T17:21:26.872684] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-09T17:21:27.201868] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-09T17:21:27.277220] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-09T17:21:27.277307] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-09T17:21:27.277962] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-09T17:21:27.278052] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-09T17:21:27.282225] [DEBUG] [LOCAL ] ASH: Trimmed 55173 records to 37885 (keeping 200 days of data) [2025-10-09T17:21:27.517013] [DEBUG] [LOCAL ] ASH: Primary data saved (37885 records). [2025-10-09T17:21:27.517170] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-09T17:21:27.518037] [INFO ] [MAIN ] Update Progress: 161/2373 symbols completed. ASH took 28.4s. Estimated remaining: 4h 54m 1s. Rate: 7.5 symbols/min [2025-10-09T17:21:27.688585] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:21:27.703248] [DEBUG] [LOCAL ] ASR: Loaded 9328 existing records from primary storage. [2025-10-09T17:21:27.703474] [INFO ] [MAIN ] ASR: Loaded 9328 existing records. [2025-10-09T17:21:27.890902] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:27.891133] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-09T17:21:27.891180] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-09T17:21:27.891554] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-09T17:21:27.891619] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-09T17:21:28.003339] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-09T17:21:28.428587] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:28.496426] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T17:21:28.726732] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T17:21:28.796781] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-09T17:21:28.946540] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T17:21:29.596748] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-09T17:21:30.098825] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T17:21:30.103154] [INFO ] [REMOTE ] ASPN: Full fetch complete (72426 records). [2025-10-09T17:21:30.103256] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-09T17:21:30.401849] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-09T17:21:30.503854] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-09T17:21:30.509394] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-09T17:21:30.510238] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-09T17:21:30.510329] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-09T17:21:30.511265] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T17:21:30.514772] [DEBUG] [LOCAL ] ASPN: Trimmed 72426 records to 50114 (keeping 200 days of data) [2025-10-09T17:21:30.791661] [DEBUG] [LOCAL ] ASPN: Primary data saved (50114 records). [2025-10-09T17:21:30.791805] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-09T17:21:30.791886] [INFO ] [MAIN ] Update Progress: 162/2373 symbols completed. ASPN took 31.7s. Estimated remaining: 4h 52m 48s. Rate: 7.6 symbols/min [2025-10-09T17:21:30.959850] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:21:31.012200] [DEBUG] [LOCAL ] ASX: Loaded 52863 existing records from primary storage. [2025-10-09T17:21:31.012577] [INFO ] [MAIN ] ASX: Loaded 52863 existing records. [2025-10-09T17:21:31.192858] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:31.193108] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-09T17:21:31.193162] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-09T17:21:31.193364] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-09T17:21:31.193421] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-09T17:21:31.204732] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-09T17:21:31.567745] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:31.710328] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T17:21:31.713151] [INFO ] [REMOTE ] ASIX: Full fetch complete (30479 records). [2025-10-09T17:21:31.713245] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-09T17:21:32.006959] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-09T17:21:32.234830] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-09T17:21:32.234945] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-09T17:21:32.235486] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-09T17:21:32.235570] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-09T17:21:32.236753] [DEBUG] [LOCAL ] ASIX: Trimmed 30479 records to 22989 (keeping 200 days of data) [2025-10-09T17:21:32.397575] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T17:21:32.443348] [DEBUG] [LOCAL ] ASIX: Primary data saved (22989 records). [2025-10-09T17:21:32.443495] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-09T17:21:32.443589] [INFO ] [MAIN ] Update Progress: 163/2373 symbols completed. ASIX took 33.4s. Estimated remaining: 4h 51m 15s. Rate: 7.6 symbols/min [2025-10-09T17:21:32.621740] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:21:32.658841] [DEBUG] [LOCAL ] ATEN: Loaded 38823 existing records from primary storage. [2025-10-09T17:21:32.659142] [INFO ] [MAIN ] ATEN: Loaded 38823 existing records. [2025-10-09T17:21:32.804701] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-09T17:21:32.835412] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:32.835628] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-09T17:21:32.835714] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-09T17:21:32.835927] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-09T17:21:32.835985] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-09T17:21:33.186927] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:33.596690] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-09T17:21:33.865838] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T17:21:34.396692] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-09T17:21:34.459361] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T17:21:35.144078] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:21:35.196732] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-09T17:21:35.933216] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T17:21:35.996686] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-09T17:21:36.098895] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T17:21:36.796849] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-09T17:21:37.177365] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T17:21:37.529193] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T17:21:37.596686] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-09T17:21:38.342310] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T17:21:38.396668] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-09T17:21:39.196706] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-09T17:21:39.326589] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T17:21:39.996716] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-09T17:21:40.785174] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T17:21:40.788916] [INFO ] [REMOTE ] ASGN: Full fetch complete (52680 records). [2025-10-09T17:21:40.789013] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-09T17:21:40.802238] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-09T17:21:41.168182] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-09T17:21:41.168267] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-09T17:21:41.168860] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-09T17:21:41.168925] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-09T17:21:41.170110] [DEBUG] [LOCAL ] ASGN: Trimmed 52680 records to 36566 (keeping 200 days of data) [2025-10-09T17:21:41.380390] [DEBUG] [LOCAL ] ASGN: Primary data saved (36566 records). [2025-10-09T17:21:41.380522] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-09T17:21:41.380603] [INFO ] [MAIN ] Update Progress: 164/2373 symbols completed. ASGN took 42.3s. Estimated remaining: 4h 51m 21s. Rate: 7.6 symbols/min [2025-10-09T17:21:41.552372] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:21:41.584039] [DEBUG] [LOCAL ] ATGE: Loaded 31120 existing records from primary storage. [2025-10-09T17:21:41.584393] [INFO ] [MAIN ] ATGE: Loaded 31120 existing records. [2025-10-09T17:21:41.608711] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-09T17:21:41.767935] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:41.768482] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-09T17:21:41.768552] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-09T17:21:41.768812] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-09T17:21:41.768875] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-09T17:21:41.909530] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T17:21:42.183090] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:42.376711] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:21:42.396695] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-09T17:21:42.562853] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T17:21:43.196720] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-09T17:21:43.946059] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T17:21:43.996678] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-09T17:21:44.611279] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:21:44.796741] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-09T17:21:45.563390] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T17:21:45.596718] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-09T17:21:46.396690] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-09T17:21:46.495674] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:21:47.054320] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T17:21:47.196700] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-09T17:21:47.213952] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T17:21:47.996717] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-09T17:21:48.796749] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-09T17:21:48.985934] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T17:21:49.335263] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T17:21:49.384123] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T17:21:49.596765] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-09T17:21:50.396716] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-09T17:21:50.966213] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T17:21:51.196779] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-09T17:21:51.804675] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T17:21:51.996742] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-09T17:21:52.479863] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T17:21:52.796778] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-09T17:21:53.596754] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-09T17:21:53.826798] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T17:21:53.871927] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T17:21:54.396741] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-09T17:21:54.673913] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:21:55.201871] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-09T17:21:55.205482] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T17:21:55.996732] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-09T17:21:56.796741] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-09T17:21:56.999845] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T17:21:57.001018] [INFO ] [REMOTE ] ASR: Full fetch complete (12385 records). [2025-10-09T17:21:57.001092] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-09T17:21:57.295527] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-09T17:21:57.411417] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-09T17:21:57.411494] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-09T17:21:57.411736] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-09T17:21:57.411798] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-09T17:21:57.412252] [DEBUG] [LOCAL ] ASR: Trimmed 12385 records to 9380 (keeping 200 days of data) [2025-10-09T17:21:57.477242] [DEBUG] [LOCAL ] ASR: Primary data saved (9380 records). [2025-10-09T17:21:57.477372] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-09T17:21:57.477452] [INFO ] [MAIN ] Update Progress: 165/2373 symbols completed. ASR took 30.0s. Estimated remaining: 4h 53m 3s. Rate: 7.5 symbols/min [2025-10-09T17:21:57.601816] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-09T17:21:57.649851] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:21:57.682013] [DEBUG] [LOCAL ] ATHM: Loaded 31820 existing records from primary storage. [2025-10-09T17:21:57.682295] [INFO ] [MAIN ] ATHM: Loaded 31820 existing records. [2025-10-09T17:21:57.856017] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:21:57.856224] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-09T17:21:57.856270] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-09T17:21:57.856464] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-09T17:21:57.856520] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-09T17:21:58.216586] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:21:58.238059] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:21:58.396752] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-09T17:21:59.196761] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-09T17:21:59.258687] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T17:21:59.872116] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T17:21:59.996693] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-09T17:22:00.796761] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-09T17:22:01.065801] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T17:22:01.183367] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T17:22:01.596931] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-09T17:22:01.918270] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T17:22:02.396721] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-09T17:22:03.103557] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:22:03.196731] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-09T17:22:03.640263] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T17:22:03.643862] [INFO ] [REMOTE ] ATEN: Full fetch complete (56913 records). [2025-10-09T17:22:03.644009] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-09T17:22:04.018558] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-09T17:22:04.039860] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-09T17:22:04.039956] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-09T17:22:04.040584] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-09T17:22:04.040775] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-09T17:22:04.041979] [DEBUG] [LOCAL ] ATEN: Trimmed 56913 records to 39032 (keeping 200 days of data) [2025-10-09T17:22:04.292278] [DEBUG] [LOCAL ] ATEN: Primary data saved (39032 records). [2025-10-09T17:22:04.292436] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-09T17:22:04.293021] [INFO ] [MAIN ] Update Progress: 166/2373 symbols completed. ATEN took 31.8s. Estimated remaining: 4h 52m 39s. Rate: 7.5 symbols/min [2025-10-09T17:22:04.494506] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T17:22:04.506350] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:04.520437] [DEBUG] [LOCAL ] ATHS: Loaded 6780 existing records from primary storage. [2025-10-09T17:22:04.520832] [INFO ] [MAIN ] ATHS: Loaded 6780 existing records. [2025-10-09T17:22:04.715134] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:04.715401] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-09T17:22:04.715482] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-09T17:22:04.715744] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-09T17:22:04.715815] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-09T17:22:04.801952] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-09T17:22:05.085817] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:05.596704] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-09T17:22:05.876253] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T17:22:05.959135] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T17:22:06.396717] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-09T17:22:06.829355] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:22:07.196743] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-09T17:22:07.996756] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-09T17:22:08.245966] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-09T17:22:08.611191] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T17:22:08.796798] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-09T17:22:08.971063] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T17:22:09.596797] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-09T17:22:09.692875] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T17:22:09.695342] [INFO ] [REMOTE ] ATGE: Full fetch complete (46097 records). [2025-10-09T17:22:09.695420] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-09T17:22:10.073548] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-09T17:22:10.073695] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-09T17:22:10.074707] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-09T17:22:10.074776] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-09T17:22:10.076067] [DEBUG] [LOCAL ] ATGE: Trimmed 46097 records to 31305 (keeping 200 days of data) [2025-10-09T17:22:10.271627] [DEBUG] [LOCAL ] ATGE: Primary data saved (31305 records). [2025-10-09T17:22:10.271826] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-09T17:22:10.273108] [INFO ] [MAIN ] Update Progress: 167/2373 symbols completed. ATGE took 28.9s. Estimated remaining: 4h 52m 5s. Rate: 7.6 symbols/min [2025-10-09T17:22:10.412205] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-09T17:22:10.445481] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:10.510133] [DEBUG] [LOCAL ] ATI: Loaded 51415 existing records from primary storage. [2025-10-09T17:22:10.510483] [INFO ] [MAIN ] ATI: Loaded 51415 existing records. [2025-10-09T17:22:10.699258] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:10.699557] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-09T17:22:10.699619] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-09T17:22:10.699904] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-09T17:22:10.699966] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-09T17:22:11.110688] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:11.196735] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-09T17:22:11.386087] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-09T17:22:11.392057] [INFO ] [REMOTE ] ASX: Full fetch complete (76586 records). [2025-10-09T17:22:11.392239] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-09T17:22:11.818884] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-09T17:22:11.818986] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-09T17:22:11.819898] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-09T17:22:11.828090] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-09T17:22:11.844276] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T17:22:11.853893] [DEBUG] [LOCAL ] ASX: Trimmed 76586 records to 53246 (keeping 200 days of data) [2025-10-09T17:22:12.043981] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-09T17:22:12.194775] [DEBUG] [LOCAL ] ASX: Primary data saved (53246 records). [2025-10-09T17:22:12.194946] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-09T17:22:12.195043] [INFO ] [MAIN ] Update Progress: 168/2373 symbols completed. ASX took 41.4s. Estimated remaining: 4h 50m 38s. Rate: 7.6 symbols/min [2025-10-09T17:22:12.361675] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:12.395219] [DEBUG] [LOCAL ] ATKR: Loaded 35380 existing records from primary storage. [2025-10-09T17:22:12.395490] [INFO ] [MAIN ] ATKR: Loaded 35380 existing records. [2025-10-09T17:22:12.572599] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:12.572827] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-09T17:22:12.572882] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-09T17:22:12.573101] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-09T17:22:12.573159] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-09T17:22:12.798583] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-09T17:22:12.937500] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:12.966384] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:22:13.574510] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T17:22:13.596490] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T17:22:13.603855] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-09T17:22:14.396762] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-09T17:22:15.196755] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-09T17:22:15.282186] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:22:15.784244] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T17:22:15.993574] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T17:22:16.001988] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-09T17:22:16.796749] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-09T17:22:17.596726] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-09T17:22:17.637161] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T17:22:18.192454] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:22:18.396773] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-09T17:22:19.084310] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T17:22:19.196727] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-09T17:22:19.319372] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:22:19.996737] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-09T17:22:20.796794] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-09T17:22:20.918627] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T17:22:21.599996] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-09T17:22:21.604956] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T17:22:22.135898] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T17:22:22.396677] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-09T17:22:23.125145] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:22:23.196720] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-09T17:22:23.367360] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T17:22:23.996732] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-09T17:22:24.730410] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:22:24.796696] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-09T17:22:25.596770] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-09T17:22:25.803381] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T17:22:26.273192] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T17:22:26.317140] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-09T17:22:26.396748] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-09T17:22:27.196734] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-09T17:22:27.875241] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T17:22:27.996691] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-09T17:22:28.028364] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T17:22:28.734263] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T17:22:28.796728] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-09T17:22:29.596774] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-09T17:22:29.956125] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:22:30.396738] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-09T17:22:30.984623] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T17:22:31.140885] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T17:22:31.196687] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-09T17:22:31.878002] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T17:22:31.996728] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-09T17:22:32.600118] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T17:22:32.796716] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-09T17:22:33.596696] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-09T17:22:33.845673] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:22:34.195514] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T17:22:34.196416] [INFO ] [REMOTE ] ATHS: Full fetch complete (9703 records). [2025-10-09T17:22:34.196484] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-09T17:22:34.401969] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-09T17:22:34.559501] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-09T17:22:34.559588] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-09T17:22:34.559818] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-09T17:22:34.559880] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-09T17:22:34.560294] [DEBUG] [LOCAL ] ATHS: Trimmed 9703 records to 6815 (keeping 200 days of data) [2025-10-09T17:22:34.606275] [DEBUG] [LOCAL ] ATHS: Primary data saved (6815 records). [2025-10-09T17:22:34.606434] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-09T17:22:34.606538] [INFO ] [MAIN ] Update Progress: 169/2373 symbols completed. ATHS took 30.3s. Estimated remaining: 4h 53m 40s. Rate: 7.5 symbols/min [2025-10-09T17:22:34.779196] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:34.824182] [DEBUG] [LOCAL ] ATMU: Loaded 39145 existing records from primary storage. [2025-10-09T17:22:34.824460] [INFO ] [MAIN ] ATMU: Loaded 39145 existing records. [2025-10-09T17:22:34.999867] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:35.000113] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-09T17:22:35.000171] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-09T17:22:35.000386] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-09T17:22:35.000443] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-09T17:22:35.202201] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-09T17:22:35.352605] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:35.996739] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-09T17:22:36.280275] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T17:22:36.631846] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T17:22:36.796733] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-09T17:22:37.505615] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:22:37.596701] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-09T17:22:38.396740] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-09T17:22:38.495220] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T17:22:38.782184] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T17:22:39.196721] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-09T17:22:39.489514] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T17:22:39.492142] [INFO ] [REMOTE ] ATHM: Full fetch complete (50507 records). [2025-10-09T17:22:39.492226] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-09T17:22:39.906544] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-09T17:22:39.906709] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-09T17:22:39.907352] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-09T17:22:39.907421] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-09T17:22:39.908925] [DEBUG] [LOCAL ] ATHM: Trimmed 50507 records to 32029 (keeping 200 days of data) [2025-10-09T17:22:40.009324] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-09T17:22:40.113076] [DEBUG] [LOCAL ] ATHM: Primary data saved (32029 records). [2025-10-09T17:22:40.113217] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-09T17:22:40.114142] [INFO ] [MAIN ] Update Progress: 170/2373 symbols completed. ATHM took 42.6s. Estimated remaining: 4h 52m 59s. Rate: 7.5 symbols/min [2025-10-09T17:22:40.287232] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:40.335119] [DEBUG] [LOCAL ] ATO: Loaded 41855 existing records from primary storage. [2025-10-09T17:22:40.335472] [INFO ] [MAIN ] ATO: Loaded 41855 existing records. [2025-10-09T17:22:40.516397] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:40.516590] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-09T17:22:40.516637] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-09T17:22:40.516889] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-09T17:22:40.516944] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-09T17:22:40.802359] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-09T17:22:40.888524] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:40.922037] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T17:22:41.444029] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T17:22:41.596731] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-09T17:22:42.214957] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T17:22:42.396717] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-09T17:22:42.668922] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T17:22:43.196767] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-09T17:22:43.926598] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T17:22:43.996665] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-09T17:22:44.675608] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T17:22:44.683824] [INFO ] [REMOTE ] ATI: Full fetch complete (73833 records). [2025-10-09T17:22:44.683952] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-09T17:22:44.801971] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-09T17:22:45.071518] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-09T17:22:45.071680] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-09T17:22:45.072480] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-09T17:22:45.072673] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-09T17:22:45.074234] [DEBUG] [LOCAL ] ATI: Trimmed 73833 records to 51732 (keeping 200 days of data) [2025-10-09T17:22:45.324942] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T17:22:45.415120] [DEBUG] [LOCAL ] ATI: Primary data saved (51732 records). [2025-10-09T17:22:45.415279] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-09T17:22:45.416164] [INFO ] [MAIN ] Update Progress: 171/2373 symbols completed. ATI took 35.1s. Estimated remaining: 4h 52m 17s. Rate: 7.5 symbols/min [2025-10-09T17:22:45.580319] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:45.601748] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-09T17:22:45.616442] [DEBUG] [LOCAL ] ATR: Loaded 30573 existing records from primary storage. [2025-10-09T17:22:45.616751] [INFO ] [MAIN ] ATR: Loaded 30573 existing records. [2025-10-09T17:22:45.789179] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:45.789389] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-09T17:22:45.789436] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-09T17:22:45.789683] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-09T17:22:45.789740] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-09T17:22:46.132162] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:46.396720] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-09T17:22:46.761289] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T17:22:47.029436] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:22:47.032493] [INFO ] [REMOTE ] ATKR: Full fetch complete (53472 records). [2025-10-09T17:22:47.032614] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-09T17:22:47.204847] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-09T17:22:47.427945] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-09T17:22:47.428083] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-09T17:22:47.428775] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-09T17:22:47.428855] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-09T17:22:47.445181] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T17:22:47.451351] [DEBUG] [LOCAL ] ATKR: Trimmed 53472 records to 35606 (keeping 200 days of data) [2025-10-09T17:22:47.672051] [DEBUG] [LOCAL ] ATKR: Primary data saved (35606 records). [2025-10-09T17:22:47.672187] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-09T17:22:47.672269] [INFO ] [MAIN ] Update Progress: 172/2373 symbols completed. ATKR took 35.5s. Estimated remaining: 4h 50m 56s. Rate: 7.6 symbols/min [2025-10-09T17:22:47.870570] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:22:47.888591] [DEBUG] [LOCAL ] ATS: Loaded 17730 existing records from primary storage. [2025-10-09T17:22:47.888913] [INFO ] [MAIN ] ATS: Loaded 17730 existing records. [2025-10-09T17:22:48.001860] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-09T17:22:48.078108] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:22:48.078314] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-09T17:22:48.078362] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-09T17:22:48.078541] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-09T17:22:48.078600] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-09T17:22:48.438053] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:22:48.801373] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-09T17:22:48.821272] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T17:22:48.887438] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T17:22:49.588409] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T17:22:49.596674] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-09T17:22:50.396779] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-09T17:22:50.597911] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T17:22:51.196816] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-09T17:22:51.811859] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T17:22:51.996749] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-09T17:22:52.796741] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-09T17:22:53.596723] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-09T17:23:05.089025] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (12.29 seconds). [2025-10-09T17:23:05.093074] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-09T17:23:05.237440] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (13.24 seconds). [2025-10-09T17:23:05.246183] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-09T17:23:05.297326] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (14.10 seconds). [2025-10-09T17:23:05.305593] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-09T17:23:05.581114] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (11.98 seconds). [2025-10-09T17:23:05.587891] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-09T17:23:05.814079] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T17:23:05.818521] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-09T17:23:06.475352] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:23:06.483119] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-09T17:23:06.912558] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T17:23:06.919731] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-09T17:23:07.210855] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:23:07.216398] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-09T17:23:07.313918] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-09T17:23:07.322679] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-09T17:23:07.396474] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T17:23:07.404961] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-09T17:23:08.227713] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T17:23:08.273217] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T17:23:08.278300] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-09T17:23:08.279532] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-09T17:23:08.362055] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T17:23:08.371561] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-09T17:23:09.091494] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:23:09.101562] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-09T17:23:09.202102] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T17:23:09.205874] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-09T17:23:09.519736] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T17:23:09.526714] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-09T17:23:10.020466] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T17:23:10.030533] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-09T17:23:10.189332] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T17:23:10.194618] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-09T17:23:10.295487] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T17:23:10.305863] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-09T17:23:10.518374] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:23:10.525332] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-09T17:23:11.204932] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:23:11.209270] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-09T17:23:11.445539] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T17:23:11.458197] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-09T17:23:11.477452] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T17:23:11.493002] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T17:23:11.496921] [INFO ] [REMOTE ] ATMU: Full fetch complete (56639 records). [2025-10-09T17:23:11.497071] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-09T17:23:11.901412] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-09T17:23:11.901527] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-09T17:23:11.902196] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-09T17:23:11.902264] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-09T17:23:11.903593] [DEBUG] [LOCAL ] ATMU: Trimmed 56639 records to 39408 (keeping 200 days of data) [2025-10-09T17:23:11.996973] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-09T17:23:12.135633] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T17:23:12.166797] [DEBUG] [LOCAL ] ATMU: Primary data saved (39408 records). [2025-10-09T17:23:12.166951] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-09T17:23:12.167609] [INFO ] [MAIN ] Update Progress: 173/2373 symbols completed. ATMU took 37.6s. Estimated remaining: 4h 54m 19s. Rate: 7.5 symbols/min [2025-10-09T17:23:12.343779] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:12.389203] [DEBUG] [LOCAL ] ATUS: Loaded 49482 existing records from primary storage. [2025-10-09T17:23:12.389503] [INFO ] [MAIN ] ATUS: Loaded 49482 existing records. [2025-10-09T17:23:12.566866] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:12.567080] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-09T17:23:12.567128] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-09T17:23:12.567355] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-09T17:23:12.567412] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-09T17:23:12.811396] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-09T17:23:12.933848] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:13.063313] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T17:23:13.355247] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T17:23:13.596743] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-09T17:23:13.740070] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T17:23:13.742339] [INFO ] [REMOTE ] ATS: Full fetch complete (25626 records). [2025-10-09T17:23:13.742465] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-09T17:23:14.114021] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-09T17:23:14.114158] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-09T17:23:14.114511] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-09T17:23:14.114556] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-09T17:23:14.115271] [DEBUG] [LOCAL ] ATS: Trimmed 25626 records to 17815 (keeping 200 days of data) [2025-10-09T17:23:14.216904] [DEBUG] [LOCAL ] ATS: Primary data saved (17815 records). [2025-10-09T17:23:14.217043] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-09T17:23:14.217128] [INFO ] [MAIN ] Update Progress: 174/2373 symbols completed. ATS took 26.5s. Estimated remaining: 4h 52m 55s. Rate: 7.5 symbols/min [2025-10-09T17:23:14.399215] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:14.397666] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-09T17:23:14.447574] [DEBUG] [LOCAL ] AU: Loaded 52990 existing records from primary storage. [2025-10-09T17:23:14.447926] [INFO ] [MAIN ] AU: Loaded 52990 existing records. [2025-10-09T17:23:14.623491] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:14.623814] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-09T17:23:14.623914] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-09T17:23:14.624380] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-09T17:23:14.624438] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-09T17:23:14.980772] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:15.196699] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-09T17:23:15.371503] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:23:15.960525] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T17:23:15.996672] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-09T17:23:16.796695] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-09T17:23:16.880701] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:23:17.217360] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T17:23:17.219959] [INFO ] [REMOTE ] ATR: Full fetch complete (43491 records). [2025-10-09T17:23:17.220040] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-09T17:23:17.220585] [FATAL] [VALIDATOR ] ATR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:23:17.220697] [FATAL] [MAIN ] ATR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:23:17.220766] [WARN ] [MAIN ] ATR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:23:17.220840] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-09T17:23:17.220903] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-10-09T17:23:17.220939] [INFO ] [LOCAL ] ATR: Starting deletion of derivative data. [2025-10-09T17:23:17.221202] [DEBUG] [LOCAL ] ATR: Deleted derivative data file. [2025-10-09T17:23:17.221865] [INFO ] [MAIN ] Update Progress: 175/2373 symbols completed. ATR took 31.8s. Estimated remaining: 4h 51m 44s. Rate: 7.5 symbols/min [2025-10-09T17:23:17.392362] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:17.444571] [DEBUG] [LOCAL ] AUB: Loaded 46185 existing records from primary storage. [2025-10-09T17:23:17.444889] [INFO ] [MAIN ] AUB: Loaded 46185 existing records. [2025-10-09T17:23:17.602072] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-09T17:23:17.626318] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:17.626551] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-09T17:23:17.626807] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-09T17:23:17.627597] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-09T17:23:17.627694] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-09T17:23:17.997250] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:18.237061] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:23:18.396754] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-09T17:23:19.196741] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-09T17:23:19.282546] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:23:19.996717] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-09T17:23:20.066370] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:23:20.796698] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-09T17:23:20.849736] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T17:23:21.596695] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-09T17:23:21.773336] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T17:23:22.396707] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-09T17:23:22.629538] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T17:23:22.705228] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T17:23:23.196717] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-09T17:23:23.995276] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T17:23:24.003351] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-09T17:23:24.391748] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T17:23:24.796864] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-09T17:23:25.596709] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-09T17:23:25.918303] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T17:23:26.396889] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-09T17:23:26.464971] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T17:23:26.688936] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T17:23:27.196763] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-09T17:23:27.867823] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:23:27.871375] [INFO ] [REMOTE ] ATO: Full fetch complete (60416 records). [2025-10-09T17:23:27.871490] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-09T17:23:28.001829] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-09T17:23:28.269234] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-09T17:23:28.269322] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-09T17:23:28.270005] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-09T17:23:28.270071] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-09T17:23:28.272895] [DEBUG] [LOCAL ] ATO: Trimmed 60416 records to 42098 (keeping 200 days of data) [2025-10-09T17:23:28.546908] [DEBUG] [LOCAL ] ATO: Primary data saved (42098 records). [2025-10-09T17:23:28.547034] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-09T17:23:28.547697] [INFO ] [MAIN ] Update Progress: 176/2373 symbols completed. ATO took 48.4s. Estimated remaining: 4h 52m 18s. Rate: 7.5 symbols/min [2025-10-09T17:23:28.730135] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:28.741303] [DEBUG] [LOCAL ] AUNA: Loaded 5056 existing records from primary storage. [2025-10-09T17:23:28.741564] [INFO ] [MAIN ] AUNA: Loaded 5056 existing records. [2025-10-09T17:23:28.807081] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-09T17:23:29.001394] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:29.001898] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-09T17:23:29.001986] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-09T17:23:29.002521] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-09T17:23:29.002597] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-09T17:23:29.450046] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T17:23:29.628298] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-09T17:23:29.660341] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:29.664681] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T17:23:30.396759] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-09T17:23:30.462445] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:23:31.196738] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-09T17:23:31.634632] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T17:23:31.996751] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-09T17:23:32.050711] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T17:23:32.454079] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-09T17:23:32.641579] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:23:32.796733] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-09T17:23:33.596719] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-09T17:23:34.272151] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T17:23:34.396697] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-09T17:23:34.821583] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-09T17:23:34.845828] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T17:23:35.196725] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-09T17:23:35.996717] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-09T17:23:36.796701] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-09T17:23:37.007143] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T17:23:37.596690] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-09T17:23:38.020060] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T17:23:38.213450] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-09T17:23:38.396682] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-09T17:23:38.505941] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:23:38.866848] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-09T17:23:39.196751] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-09T17:23:39.588497] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T17:23:39.996759] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-09T17:23:40.796732] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-09T17:23:41.465685] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T17:23:41.596760] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-09T17:23:42.198129] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T17:23:42.396774] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-09T17:23:42.472212] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T17:23:43.196759] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-09T17:23:43.888740] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T17:23:43.996767] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-09T17:23:44.693961] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:23:44.796770] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-09T17:23:45.596755] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-09T17:23:45.850287] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T17:23:46.396742] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-09T17:23:46.428766] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T17:23:46.434054] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T17:23:46.438602] [INFO ] [REMOTE ] ATUS: Full fetch complete (71064 records). [2025-10-09T17:23:46.438761] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-09T17:23:46.820201] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-09T17:23:46.820288] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-09T17:23:46.820998] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-09T17:23:46.821063] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-09T17:23:46.822477] [DEBUG] [LOCAL ] ATUS: Trimmed 71064 records to 49851 (keeping 200 days of data) [2025-10-09T17:23:47.135784] [DEBUG] [LOCAL ] ATUS: Primary data saved (49851 records). [2025-10-09T17:23:47.135944] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-09T17:23:47.137027] [INFO ] [MAIN ] Update Progress: 177/2373 symbols completed. ATUS took 35.0s. Estimated remaining: 4h 54m 22s. Rate: 7.5 symbols/min [2025-10-09T17:23:47.201872] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-09T17:23:47.322736] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:47.367375] [DEBUG] [LOCAL ] AVA: Loaded 39116 existing records from primary storage. [2025-10-09T17:23:47.367695] [INFO ] [MAIN ] AVA: Loaded 39116 existing records. [2025-10-09T17:23:47.545234] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:47.545467] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-09T17:23:47.545515] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-09T17:23:47.545752] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-09T17:23:47.545811] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-09T17:23:47.937704] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:47.996756] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-09T17:23:48.078053] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T17:23:48.796705] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-09T17:23:49.058452] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T17:23:49.379115] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T17:23:49.458471] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T17:23:49.596758] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-09T17:23:50.396726] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-09T17:23:50.988716] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T17:23:51.196757] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-09T17:23:51.908243] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T17:23:51.986910] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T17:23:51.996681] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-09T17:23:52.796749] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-09T17:23:53.596735] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-09T17:23:53.934192] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-09T17:23:53.939577] [INFO ] [REMOTE ] AU: Full fetch complete (76306 records). [2025-10-09T17:23:53.939786] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-09T17:23:54.305161] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T17:23:54.402085] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-09T17:23:54.401774] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-09T17:23:54.402223] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-09T17:23:54.403385] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-09T17:23:54.404344] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-09T17:23:54.406395] [DEBUG] [LOCAL ] AU: Trimmed 76306 records to 53379 (keeping 200 days of data) [2025-10-09T17:23:54.739764] [DEBUG] [LOCAL ] AU: Primary data saved (53379 records). [2025-10-09T17:23:54.739899] [INFO ] [MAIN ] AU: Full history saved. [2025-10-09T17:23:54.739979] [INFO ] [MAIN ] Update Progress: 178/2373 symbols completed. AU took 40.5s. Estimated remaining: 4h 54m 9s. Rate: 7.5 symbols/min [2025-10-09T17:23:54.921824] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:54.932387] [DEBUG] [LOCAL ] AVAL: Loaded 8653 existing records from primary storage. [2025-10-09T17:23:54.932611] [INFO ] [MAIN ] AVAL: Loaded 8653 existing records. [2025-10-09T17:23:55.120072] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:55.123725] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-09T17:23:55.123820] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-09T17:23:55.124257] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-09T17:23:55.123963] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:23:55.124610] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-09T17:23:55.148171] [INFO ] [REMOTE ] AUNA: Full fetch complete (7793 records). [2025-10-09T17:23:55.211303] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-09T17:23:55.201728] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-09T17:23:55.252995] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T17:23:55.864068] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:55.927502] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-09T17:23:55.927577] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-09T17:23:55.927839] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-09T17:23:55.927899] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-09T17:23:55.928510] [DEBUG] [LOCAL ] AUNA: Trimmed 7793 records to 5085 (keeping 200 days of data) [2025-10-09T17:23:55.958033] [DEBUG] [LOCAL ] AUNA: Primary data saved (5085 records). [2025-10-09T17:23:55.958141] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-09T17:23:55.958219] [INFO ] [MAIN ] Update Progress: 179/2373 symbols completed. AUNA took 27.4s. Estimated remaining: 4h 52m 37s. Rate: 7.5 symbols/min [2025-10-09T17:23:56.001858] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-09T17:23:56.129281] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:56.173315] [DEBUG] [LOCAL ] AVB: Loaded 42092 existing records from primary storage. [2025-10-09T17:23:56.173598] [INFO ] [MAIN ] AVB: Loaded 42092 existing records. [2025-10-09T17:23:56.349021] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:23:56.349253] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-09T17:23:56.349346] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-09T17:23:56.349566] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-09T17:23:56.349623] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-09T17:23:56.733161] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:56.796733] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-09T17:23:56.880449] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T17:23:57.511989] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T17:23:57.516512] [INFO ] [REMOTE ] AUB: Full fetch complete (65776 records). [2025-10-09T17:23:57.516725] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-09T17:23:57.605464] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-09T17:23:57.906191] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-09T17:23:57.906396] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-09T17:23:57.907162] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-09T17:23:57.907242] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-09T17:23:57.915854] [DEBUG] [LOCAL ] AUB: Trimmed 65776 records to 46506 (keeping 200 days of data) [2025-10-09T17:23:57.929636] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T17:23:58.240900] [DEBUG] [LOCAL ] AUB: Primary data saved (46506 records). [2025-10-09T17:23:58.241080] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-09T17:23:58.242075] [INFO ] [MAIN ] Update Progress: 180/2373 symbols completed. AUB took 41.0s. Estimated remaining: 4h 51m 19s. Rate: 7.5 symbols/min [2025-10-09T17:23:58.420102] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:23:58.416462] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-09T17:23:58.420354] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-09T17:23:58.421518] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-09T17:23:58.421684] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-09T17:23:58.421739] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-09T17:23:58.421784] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-09T17:23:58.421817] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-09T17:23:58.823617] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:23:59.158936] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T17:23:59.196696] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-09T17:23:59.603988] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T17:23:59.996718] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-09T17:24:00.796726] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-09T17:24:00.920897] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:24:01.009069] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:24:01.009387] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-09T17:24:01.009489] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:24:01.009580] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-09T17:24:01.009761] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:24:01.009853] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-09T17:24:01.009935] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-09T17:24:01.010020] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-09T17:24:01.010121] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-09T17:24:01.010232] [INFO ] [MAIN ] Update Progress: 181/2373 symbols completed. AVBC took 2.8s. Estimated remaining: 4h 50m 8s. Rate: 7.6 symbols/min [2025-10-09T17:24:01.192052] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:01.219550] [DEBUG] [LOCAL ] AVD: Loaded 22246 existing records from primary storage. [2025-10-09T17:24:01.219837] [INFO ] [MAIN ] AVD: Loaded 22246 existing records. [2025-10-09T17:24:01.402017] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:01.402298] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-09T17:24:01.402462] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-09T17:24:01.402772] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-09T17:24:01.402832] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-09T17:24:01.601790] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-09T17:24:01.730412] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:24:01.805988] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:02.396736] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-09T17:24:02.490355] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T17:24:03.196740] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-09T17:24:03.877535] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:24:03.996711] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-09T17:24:04.080994] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T17:24:04.796754] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-09T17:24:05.346751] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T17:24:05.596719] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-09T17:24:06.345591] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T17:24:06.396741] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-09T17:24:07.134692] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T17:24:07.196708] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-09T17:24:07.905179] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:24:07.996716] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-09T17:24:08.660301] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:24:08.796716] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-09T17:24:09.291487] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T17:24:09.596724] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-09T17:24:10.279191] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T17:24:10.329023] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T17:24:10.396696] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-09T17:24:11.196741] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-09T17:24:11.823239] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:24:11.826516] [INFO ] [REMOTE ] AVA: Full fetch complete (55559 records). [2025-10-09T17:24:11.826615] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-09T17:24:12.010790] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-09T17:24:12.243197] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-09T17:24:12.243330] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-09T17:24:12.244136] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-09T17:24:12.244205] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-09T17:24:12.245884] [DEBUG] [LOCAL ] AVA: Trimmed 55559 records to 39336 (keeping 200 days of data) [2025-10-09T17:24:12.497159] [DEBUG] [LOCAL ] AVA: Primary data saved (39336 records). [2025-10-09T17:24:12.497326] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-09T17:24:12.497415] [INFO ] [MAIN ] Update Progress: 182/2373 symbols completed. AVA took 25.4s. Estimated remaining: 4h 50m 43s. Rate: 7.5 symbols/min [2025-10-09T17:24:12.676157] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:12.713579] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:24:12.735748] [DEBUG] [LOCAL ] AVK: Loaded 18294 existing records from primary storage. [2025-10-09T17:24:12.736016] [INFO ] [MAIN ] AVK: Loaded 18294 existing records. [2025-10-09T17:24:12.801995] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-09T17:24:12.911547] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:12.911794] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-09T17:24:12.911845] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-09T17:24:12.912947] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-09T17:24:12.912996] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-09T17:24:13.161205] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T17:24:13.305884] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:13.596685] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-09T17:24:13.900300] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T17:24:14.396684] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-09T17:24:14.759136] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T17:24:15.196764] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-09T17:24:15.304925] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T17:24:15.996696] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-09T17:24:16.233350] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T17:24:16.796741] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-09T17:24:16.871927] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-09T17:24:17.596749] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-09T17:24:18.364841] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:24:18.396670] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-09T17:24:18.540876] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T17:24:19.196915] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-09T17:24:19.902565] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T17:24:19.996729] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-09T17:24:20.042478] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T17:24:20.686159] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T17:24:20.796721] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-09T17:24:21.245697] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T17:24:21.596764] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-09T17:24:22.396731] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-09T17:24:23.154473] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T17:24:23.196723] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-09T17:24:23.428635] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T17:24:23.996734] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-09T17:24:24.541184] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T17:24:24.546204] [INFO ] [REMOTE ] AVB: Full fetch complete (58498 records). [2025-10-09T17:24:24.546351] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-09T17:24:24.547226] [FATAL] [VALIDATOR ] AVB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:24:24.547344] [FATAL] [MAIN ] AVB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:24:24.547417] [WARN ] [MAIN ] AVB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:24:24.547495] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-09T17:24:24.547564] [DEBUG] [LOCAL ] AVB: No primary data file found to delete. [2025-10-09T17:24:24.547610] [INFO ] [LOCAL ] AVB: Starting deletion of derivative data. [2025-10-09T17:24:24.547912] [DEBUG] [LOCAL ] AVB: Deleted derivative data file. [2025-10-09T17:24:24.548418] [INFO ] [MAIN ] Update Progress: 183/2373 symbols completed. AVB took 28.6s. Estimated remaining: 4h 51m 24s. Rate: 7.5 symbols/min [2025-10-09T17:24:24.738373] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:24.776822] [DEBUG] [LOCAL ] AVNS: Loaded 33577 existing records from primary storage. [2025-10-09T17:24:24.777094] [INFO ] [MAIN ] AVNS: Loaded 33577 existing records. [2025-10-09T17:24:24.807108] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-09T17:24:24.958001] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:24.958241] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-09T17:24:24.958318] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-09T17:24:24.958670] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-09T17:24:24.958732] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-09T17:24:25.275157] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T17:24:25.337423] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:25.596737] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-09T17:24:26.044278] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T17:24:26.396698] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-09T17:24:26.578605] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T17:24:27.196760] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-09T17:24:27.310108] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T17:24:27.996694] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-09T17:24:28.204219] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T17:24:28.796749] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-09T17:24:28.899544] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T17:24:29.523764] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T17:24:29.596674] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-09T17:24:30.353428] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T17:24:30.396721] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-09T17:24:31.204438] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-09T17:24:31.208894] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T17:24:31.892423] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:24:31.893727] [INFO ] [REMOTE ] AVAL: Full fetch complete (14695 records). [2025-10-09T17:24:31.893798] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-09T17:24:32.001790] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-09T17:24:32.257044] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-09T17:24:32.257129] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-09T17:24:32.257388] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-09T17:24:32.257427] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-09T17:24:32.257925] [DEBUG] [LOCAL ] AVAL: Trimmed 14695 records to 8696 (keeping 200 days of data) [2025-10-09T17:24:32.310273] [DEBUG] [LOCAL ] AVAL: Primary data saved (8696 records). [2025-10-09T17:24:32.310406] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-09T17:24:32.310505] [INFO ] [MAIN ] Update Progress: 184/2373 symbols completed. AVAL took 37.6s. Estimated remaining: 4h 51m 13s. Rate: 7.5 symbols/min [2025-10-09T17:24:32.481670] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:32.520308] [DEBUG] [LOCAL ] AVNT: Loaded 39051 existing records from primary storage. [2025-10-09T17:24:32.520613] [INFO ] [MAIN ] AVNT: Loaded 39051 existing records. [2025-10-09T17:24:32.726846] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:32.727129] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-09T17:24:32.727187] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-09T17:24:32.727556] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-09T17:24:32.727624] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-09T17:24:32.805763] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-09T17:24:33.102859] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:33.423180] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T17:24:33.596679] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-09T17:24:33.960786] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T17:24:34.396702] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-09T17:24:35.026348] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T17:24:35.196704] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-09T17:24:35.475560] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T17:24:35.996725] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-09T17:24:36.637459] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T17:24:36.796715] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-09T17:24:37.102390] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T17:24:37.596770] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-09T17:24:38.081238] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T17:24:38.396679] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-09T17:24:38.699348] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T17:24:39.196702] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-09T17:24:39.245570] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T17:24:39.996788] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-09T17:24:40.640855] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T17:24:40.796745] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-09T17:24:41.384916] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:24:41.489761] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:24:41.492049] [INFO ] [REMOTE ] AVK: Full fetch complete (26692 records). [2025-10-09T17:24:41.492124] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-09T17:24:41.601858] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-09T17:24:41.863076] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-09T17:24:41.863206] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-09T17:24:41.863692] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-09T17:24:41.863783] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-09T17:24:41.864777] [DEBUG] [LOCAL ] AVK: Trimmed 26692 records to 18448 (keeping 200 days of data) [2025-10-09T17:24:41.979787] [DEBUG] [LOCAL ] AVK: Primary data saved (18448 records). [2025-10-09T17:24:41.979936] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-09T17:24:41.980040] [INFO ] [MAIN ] Update Progress: 185/2373 symbols completed. AVK took 29.5s. Estimated remaining: 4h 51m 25s. Rate: 7.5 symbols/min [2025-10-09T17:24:42.145368] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:42.195183] [DEBUG] [LOCAL ] AVTR: Loaded 53563 existing records from primary storage. [2025-10-09T17:24:42.195509] [INFO ] [MAIN ] AVTR: Loaded 53563 existing records. [2025-10-09T17:24:42.370466] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:42.370675] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-09T17:24:42.370748] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-09T17:24:42.371011] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-09T17:24:42.371071] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-09T17:24:42.401813] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-09T17:24:42.737952] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:42.911364] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T17:24:43.196693] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-09T17:24:43.593439] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T17:24:43.996685] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-09T17:24:44.491358] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T17:24:44.796688] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-09T17:24:45.035912] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T17:24:45.596719] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-09T17:24:45.887590] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T17:24:46.396713] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-09T17:24:46.998675] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T17:24:47.196687] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-09T17:24:47.906602] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T17:24:47.996711] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-09T17:24:48.439499] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T17:24:48.796731] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-09T17:24:49.423561] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T17:24:49.596714] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-09T17:24:50.182635] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T17:24:50.396727] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-09T17:24:51.204331] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-09T17:24:51.209146] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T17:24:51.862388] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:24:51.996725] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-09T17:24:52.538504] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T17:24:52.796726] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-09T17:24:53.596711] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-09T17:24:53.703082] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T17:24:54.030265] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T17:24:54.033418] [INFO ] [REMOTE ] AVNS: Full fetch complete (48312 records). [2025-10-09T17:24:54.033550] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-09T17:24:54.422973] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-09T17:24:54.444399] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-09T17:24:54.444502] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-09T17:24:54.445091] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-09T17:24:54.445240] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-09T17:24:54.446299] [DEBUG] [LOCAL ] AVNS: Trimmed 48312 records to 33765 (keeping 200 days of data) [2025-10-09T17:24:54.651090] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T17:24:54.654820] [INFO ] [REMOTE ] AVD: Full fetch complete (33138 records). [2025-10-09T17:24:54.655446] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-09T17:24:54.657251] [DEBUG] [LOCAL ] AVNS: Primary data saved (33765 records). [2025-10-09T17:24:54.701880] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-09T17:24:54.702929] [INFO ] [MAIN ] Update Progress: 186/2373 symbols completed. AVNS took 30.2s. Estimated remaining: 4h 52m 13s. Rate: 7.5 symbols/min [2025-10-09T17:24:55.075990] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:55.102060] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-10-09T17:24:55.107788] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-10-09T17:24:55.133727] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-09T17:24:55.133810] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-09T17:24:55.133944] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-09T17:24:55.144717] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-09T17:24:55.214263] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-09T17:24:55.323772] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-09T17:24:55.335211] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-09T17:24:55.340817] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-09T17:24:55.346039] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-09T17:24:55.411441] [DEBUG] [LOCAL ] AVD: Trimmed 33138 records to 22339 (keeping 200 days of data) [2025-10-09T17:24:55.673558] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:55.737214] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T17:24:55.747320] [DEBUG] [LOCAL ] AVD: Primary data saved (22339 records). [2025-10-09T17:24:55.747494] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-09T17:24:55.747591] [INFO ] [MAIN ] Update Progress: 187/2373 symbols completed. AVD took 54.7s. Estimated remaining: 4h 50m 44s. Rate: 7.5 symbols/min [2025-10-09T17:24:55.917903] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:24:55.942562] [DEBUG] [LOCAL ] AWF: Loaded 24261 existing records from primary storage. [2025-10-09T17:24:55.942861] [INFO ] [MAIN ] AWF: Loaded 24261 existing records. [2025-10-09T17:24:56.005807] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-09T17:24:56.126015] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:24:56.126258] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-09T17:24:56.126308] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-09T17:24:56.126566] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-09T17:24:56.126624] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-09T17:24:56.481474] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:24:56.629327] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T17:24:56.796695] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-09T17:24:57.596719] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-09T17:24:57.673347] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T17:24:58.396677] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-09T17:24:58.490685] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T17:24:58.670961] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T17:24:59.196711] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-09T17:24:59.759229] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T17:24:59.996731] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-09T17:25:00.796744] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-09T17:25:00.996316] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T17:25:01.596733] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-09T17:25:01.736286] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T17:25:02.396686] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-09T17:25:02.493013] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T17:25:03.196693] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-09T17:25:03.377912] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T17:25:03.554310] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T17:25:03.996722] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-09T17:25:04.363676] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T17:25:04.796689] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-09T17:25:05.135825] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T17:25:05.596713] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-09T17:25:06.295591] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T17:25:06.396760] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-09T17:25:06.606063] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T17:25:06.609016] [INFO ] [REMOTE ] AVNT: Full fetch complete (56053 records). [2025-10-09T17:25:06.609113] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-09T17:25:06.609795] [FATAL] [VALIDATOR ] AVNT: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:25:06.609896] [FATAL] [MAIN ] AVNT: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:25:06.609970] [WARN ] [MAIN ] AVNT: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:25:06.610060] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-09T17:25:06.610136] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-10-09T17:25:06.610173] [INFO ] [LOCAL ] AVNT: Starting deletion of derivative data. [2025-10-09T17:25:06.610404] [DEBUG] [LOCAL ] AVNT: Deleted derivative data file. [2025-10-09T17:25:06.610495] [INFO ] [MAIN ] Update Progress: 188/2373 symbols completed. AVNT took 34.3s. Estimated remaining: 4h 51m 9s. Rate: 7.5 symbols/min [2025-10-09T17:25:06.816518] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:06.849679] [DEBUG] [LOCAL ] AWI: Loaded 25305 existing records from primary storage. [2025-10-09T17:25:06.850073] [INFO ] [MAIN ] AWI: Loaded 25305 existing records. [2025-10-09T17:25:07.049910] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:07.050179] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-09T17:25:07.050234] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-09T17:25:07.050491] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-09T17:25:07.050571] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-09T17:25:07.210938] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-09T17:25:07.429430] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:07.760498] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T17:25:07.996733] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-09T17:25:08.379326] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T17:25:08.796737] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-09T17:25:09.596765] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-09T17:25:09.729543] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T17:25:09.876012] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T17:25:10.396720] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-09T17:25:11.196765] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-09T17:25:11.345216] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T17:25:11.423974] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T17:25:11.996737] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-09T17:25:12.483797] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T17:25:12.796733] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-09T17:25:13.347755] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T17:25:13.596780] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-09T17:25:13.768570] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T17:25:14.396767] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-09T17:25:15.088605] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T17:25:15.196677] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-09T17:25:15.544900] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T17:25:15.996726] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-09T17:25:16.442608] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T17:25:16.796735] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-09T17:25:17.184729] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T17:25:17.596779] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-09T17:25:18.364199] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T17:25:18.396679] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-09T17:25:18.527184] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T17:25:19.196693] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-09T17:25:19.498947] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T17:25:19.996719] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-09T17:25:20.688434] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T17:25:20.796690] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-09T17:25:21.596686] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-09T17:25:21.755584] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T17:25:21.760225] [INFO ] [REMOTE ] AVTR: Full fetch complete (77442 records). [2025-10-09T17:25:21.760354] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-09T17:25:22.161843] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-09T17:25:22.161960] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-09T17:25:22.162843] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-09T17:25:22.162996] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-09T17:25:22.183061] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:25:22.183212] [DEBUG] [LOCAL ] AVTR: Trimmed 77442 records to 53951 (keeping 200 days of data) [2025-10-09T17:25:22.397886] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-09T17:25:22.520925] [DEBUG] [LOCAL ] AVTR: Primary data saved (53951 records). [2025-10-09T17:25:22.521067] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-09T17:25:22.521907] [INFO ] [MAIN ] Update Progress: 189/2373 symbols completed. AVTR took 40.5s. Estimated remaining: 4h 52m 33s. Rate: 7.5 symbols/min [2025-10-09T17:25:22.698126] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:22.747014] [DEBUG] [LOCAL ] AWK: Loaded 48684 existing records from primary storage. [2025-10-09T17:25:22.747367] [INFO ] [MAIN ] AWK: Loaded 48684 existing records. [2025-10-09T17:25:22.933338] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:22.933730] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-09T17:25:22.933794] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-09T17:25:22.934040] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-09T17:25:22.934166] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-09T17:25:23.062493] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-09T17:25:23.207129] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-09T17:25:23.339070] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:23.526718] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T17:25:23.996715] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-09T17:25:24.796688] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-09T17:25:24.833250] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T17:25:25.596686] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-09T17:25:25.672204] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:25:25.732468] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T17:25:26.396721] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-09T17:25:27.062341] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:25:27.066231] [INFO ] [REMOTE ] AVY: Full fetch complete (56347 records). [2025-10-09T17:25:27.066328] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-09T17:25:27.212244] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-09T17:25:27.499339] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-09T17:25:27.499454] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-09T17:25:27.500066] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-09T17:25:27.500128] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-09T17:25:27.501204] [DEBUG] [LOCAL ] AVY: Trimmed 56347 records to 37848 (keeping 200 days of data) [2025-10-09T17:25:27.729264] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:25:27.766857] [DEBUG] [LOCAL ] AVY: Primary data saved (37848 records). [2025-10-09T17:25:27.766988] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-09T17:25:27.767059] [INFO ] [MAIN ] Update Progress: 190/2373 symbols completed. AVY took 33.0s. Estimated remaining: 4h 51m 52s. Rate: 7.5 symbols/min [2025-10-09T17:25:27.938945] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:27.959053] [DEBUG] [LOCAL ] AWP: Loaded 21500 existing records from primary storage. [2025-10-09T17:25:27.959334] [INFO ] [MAIN ] AWP: Loaded 21500 existing records. [2025-10-09T17:25:28.001888] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-09T17:25:28.137631] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:28.137901] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-09T17:25:28.137956] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-09T17:25:28.138162] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-09T17:25:28.138219] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-09T17:25:28.495025] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:28.796708] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-09T17:25:29.106205] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T17:25:29.358738] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T17:25:29.596754] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-09T17:25:29.973319] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T17:25:30.396722] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-09T17:25:30.648866] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:25:31.196776] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-09T17:25:31.617170] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T17:25:31.996722] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-09T17:25:32.633603] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T17:25:32.737242] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T17:25:32.796730] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-09T17:25:33.596730] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-09T17:25:34.361085] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T17:25:34.396674] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-09T17:25:34.699823] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:25:34.702143] [INFO ] [REMOTE ] AWF: Full fetch complete (35879 records). [2025-10-09T17:25:34.702223] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-09T17:25:35.078925] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-09T17:25:35.079005] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-09T17:25:35.079455] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-09T17:25:35.079496] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-09T17:25:35.080340] [DEBUG] [LOCAL ] AWF: Trimmed 35879 records to 24414 (keeping 200 days of data) [2025-10-09T17:25:35.196737] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-09T17:25:35.227815] [DEBUG] [LOCAL ] AWF: Primary data saved (24414 records). [2025-10-09T17:25:35.227996] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-09T17:25:35.228113] [INFO ] [MAIN ] Update Progress: 191/2373 symbols completed. AWF took 39.5s. Estimated remaining: 4h 51m 38s. Rate: 7.5 symbols/min [2025-10-09T17:25:35.402620] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:35.425906] [DEBUG] [LOCAL ] AWR: Loaded 22687 existing records from primary storage. [2025-10-09T17:25:35.426217] [INFO ] [MAIN ] AWR: Loaded 22687 existing records. [2025-10-09T17:25:35.624921] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:35.625145] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-09T17:25:35.625194] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-09T17:25:35.625461] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-09T17:25:35.625520] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-09T17:25:36.000904] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:35.997208] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-09T17:25:36.019011] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T17:25:36.057896] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T17:25:36.796734] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-09T17:25:37.054776] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T17:25:37.596738] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-09T17:25:37.785513] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T17:25:38.396764] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-09T17:25:39.196709] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-09T17:25:39.419520] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:25:39.489052] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T17:25:39.996806] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-09T17:25:40.121610] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T17:25:40.796773] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-09T17:25:41.596746] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-09T17:25:41.659629] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:25:41.816265] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T17:25:42.396801] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-09T17:25:42.691437] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T17:25:43.196803] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-09T17:25:43.598840] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T17:25:43.601741] [INFO ] [REMOTE ] AWI: Full fetch complete (35683 records). [2025-10-09T17:25:43.601833] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-09T17:25:43.967520] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-09T17:25:43.967604] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-09T17:25:43.968094] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-09T17:25:43.968158] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-09T17:25:43.968966] [DEBUG] [LOCAL ] AWI: Trimmed 35683 records to 25458 (keeping 200 days of data) [2025-10-09T17:25:44.023455] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-09T17:25:44.135092] [DEBUG] [LOCAL ] AWI: Primary data saved (25458 records). [2025-10-09T17:25:44.135248] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-09T17:25:44.135336] [INFO ] [MAIN ] Update Progress: 192/2373 symbols completed. AWI took 37.5s. Estimated remaining: 4h 51m 40s. Rate: 7.5 symbols/min [2025-10-09T17:25:44.337466] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:44.366012] [DEBUG] [LOCAL ] AX: Loaded 28069 existing records from primary storage. [2025-10-09T17:25:44.366305] [INFO ] [MAIN ] AX: Loaded 28069 existing records. [2025-10-09T17:25:44.555998] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:44.556275] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-09T17:25:44.556393] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-09T17:25:44.556780] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-09T17:25:44.556838] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-09T17:25:44.803230] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-09T17:25:44.920637] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:44.953851] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:25:45.133270] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T17:25:45.596693] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-09T17:25:45.976077] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T17:25:46.396739] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-09T17:25:47.091265] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T17:25:47.196690] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-09T17:25:47.504744] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T17:25:47.996727] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-09T17:25:48.706972] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-09T17:25:48.796670] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-09T17:25:49.163826] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T17:25:49.596708] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-09T17:25:50.396686] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-09T17:25:50.624336] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T17:25:50.628896] [INFO ] [REMOTE ] AWK: Full fetch complete (70675 records). [2025-10-09T17:25:50.629031] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-09T17:25:50.817726] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T17:25:51.033411] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-09T17:25:51.033501] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-09T17:25:51.034240] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-09T17:25:51.034306] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-09T17:25:51.035868] [DEBUG] [LOCAL ] AWK: Trimmed 70675 records to 49030 (keeping 200 days of data) [2025-10-09T17:25:51.225328] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-09T17:25:51.356912] [DEBUG] [LOCAL ] AWK: Primary data saved (49030 records). [2025-10-09T17:25:51.357057] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-09T17:25:51.357609] [INFO ] [MAIN ] Update Progress: 193/2373 symbols completed. AWK took 28.8s. Estimated remaining: 4h 51m 23s. Rate: 7.5 symbols/min [2025-10-09T17:25:51.527315] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:25:51.576169] [DEBUG] [LOCAL ] AXL: Loaded 50517 existing records from primary storage. [2025-10-09T17:25:51.576517] [INFO ] [MAIN ] AXL: Loaded 50517 existing records. [2025-10-09T17:25:51.776928] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:25:51.778523] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T17:25:51.778683] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-09T17:25:51.785225] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-09T17:25:51.785509] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-09T17:25:51.785583] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-09T17:25:52.003557] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-09T17:25:52.154352] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:25:52.155534] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T17:25:52.796719] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-09T17:25:53.292701] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T17:25:53.596745] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-09T17:25:54.198962] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T17:25:54.396745] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-09T17:25:55.159148] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:25:55.196665] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-09T17:25:55.410452] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:25:55.996765] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-09T17:25:56.684269] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T17:25:56.796739] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-09T17:25:56.859259] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T17:25:57.596732] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-09T17:25:58.068283] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T17:25:58.396752] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-09T17:25:59.185114] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:25:59.196680] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-09T17:25:59.471499] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T17:25:59.996790] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-09T17:26:00.796757] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-09T17:26:01.089794] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T17:26:01.156929] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T17:26:01.596764] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-09T17:26:01.854703] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T17:26:01.856518] [INFO ] [REMOTE ] AWP: Full fetch complete (31893 records). [2025-10-09T17:26:01.856594] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-09T17:26:01.857106] [FATAL] [VALIDATOR ] AWP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:26:01.857222] [FATAL] [MAIN ] AWP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:26:01.857265] [WARN ] [MAIN ] AWP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:26:01.857303] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-09T17:26:01.857357] [DEBUG] [LOCAL ] AWP: No primary data file found to delete. [2025-10-09T17:26:01.857391] [INFO ] [LOCAL ] AWP: Starting deletion of derivative data. [2025-10-09T17:26:01.857827] [DEBUG] [LOCAL ] AWP: Deleted derivative data file. [2025-10-09T17:26:01.857916] [INFO ] [MAIN ] Update Progress: 194/2373 symbols completed. AWP took 34.1s. Estimated remaining: 4h 51m 43s. Rate: 7.5 symbols/min [2025-10-09T17:26:02.023587] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:02.072294] [DEBUG] [LOCAL ] AXP: Loaded 53172 existing records from primary storage. [2025-10-09T17:26:02.072618] [INFO ] [MAIN ] AXP: Loaded 53172 existing records. [2025-10-09T17:26:02.245527] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:02.245731] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-09T17:26:02.245792] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-09T17:26:02.246044] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-09T17:26:02.246108] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-09T17:26:02.401863] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-09T17:26:02.603055] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:02.782129] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T17:26:02.784951] [INFO ] [REMOTE ] AWR: Full fetch complete (32195 records). [2025-10-09T17:26:02.785042] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-09T17:26:03.148374] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-09T17:26:03.148452] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-09T17:26:03.148840] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-09T17:26:03.148901] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-09T17:26:03.149928] [DEBUG] [LOCAL ] AWR: Trimmed 32195 records to 22850 (keeping 200 days of data) [2025-10-09T17:26:03.207347] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-09T17:26:03.298495] [DEBUG] [LOCAL ] AWR: Primary data saved (22850 records). [2025-10-09T17:26:03.298614] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-09T17:26:03.298731] [INFO ] [MAIN ] Update Progress: 195/2373 symbols completed. AWR took 28.1s. Estimated remaining: 4h 50m 21s. Rate: 7.5 symbols/min [2025-10-09T17:26:03.470347] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:03.476812] [DEBUG] [LOCAL ] AXR: Loaded 2986 existing records from primary storage. [2025-10-09T17:26:03.476981] [INFO ] [MAIN ] AXR: Loaded 2986 existing records. [2025-10-09T17:26:03.653763] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:03.654156] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-09T17:26:03.654218] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-09T17:26:03.659607] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-09T17:26:03.666697] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-09T17:26:03.770108] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T17:26:04.006683] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-09T17:26:04.028279] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:04.796716] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-09T17:26:05.313674] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-09T17:26:05.526926] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T17:26:05.596661] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-09T17:26:06.074107] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T17:26:06.396783] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-09T17:26:06.994589] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:26:07.196762] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-09T17:26:07.963754] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T17:26:07.996685] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-09T17:26:08.495720] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-09T17:26:08.587373] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T17:26:08.796813] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-09T17:26:09.596752] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-09T17:26:10.396719] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-09T17:26:10.807269] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-09T17:26:10.918109] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-09T17:26:11.196744] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-09T17:26:11.235368] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T17:26:11.996734] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-09T17:26:12.606760] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T17:26:12.796699] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-09T17:26:13.272543] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-09T17:26:13.596735] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-09T17:26:14.184188] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T17:26:14.292923] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T17:26:14.396749] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-09T17:26:14.876788] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-09T17:26:15.196730] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-09T17:26:15.996716] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-09T17:26:16.588698] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T17:26:16.796726] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-09T17:26:17.596704] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-09T17:26:17.938308] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T17:26:18.396721] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-09T17:26:18.503408] [DEBUG] [REMOTE ] AX: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-09T17:26:18.503762] [WARN ] [REMOTE ] AX: No data returned for month 2025-06 [2025-10-09T17:26:18.503852] [FATAL] [REMOTE ] AX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:26:18.503966] [FATAL] [MAIN ] AX: Failed to fetch primary data. [2025-10-09T17:26:18.504038] [WARN ] [MAIN ] AX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:26:18.504112] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-09T17:26:18.504182] [DEBUG] [LOCAL ] AX: No primary data file found to delete. [2025-10-09T17:26:18.504252] [INFO ] [LOCAL ] AX: Starting deletion of derivative data. [2025-10-09T17:26:18.504455] [DEBUG] [LOCAL ] AX: Deleted derivative data file. [2025-10-09T17:26:18.504543] [INFO ] [MAIN ] Update Progress: 196/2373 symbols completed. AX took 34.4s. Estimated remaining: 4h 51m 33s. Rate: 7.5 symbols/min [2025-10-09T17:26:18.672902] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:18.713334] [DEBUG] [LOCAL ] AXS: Loaded 38632 existing records from primary storage. [2025-10-09T17:26:18.713626] [INFO ] [MAIN ] AXS: Loaded 38632 existing records. [2025-10-09T17:26:18.910478] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:18.910957] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-09T17:26:18.911011] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-09T17:26:18.911233] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-09T17:26:18.911291] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-09T17:26:19.199068] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-09T17:26:19.290775] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (4.09 seconds). [2025-10-09T17:26:19.344869] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:19.398739] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T17:26:19.910436] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T17:26:19.996730] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-09T17:26:20.796728] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-09T17:26:21.117075] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-09T17:26:21.596755] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-09T17:26:21.651934] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:26:22.396727] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-09T17:26:23.196725] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-09T17:26:23.257471] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T17:26:23.996729] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-09T17:26:24.060018] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:26:24.567207] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:26:24.796731] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-09T17:26:25.353464] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T17:26:25.605588] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-09T17:26:25.624835] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T17:26:26.186489] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T17:26:26.187231] [INFO ] [REMOTE ] AXR: Full fetch complete (4585 records). [2025-10-09T17:26:26.187301] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-09T17:26:26.401802] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-09T17:26:26.583367] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-09T17:26:26.583444] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-09T17:26:26.583575] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-09T17:26:26.583611] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-09T17:26:26.583988] [DEBUG] [LOCAL ] AXR: Trimmed 4585 records to 3001 (keeping 200 days of data) [2025-10-09T17:26:26.601694] [DEBUG] [LOCAL ] AXR: Primary data saved (3001 records). [2025-10-09T17:26:26.601781] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-09T17:26:26.601854] [INFO ] [MAIN ] Update Progress: 197/2373 symbols completed. AXR took 23.3s. Estimated remaining: 4h 51m 26s. Rate: 7.5 symbols/min [2025-10-09T17:26:27.196718] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-09T17:26:27.996702] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-09T17:26:28.093518] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T17:26:28.098245] [INFO ] [REMOTE ] AXL: Full fetch complete (72771 records). [2025-10-09T17:26:28.098358] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-09T17:26:28.499150] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-09T17:26:28.499349] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-09T17:26:28.500305] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-09T17:26:28.500391] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-09T17:26:28.521639] [DEBUG] [LOCAL ] AXL: Trimmed 72771 records to 50878 (keeping 200 days of data) [2025-10-09T17:26:28.523359] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:26:28.806286] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-09T17:26:28.825828] [DEBUG] [LOCAL ] AXL: Primary data saved (50878 records). [2025-10-09T17:26:28.825925] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-09T17:26:28.826444] [INFO ] [MAIN ] Update Progress: 198/2373 symbols completed. AXL took 37.5s. Estimated remaining: 4h 50m 14s. Rate: 7.5 symbols/min [2025-10-09T17:26:30.138715] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-09T17:26:30.151024] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-09T17:26:30.241357] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T17:26:30.396680] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-09T17:26:32.013507] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T17:26:32.022176] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-09T17:26:32.271743] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-09T17:26:32.283269] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-09T17:26:33.547614] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:26:33.556015] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-09T17:26:34.005410] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T17:26:34.016769] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-09T17:26:35.093378] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T17:26:35.101365] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-09T17:26:36.045986] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-09T17:26:36.049919] [INFO ] [REMOTE ] AXP: Full fetch complete (76522 records). [2025-10-09T17:26:36.050028] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-09T17:26:36.050817] [FATAL] [VALIDATOR ] AXP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:26:36.050909] [FATAL] [MAIN ] AXP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:26:36.050952] [WARN ] [MAIN ] AXP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:26:36.050989] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-09T17:26:36.051047] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-10-09T17:26:36.051097] [INFO ] [LOCAL ] AXP: Starting deletion of derivative data. [2025-10-09T17:26:36.051325] [DEBUG] [LOCAL ] AXP: Deleted derivative data file. [2025-10-09T17:26:36.051422] [INFO ] [MAIN ] Update Progress: 199/2373 symbols completed. AXP took 34.2s. Estimated remaining: 4h 49m 57s. Rate: 7.5 symbols/min [2025-10-09T17:26:36.555788] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:26:36.564300] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-09T17:26:38.038745] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:26:38.047361] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-09T17:26:39.578609] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T17:26:39.587196] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-09T17:26:41.057153] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T17:26:41.066023] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-09T17:26:42.557852] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T17:26:42.562718] [INFO ] [REMOTE ] AXS: Full fetch complete (55739 records). [2025-10-09T17:26:42.562876] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-09T17:26:43.006852] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-09T17:26:43.006939] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-09T17:26:43.007607] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-09T17:26:43.007702] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-09T17:26:43.009035] [DEBUG] [LOCAL ] AXS: Trimmed 55739 records to 38952 (keeping 200 days of data) [2025-10-09T17:26:43.275916] [DEBUG] [LOCAL ] AXS: Primary data saved (38952 records). [2025-10-09T17:26:43.276097] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-09T17:26:43.276204] [INFO ] [MAIN ] Update Progress: 200/2373 symbols completed. AXS took 24.8s. Estimated remaining: 4h 49m 41s. Rate: 7.5 symbols/min [2025-10-09T17:26:43.865292] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:43.989010] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:43.984237] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:44.025782] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:26:44.034760] [DEBUG] [LOCAL ] AZO: Loaded 11256 existing records from primary storage. [2025-10-09T17:26:44.036873] [INFO ] [MAIN ] AZO: Loaded 11256 existing records. [2025-10-09T17:26:44.182009] [DEBUG] [LOCAL ] AYI: Loaded 25246 existing records from primary storage. [2025-10-09T17:26:44.243903] [INFO ] [MAIN ] AYI: Loaded 25246 existing records. [2025-10-09T17:26:44.274299] [DEBUG] [LOCAL ] AZZ: Loaded 22128 existing records from primary storage. [2025-10-09T17:26:44.278422] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:44.297353] [INFO ] [MAIN ] AZZ: Loaded 22128 existing records. [2025-10-09T17:26:44.297480] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-09T17:26:44.304897] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-09T17:26:44.360208] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-09T17:26:44.360342] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-09T17:26:44.361692] [DEBUG] [LOCAL ] AXTA: Loaded 52183 existing records from primary storage. [2025-10-09T17:26:44.470321] [INFO ] [MAIN ] AXTA: Loaded 52183 existing records. [2025-10-09T17:26:45.061684] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:45.125269] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:45.184690] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:26:45.199348] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-09T17:26:45.193701] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-09T17:26:45.210277] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-09T17:26:45.215838] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-09T17:26:45.221509] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-09T17:26:45.232225] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-09T17:26:45.235946] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-09T17:26:45.241414] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-09T17:26:45.235676] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-09T17:26:45.289031] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-09T17:26:45.273468] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-09T17:26:45.289291] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-09T17:26:45.533570] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:45.607140] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-09T17:26:46.333250] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:46.343806] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-09T17:26:46.400896] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:46.422978] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-09T17:26:46.491741] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:26:46.492160] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-09T17:26:46.874697] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T17:26:46.878348] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-09T17:26:47.233432] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T17:26:47.237638] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-09T17:26:47.701536] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:26:47.707428] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-09T17:26:47.716598] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T17:26:47.719402] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-09T17:26:47.889435] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T17:26:47.899697] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-09T17:26:48.058815] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T17:26:48.063187] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-09T17:26:48.580884] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T17:26:48.583290] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-09T17:26:48.696480] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-09T17:26:48.706910] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-09T17:26:49.120853] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T17:26:49.125884] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-09T17:26:49.252792] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T17:26:49.256466] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-09T17:26:49.392362] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T17:26:49.589974] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T17:26:49.596661] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-09T17:26:49.863480] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T17:26:49.941813] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T17:26:50.396721] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-09T17:26:50.882299] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T17:26:51.151972] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T17:26:51.196669] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-09T17:26:51.996695] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-09T17:26:52.223690] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T17:26:52.796684] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-09T17:26:52.943023] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T17:26:53.547577] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T17:26:53.596682] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-09T17:26:54.396716] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-09T17:26:54.834961] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T17:26:55.196733] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-09T17:26:55.895826] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:26:55.996696] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-09T17:26:56.070409] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T17:26:56.796698] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-09T17:26:57.151765] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:26:57.596762] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-09T17:26:57.697744] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T17:26:58.396724] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-09T17:26:58.648873] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T17:26:59.196769] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-09T17:26:59.996771] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-09T17:27:00.099979] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T17:27:00.640806] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:27:00.773210] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T17:27:00.796672] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-09T17:27:01.596762] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-09T17:27:01.647424] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T17:27:02.396757] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-09T17:27:02.575960] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-09T17:27:02.578744] [INFO ] [REMOTE ] AZZ: Full fetch complete (31316 records). [2025-10-09T17:27:02.578835] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-09T17:27:02.946268] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-09T17:27:02.946353] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-09T17:27:02.946799] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-09T17:27:02.946863] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-09T17:27:02.947604] [DEBUG] [LOCAL ] AZZ: Trimmed 31316 records to 22454 (keeping 200 days of data) [2025-10-09T17:27:03.089741] [DEBUG] [LOCAL ] AZZ: Primary data saved (22454 records). [2025-10-09T17:27:03.089910] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-09T17:27:03.090045] [INFO ] [MAIN ] Update Progress: 201/2373 symbols completed. AZZ took 19.8s. Estimated remaining: 4h 51m 41s. Rate: 7.4 symbols/min [2025-10-09T17:27:03.201905] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-09T17:27:03.264522] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:03.264719] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-09T17:27:03.264769] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-09T17:27:03.264880] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-09T17:27:03.264920] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-09T17:27:03.264961] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-09T17:27:03.264992] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-09T17:27:03.627804] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:03.635425] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T17:27:03.996687] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-09T17:27:04.070363] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T17:27:04.796733] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-09T17:27:05.364941] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:27:05.596683] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-09T17:27:06.193538] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:27:06.396766] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-09T17:27:07.196681] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-09T17:27:07.268525] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:27:07.551833] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T17:27:07.763492] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T17:27:07.996766] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-09T17:27:08.202416] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:27:08.202756] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-09T17:27:08.202859] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:27:08.202975] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-09T17:27:08.203043] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:27:08.203112] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-09T17:27:08.203176] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-09T17:27:08.203212] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-09T17:27:08.203279] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-09T17:27:08.203348] [INFO ] [MAIN ] Update Progress: 202/2373 symbols completed. B took 5.1s. Estimated remaining: 4h 51m 1s. Rate: 7.5 symbols/min [2025-10-09T17:27:08.370710] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:08.423892] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-09T17:27:08.424227] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-09T17:27:08.596781] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:27:08.596985] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-09T17:27:08.597030] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-09T17:27:08.597301] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-09T17:27:08.597358] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-09T17:27:08.801869] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-09T17:27:08.994235] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:09.596713] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-09T17:27:09.755628] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T17:27:09.756995] [INFO ] [REMOTE ] AZO: Full fetch complete (16060 records). [2025-10-09T17:27:09.757062] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-09T17:27:10.113067] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-09T17:27:10.113163] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-09T17:27:10.113465] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-09T17:27:10.113507] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-09T17:27:10.114036] [DEBUG] [LOCAL ] AZO: Trimmed 16060 records to 11333 (keeping 200 days of data) [2025-10-09T17:27:10.185457] [DEBUG] [LOCAL ] AZO: Primary data saved (11333 records). [2025-10-09T17:27:10.185658] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-09T17:27:10.185763] [INFO ] [MAIN ] Update Progress: 203/2373 symbols completed. AZO took 26.9s. Estimated remaining: 4h 49m 48s. Rate: 7.5 symbols/min [2025-10-09T17:27:10.350151] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:10.403587] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-09T17:27:10.406540] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-09T17:27:10.406856] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-09T17:27:10.582740] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:27:10.582955] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-09T17:27:10.583001] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-09T17:27:10.583771] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-09T17:27:10.583830] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-09T17:27:10.937273] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:11.196736] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-09T17:27:11.689108] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T17:27:11.692089] [INFO ] [REMOTE ] AYI: Full fetch complete (37039 records). [2025-10-09T17:27:11.692233] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-09T17:27:11.998096] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-09T17:27:12.106385] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-09T17:27:12.106561] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-09T17:27:12.107175] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-09T17:27:12.107354] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-09T17:27:12.108430] [DEBUG] [LOCAL ] AYI: Trimmed 37039 records to 25419 (keeping 200 days of data) [2025-10-09T17:27:12.258320] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-09T17:27:12.317384] [DEBUG] [LOCAL ] AYI: Primary data saved (25419 records). [2025-10-09T17:27:12.317539] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-09T17:27:12.317632] [INFO ] [MAIN ] Update Progress: 204/2373 symbols completed. AYI took 29.0s. Estimated remaining: 4h 48m 38s. Rate: 7.5 symbols/min [2025-10-09T17:27:12.507701] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:12.562896] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-09T17:27:12.563276] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-09T17:27:12.758412] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:27:12.758790] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-09T17:27:12.758886] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-09T17:27:12.759194] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-09T17:27:12.759257] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-09T17:27:12.809566] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-09T17:27:13.162415] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:13.597131] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-09T17:27:13.610941] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-09T17:27:14.010012] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T17:27:14.396746] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-09T17:27:15.207184] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-09T17:27:15.242711] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-09T17:27:15.996693] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-09T17:27:16.308346] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-09T17:27:16.796750] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-09T17:27:16.958986] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-09T17:27:16.998610] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:27:17.596719] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-09T17:27:18.099963] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-09T17:27:18.396761] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-09T17:27:18.933888] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T17:27:18.978688] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-09T17:27:19.196730] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-09T17:27:19.996730] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-09T17:27:20.796753] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-09T17:27:20.842954] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-09T17:27:21.347595] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-09T17:27:21.596722] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-09T17:27:22.124087] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:27:22.180477] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-09T17:27:22.396722] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-09T17:27:23.196733] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-09T17:27:23.996718] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-09T17:27:24.363956] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-09T17:27:24.455869] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T17:27:24.796736] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-09T17:27:25.596782] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-09T17:27:25.728454] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-09T17:27:26.116664] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-09T17:27:26.396687] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-09T17:27:26.506573] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T17:27:27.196729] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-09T17:27:27.501181] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T17:27:27.996709] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-09T17:27:28.644119] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T17:27:28.649891] [INFO ] [REMOTE ] AXTA: Full fetch complete (75112 records). [2025-10-09T17:27:28.650013] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-09T17:27:28.799714] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-09T17:27:29.058727] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-09T17:27:29.058865] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-09T17:27:29.059628] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-09T17:27:29.059782] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-09T17:27:29.089751] [DEBUG] [LOCAL ] AXTA: Trimmed 75112 records to 52567 (keeping 200 days of data) [2025-10-09T17:27:29.091418] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-09T17:27:29.418234] [DEBUG] [LOCAL ] AXTA: Primary data saved (52567 records). [2025-10-09T17:27:29.418367] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-09T17:27:29.418464] [INFO ] [MAIN ] Update Progress: 205/2373 symbols completed. AXTA took 46.1s. Estimated remaining: 4h 50m 6s. Rate: 7.5 symbols/min [2025-10-09T17:27:29.597204] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-09T17:27:29.597129] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:29.598293] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-10-09T17:27:29.598359] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-10-09T17:27:29.598501] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-09T17:27:29.598574] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-09T17:27:29.598681] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-09T17:27:29.598756] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-09T17:27:29.967384] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:30.189755] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-09T17:27:30.396737] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-09T17:27:31.018237] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-09T17:27:31.196715] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-09T17:27:31.648466] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T17:27:31.996682] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-09T17:27:32.502668] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-09T17:27:32.796723] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-09T17:27:33.574942] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-09T17:27:33.596683] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-09T17:27:34.396685] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-09T17:27:34.468399] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-09T17:27:34.630743] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T17:27:35.196745] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-09T17:27:35.705355] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T17:27:35.996792] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-09T17:27:36.377223] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-09T17:27:36.785839] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T17:27:36.796677] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-09T17:27:37.596737] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-09T17:27:38.396697] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-09T17:27:38.519402] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T17:27:38.885365] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-09T17:27:39.196714] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-09T17:27:39.996748] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-09T17:27:40.163042] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-09T17:27:40.723351] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-09T17:27:40.796720] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-09T17:27:41.104463] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T17:27:41.214508] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T17:27:41.219217] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-09T17:27:41.219381] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-09T17:27:41.598584] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-09T17:27:41.619386] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-09T17:27:41.619510] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-09T17:27:41.620404] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-09T17:27:41.620679] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-09T17:27:41.622498] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 54180 (keeping 200 days of data) [2025-10-09T17:27:41.775335] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T17:27:42.025438] [DEBUG] [LOCAL ] BA: Primary data saved (54180 records). [2025-10-09T17:27:42.025617] [INFO ] [MAIN ] BA: Full history saved. [2025-10-09T17:27:42.025740] [INFO ] [MAIN ] Update Progress: 206/2373 symbols completed. BA took 33.8s. Estimated remaining: 4h 50m 46s. Rate: 7.5 symbols/min [2025-10-09T17:27:42.192776] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:42.230952] [DEBUG] [LOCAL ] BAK: Loaded 39408 existing records from primary storage. [2025-10-09T17:27:42.231279] [INFO ] [MAIN ] BAK: Loaded 39408 existing records. [2025-10-09T17:27:42.403803] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-09T17:27:42.409625] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:27:42.410873] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-09T17:27:42.410938] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-09T17:27:42.411130] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-09T17:27:42.411187] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-09T17:27:42.769755] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:43.196774] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-09T17:27:43.996739] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-09T17:27:44.312460] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-09T17:27:44.646776] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-09T17:27:44.796677] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-09T17:27:45.065353] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T17:27:45.596697] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-09T17:27:45.673915] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:27:46.396700] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-09T17:27:46.976419] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T17:27:47.196818] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-09T17:27:47.672849] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-09T17:27:47.996699] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-09T17:27:48.069409] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:27:48.796772] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-09T17:27:49.563543] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-09T17:27:49.568458] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-09T17:27:49.568601] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-09T17:27:49.601794] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-09T17:27:49.976072] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-09T17:27:49.976273] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-09T17:27:49.977114] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-09T17:27:49.977197] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-09T17:27:49.978971] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54210 (keeping 200 days of data) [2025-10-09T17:27:50.131869] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-09T17:27:50.360523] [DEBUG] [LOCAL ] BABA: Primary data saved (54210 records). [2025-10-09T17:27:50.360820] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-09T17:27:50.361914] [INFO ] [MAIN ] Update Progress: 207/2373 symbols completed. BABA took 40.2s. Estimated remaining: 4h 50m 41s. Rate: 7.5 symbols/min [2025-10-09T17:27:50.405749] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-09T17:27:50.539690] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:50.590919] [DEBUG] [LOCAL ] BALL: Loaded 51825 existing records from primary storage. [2025-10-09T17:27:50.591254] [INFO ] [MAIN ] BALL: Loaded 51825 existing records. [2025-10-09T17:27:50.768006] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:27:50.768261] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-09T17:27:50.768353] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-09T17:27:50.769962] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-09T17:27:50.770021] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-09T17:27:51.153432] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:51.158663] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-09T17:27:51.186956] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:27:51.187257] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-09T17:27:51.195491] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-09T17:27:51.208349] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-09T17:27:51.587460] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-09T17:27:51.587552] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-09T17:27:51.588456] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-09T17:27:51.588527] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-09T17:27:51.590188] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54198 (keeping 200 days of data) [2025-10-09T17:27:51.934148] [DEBUG] [LOCAL ] BAC: Primary data saved (54198 records). [2025-10-09T17:27:51.934306] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-09T17:27:51.934862] [INFO ] [MAIN ] Update Progress: 208/2373 symbols completed. BAC took 39.6s. Estimated remaining: 4h 49m 26s. Rate: 7.5 symbols/min [2025-10-09T17:27:51.997114] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-09T17:27:52.110150] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:27:52.110503] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-09T17:27:52.110577] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-09T17:27:52.110848] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-09T17:27:52.110906] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-09T17:27:52.110950] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-09T17:27:52.110984] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-09T17:27:52.473561] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:27:52.506811] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-09T17:27:52.796733] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-09T17:27:53.133080] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T17:27:53.477141] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:27:53.596682] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-09T17:27:53.673087] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:27:54.396714] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-09T17:27:54.860701] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T17:27:55.196683] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-09T17:27:55.543316] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T17:27:55.996798] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-09T17:27:56.451533] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T17:27:56.796742] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-09T17:27:57.158230] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-09T17:27:57.578534] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T17:27:57.596717] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-09T17:27:58.396758] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-09T17:27:58.913771] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T17:27:59.196777] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-09T17:27:59.873551] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T17:27:59.995329] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:28:00.005001] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-09T17:28:00.796712] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-09T17:28:01.447786] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T17:28:01.596694] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-09T17:28:01.969438] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T17:28:02.396748] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-09T17:28:02.919803] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-09T17:28:03.196688] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-09T17:28:03.342282] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T17:28:03.996731] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-09T17:28:04.796689] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-09T17:28:04.908306] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T17:28:05.379415] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T17:28:05.383888] [INFO ] [REMOTE ] BAH: Full fetch complete (74910 records). [2025-10-09T17:28:05.384007] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-09T17:28:05.608975] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-09T17:28:05.787781] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-09T17:28:05.787676] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:28:05.787925] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-09T17:28:05.792187] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-09T17:28:05.792547] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-09T17:28:05.794047] [DEBUG] [LOCAL ] BAH: Trimmed 74910 records to 52055 (keeping 200 days of data) [2025-10-09T17:28:06.128110] [DEBUG] [LOCAL ] BAH: Primary data saved (52055 records). [2025-10-09T17:28:06.128268] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-09T17:28:06.128345] [INFO ] [MAIN ] Update Progress: 209/2373 symbols completed. BAH took 36.7s. Estimated remaining: 4h 50m 22s. Rate: 7.5 symbols/min [2025-10-09T17:28:06.332267] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:06.393016] [DEBUG] [LOCAL ] BAM: Loaded 52011 existing records from primary storage. [2025-10-09T17:28:06.393522] [INFO ] [MAIN ] BAM: Loaded 52011 existing records. [2025-10-09T17:28:06.406993] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-09T17:28:06.626345] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:06.626674] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-09T17:28:06.626754] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-09T17:28:06.628753] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-09T17:28:06.628875] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-09T17:28:07.121813] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T17:28:07.200307] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-09T17:28:07.261527] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:07.297720] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T17:28:07.996755] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-09T17:28:08.346335] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T17:28:08.796737] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-09T17:28:09.297294] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T17:28:09.596718] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-09T17:28:10.033549] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T17:28:10.163606] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T17:28:10.396720] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-09T17:28:11.196768] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-09T17:28:11.750870] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T17:28:11.950032] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T17:28:11.996757] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-09T17:28:12.796407] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-09T17:28:12.797751] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-09T17:28:12.798494] [INFO ] [REMOTE ] BALY: Full fetch complete (16667 records). [2025-10-09T17:28:12.798594] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-09T17:28:12.800021] [FATAL] [VALIDATOR ] BALY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:28:12.800176] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:28:12.800261] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:28:12.800350] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-09T17:28:12.800450] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-09T17:28:12.800584] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-09T17:28:12.800680] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-09T17:28:12.800764] [INFO ] [MAIN ] Update Progress: 210/2373 symbols completed. BALY took 20.9s. Estimated remaining: 4h 49m 59s. Rate: 7.5 symbols/min [2025-10-09T17:28:12.979404] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:13.035214] [DEBUG] [LOCAL ] BANC: Loaded 51277 existing records from primary storage. [2025-10-09T17:28:13.035593] [INFO ] [MAIN ] BANC: Loaded 51277 existing records. [2025-10-09T17:28:13.222245] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:13.222474] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-09T17:28:13.222521] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-09T17:28:13.224053] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-09T17:28:13.224114] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-09T17:28:13.588162] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:13.596668] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-09T17:28:14.201834] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T17:28:14.396718] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-09T17:28:15.196742] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-09T17:28:15.411516] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T17:28:15.793811] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:28:15.996756] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-09T17:28:16.796712] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-09T17:28:17.079733] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T17:28:17.596701] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-09T17:28:17.630019] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T17:28:18.131263] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:28:18.396709] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-09T17:28:18.935767] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T17:28:19.196740] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-09T17:28:19.917883] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T17:28:19.921802] [INFO ] [REMOTE ] BAK: Full fetch complete (57070 records). [2025-10-09T17:28:19.921959] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-09T17:28:20.001824] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-09T17:28:20.325133] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-09T17:28:20.325216] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-09T17:28:20.325836] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-09T17:28:20.325900] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-09T17:28:20.327024] [DEBUG] [LOCAL ] BAK: Trimmed 57070 records to 39681 (keeping 200 days of data) [2025-10-09T17:28:20.558152] [DEBUG] [LOCAL ] BAK: Primary data saved (39681 records). [2025-10-09T17:28:20.558315] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-09T17:28:20.558414] [INFO ] [MAIN ] Update Progress: 211/2373 symbols completed. BAK took 38.5s. Estimated remaining: 4h 49m 48s. Rate: 7.5 symbols/min [2025-10-09T17:28:20.760337] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:20.787043] [DEBUG] [LOCAL ] BAP: Loaded 25923 existing records from primary storage. [2025-10-09T17:28:20.787339] [INFO ] [MAIN ] BAP: Loaded 25923 existing records. [2025-10-09T17:28:20.810583] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-09T17:28:20.925881] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:28:21.017878] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:21.018163] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-09T17:28:21.018227] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-09T17:28:21.019185] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-09T17:28:21.019250] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-09T17:28:21.379253] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:21.601962] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-09T17:28:21.607541] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T17:28:22.396770] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-09T17:28:22.512877] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T17:28:22.519996] [INFO ] [REMOTE ] BALL: Full fetch complete (75373 records). [2025-10-09T17:28:22.520119] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-09T17:28:22.919508] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-09T17:28:22.919615] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-09T17:28:22.920687] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-09T17:28:22.920756] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-09T17:28:22.922418] [DEBUG] [LOCAL ] BALL: Trimmed 75373 records to 52213 (keeping 200 days of data) [2025-10-09T17:28:23.159757] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:28:23.200915] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-09T17:28:23.274098] [DEBUG] [LOCAL ] BALL: Primary data saved (52213 records). [2025-10-09T17:28:23.274214] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-09T17:28:23.274849] [INFO ] [MAIN ] Update Progress: 212/2373 symbols completed. BALL took 32.9s. Estimated remaining: 4h 48m 46s. Rate: 7.5 symbols/min [2025-10-09T17:28:23.520303] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:23.558320] [DEBUG] [LOCAL ] BARK: Loaded 37978 existing records from primary storage. [2025-10-09T17:28:23.558615] [INFO ] [MAIN ] BARK: Loaded 37978 existing records. [2025-10-09T17:28:23.740215] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:23.740438] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-09T17:28:23.740484] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-09T17:28:23.741538] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-09T17:28:23.741596] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-09T17:28:23.997028] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-09T17:28:24.107828] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:24.186416] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T17:28:24.548288] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T17:28:24.796731] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-09T17:28:25.596705] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-09T17:28:25.744595] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T17:28:25.886213] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T17:28:26.396715] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-09T17:28:27.196683] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-09T17:28:27.268179] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:28:27.996736] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-09T17:28:28.222854] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T17:28:28.329375] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T17:28:28.796784] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-09T17:28:29.596902] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-09T17:28:30.103750] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T17:28:30.141189] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-09T17:28:30.396766] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-09T17:28:31.017557] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T17:28:31.196730] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-09T17:28:31.996689] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-09T17:28:32.340081] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T17:28:32.412196] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-09T17:28:32.796720] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-09T17:28:33.596696] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-09T17:28:33.653938] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:28:34.115977] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T17:28:34.396749] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-09T17:28:34.999143] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T17:28:35.196732] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-09T17:28:35.996711] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-09T17:28:36.340503] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T17:28:36.591940] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T17:28:36.796721] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-09T17:28:37.596755] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-09T17:28:37.730343] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T17:28:38.200190] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T17:28:38.396730] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-09T17:28:38.961141] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T17:28:39.196719] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-09T17:28:39.354563] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T17:28:39.996761] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-09T17:28:40.796695] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-09T17:28:41.193367] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-09T17:28:41.397858] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:28:41.601783] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-09T17:28:41.611040] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T17:28:42.396719] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-09T17:28:43.196725] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-09T17:28:43.288476] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T17:28:43.293792] [INFO ] [REMOTE ] BAM: Full fetch complete (74558 records). [2025-10-09T17:28:43.293914] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-09T17:28:43.715823] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-09T17:28:43.715984] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-09T17:28:43.716765] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-09T17:28:43.716828] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-09T17:28:43.718322] [DEBUG] [LOCAL ] BAM: Trimmed 74558 records to 52387 (keeping 200 days of data) [2025-10-09T17:28:44.008192] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-09T17:28:44.057414] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:28:44.107213] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T17:28:44.106380] [DEBUG] [LOCAL ] BAM: Primary data saved (52387 records). [2025-10-09T17:28:44.112970] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-09T17:28:44.114977] [INFO ] [MAIN ] Update Progress: 213/2373 symbols completed. BAM took 38.0s. Estimated remaining: 4h 50m 48s. Rate: 7.4 symbols/min [2025-10-09T17:28:44.296091] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:44.352404] [DEBUG] [LOCAL ] BAX: Loaded 53504 existing records from primary storage. [2025-10-09T17:28:44.352796] [INFO ] [MAIN ] BAX: Loaded 53504 existing records. [2025-10-09T17:28:44.537136] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:44.537355] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-09T17:28:44.537403] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-09T17:28:44.539187] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-09T17:28:44.539250] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-09T17:28:44.801949] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-09T17:28:44.905133] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:45.341949] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:28:45.596743] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-09T17:28:45.974457] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T17:28:46.396747] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-09T17:28:47.196706] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-09T17:28:47.328804] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T17:28:47.533691] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T17:28:47.996719] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-09T17:28:48.796738] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-09T17:28:49.060223] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T17:28:49.596710] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-09T17:28:49.902397] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T17:28:50.145521] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:28:50.396752] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-09T17:28:51.196700] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-09T17:28:51.320735] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:28:51.741457] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T17:28:51.748030] [INFO ] [REMOTE ] BANC: Full fetch complete (74329 records). [2025-10-09T17:28:51.748203] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-09T17:28:52.004354] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-09T17:28:52.139154] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-09T17:28:52.139244] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-09T17:28:52.140011] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-09T17:28:52.140079] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-09T17:28:52.141514] [DEBUG] [LOCAL ] BANC: Trimmed 74329 records to 51663 (keeping 200 days of data) [2025-10-09T17:28:52.469104] [DEBUG] [LOCAL ] BANC: Primary data saved (51663 records). [2025-10-09T17:28:52.469346] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-09T17:28:52.469940] [INFO ] [MAIN ] Update Progress: 214/2373 symbols completed. BANC took 39.7s. Estimated remaining: 4h 50m 43s. Rate: 7.4 symbols/min [2025-10-09T17:28:52.615966] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T17:28:52.667313] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:52.717027] [DEBUG] [LOCAL ] BB: Loaded 52939 existing records from primary storage. [2025-10-09T17:28:52.717335] [INFO ] [MAIN ] BB: Loaded 52939 existing records. [2025-10-09T17:28:52.805080] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-09T17:28:52.895964] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:52.896205] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-09T17:28:52.896275] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-09T17:28:52.897838] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-09T17:28:52.897900] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-09T17:28:53.245763] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:53.596716] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-09T17:28:53.754456] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T17:28:53.836799] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T17:28:54.396706] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-09T17:28:55.196888] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-09T17:28:55.747206] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-09T17:28:55.996696] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-09T17:28:56.033409] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:28:56.350058] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T17:28:56.352218] [INFO ] [REMOTE ] BAP: Full fetch complete (37310 records). [2025-10-09T17:28:56.352288] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-09T17:28:56.722541] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-09T17:28:56.722620] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-09T17:28:56.723117] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-09T17:28:56.723178] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-09T17:28:56.724145] [DEBUG] [LOCAL ] BAP: Trimmed 37310 records to 26069 (keeping 200 days of data) [2025-10-09T17:28:56.811999] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-09T17:28:56.883277] [DEBUG] [LOCAL ] BAP: Primary data saved (26069 records). [2025-10-09T17:28:56.883404] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-09T17:28:56.883515] [INFO ] [MAIN ] Update Progress: 215/2373 symbols completed. BAP took 36.3s. Estimated remaining: 4h 49m 58s. Rate: 7.4 symbols/min [2025-10-09T17:28:57.049375] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:57.103226] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-09T17:28:57.103589] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-09T17:28:57.284580] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:57.284877] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-09T17:28:57.284954] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-09T17:28:57.285205] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-09T17:28:57.285277] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-09T17:28:57.605688] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-09T17:28:57.646726] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:57.814863] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T17:28:58.060226] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T17:28:58.063461] [INFO ] [REMOTE ] BARK: Full fetch complete (55970 records). [2025-10-09T17:28:58.063555] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-09T17:28:58.401835] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-09T17:28:58.454194] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-09T17:28:58.454273] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-09T17:28:58.454977] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-09T17:28:58.455042] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-09T17:28:58.456220] [DEBUG] [LOCAL ] BARK: Trimmed 55970 records to 38242 (keeping 200 days of data) [2025-10-09T17:28:58.670526] [DEBUG] [LOCAL ] BARK: Primary data saved (38242 records). [2025-10-09T17:28:58.670687] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-09T17:28:58.671270] [INFO ] [MAIN ] Update Progress: 216/2373 symbols completed. BARK took 35.4s. Estimated remaining: 4h 48m 47s. Rate: 7.5 symbols/min [2025-10-09T17:28:58.844625] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:28:58.893394] [DEBUG] [LOCAL ] BBAR: Loaded 41817 existing records from primary storage. [2025-10-09T17:28:58.893854] [INFO ] [MAIN ] BBAR: Loaded 41817 existing records. [2025-10-09T17:28:59.146478] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:28:59.147063] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-09T17:28:59.147148] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-09T17:28:59.148564] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-09T17:28:59.148676] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-09T17:28:59.201998] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-09T17:28:59.679288] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-09T17:28:59.768662] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:28:59.996767] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-09T17:29:00.796742] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-09T17:29:01.010111] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-10-09T17:29:01.450383] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-09T17:29:01.596673] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-09T17:29:01.749714] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T17:29:02.026457] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T17:29:02.396786] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-09T17:29:03.196714] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-09T17:29:03.580025] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-09T17:29:03.993696] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:29:04.003744] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-09T17:29:04.787740] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T17:29:04.796934] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-09T17:29:05.596729] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-09T17:29:06.396711] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-09T17:29:06.491358] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-09T17:29:06.646776] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T17:29:07.196684] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-09T17:29:07.256811] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T17:29:07.601478] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T17:29:07.996730] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-09T17:29:08.765628] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T17:29:08.796721] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-09T17:29:09.181960] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T17:29:09.596733] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-09T17:29:10.396769] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-09T17:29:11.085989] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T17:29:11.196742] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-09T17:29:11.360953] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-09T17:29:11.816104] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T17:29:11.996727] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-09T17:29:12.702308] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:29:12.796701] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-09T17:29:13.596743] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-09T17:29:13.980562] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T17:29:14.396696] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-09T17:29:14.678836] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-09T17:29:15.196692] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-09T17:29:15.704159] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-09T17:29:15.996736] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-09T17:29:16.064122] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T17:29:16.555124] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T17:29:16.559919] [INFO ] [REMOTE ] BAX: Full fetch complete (77440 records). [2025-10-09T17:29:16.560079] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-09T17:29:16.801863] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-09T17:29:16.993160] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-09T17:29:16.993252] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-09T17:29:16.994049] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-09T17:29:16.994111] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-09T17:29:16.995605] [DEBUG] [LOCAL ] BAX: Trimmed 77440 records to 53893 (keeping 200 days of data) [2025-10-09T17:29:17.322194] [DEBUG] [LOCAL ] BAX: Primary data saved (53893 records). [2025-10-09T17:29:17.322360] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-09T17:29:17.322491] [INFO ] [MAIN ] Update Progress: 217/2373 symbols completed. BAX took 33.2s. Estimated remaining: 4h 50m 25s. Rate: 7.4 symbols/min [2025-10-09T17:29:17.489242] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:17.541371] [DEBUG] [LOCAL ] BBD: Loaded 53245 existing records from primary storage. [2025-10-09T17:29:17.541720] [INFO ] [MAIN ] BBD: Loaded 53245 existing records. [2025-10-09T17:29:17.602928] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-09T17:29:17.717229] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:29:17.717456] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-09T17:29:17.717504] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-09T17:29:17.717814] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-09T17:29:17.717872] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-09T17:29:18.062254] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:18.396800] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-09T17:29:18.602040] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-09T17:29:18.762535] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-09T17:29:19.194626] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T17:29:19.202873] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-09T17:29:19.996739] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-09T17:29:20.168501] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:29:20.796798] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-09T17:29:21.048570] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T17:29:21.528064] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T17:29:21.596676] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-09T17:29:22.225807] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T17:29:22.396707] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-09T17:29:23.196721] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-09T17:29:23.377943] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T17:29:23.382014] [INFO ] [REMOTE ] BBAR: Full fetch complete (61047 records). [2025-10-09T17:29:23.382122] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-09T17:29:23.779362] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-09T17:29:23.779484] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-09T17:29:23.780260] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-09T17:29:23.780327] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-09T17:29:23.781597] [DEBUG] [LOCAL ] BBAR: Trimmed 61047 records to 42187 (keeping 200 days of data) [2025-10-09T17:29:23.999457] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-09T17:29:24.047614] [DEBUG] [LOCAL ] BBAR: Primary data saved (42187 records). [2025-10-09T17:29:24.047783] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-09T17:29:24.049457] [INFO ] [MAIN ] Update Progress: 218/2373 symbols completed. BBAR took 25.4s. Estimated remaining: 4h 50m 3s. Rate: 7.4 symbols/min [2025-10-09T17:29:24.181127] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T17:29:24.262668] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:24.295320] [DEBUG] [LOCAL ] BBDC: Loaded 33016 existing records from primary storage. [2025-10-09T17:29:24.295586] [INFO ] [MAIN ] BBDC: Loaded 33016 existing records. [2025-10-09T17:29:24.483733] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:29:24.483965] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-09T17:29:24.484014] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-09T17:29:24.484273] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-09T17:29:24.484331] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-09T17:29:24.808185] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-09T17:29:24.857932] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:25.172415] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-09T17:29:25.596748] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-09T17:29:26.396745] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-09T17:29:26.456080] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T17:29:26.542919] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-09T17:29:27.196771] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-09T17:29:27.657421] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T17:29:27.741498] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-09T17:29:27.996759] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-09T17:29:28.796695] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-09T17:29:28.983818] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T17:29:29.399568] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T17:29:29.596696] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-09T17:29:30.396749] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-09T17:29:31.196687] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-09T17:29:31.343426] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-09T17:29:31.707534] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-09T17:29:31.711985] [INFO ] [REMOTE ] BB: Full fetch complete (76985 records). [2025-10-09T17:29:31.712094] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-09T17:29:31.868816] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:29:32.005130] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-09T17:29:32.126173] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-09T17:29:32.126251] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-09T17:29:32.127064] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-09T17:29:32.127128] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-09T17:29:32.128533] [DEBUG] [LOCAL ] BB: Trimmed 76985 records to 53323 (keeping 200 days of data) [2025-10-09T17:29:32.432527] [DEBUG] [LOCAL ] BB: Primary data saved (53323 records). [2025-10-09T17:29:32.432695] [INFO ] [MAIN ] BB: Full history saved. [2025-10-09T17:29:32.433588] [INFO ] [MAIN ] Update Progress: 219/2373 symbols completed. BB took 40.0s. Estimated remaining: 4h 49m 58s. Rate: 7.4 symbols/min [2025-10-09T17:29:32.600048] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:32.600289] [DEBUG] [LOCAL ] BBDO: No existing data file found in primary storage. [2025-10-09T17:29:32.600344] [WARN ] [MAIN ] BBDO: No existing data found, performing full refresh instead. [2025-10-09T17:29:32.600483] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-09T17:29:32.600549] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-09T17:29:32.600599] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-09T17:29:32.600631] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-09T17:29:32.805472] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-09T17:29:32.969059] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:33.256717] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-09T17:29:33.596784] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-09T17:29:34.309954] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T17:29:34.396683] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-09T17:29:34.547255] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T17:29:34.913707] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-09T17:29:35.196750] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-09T17:29:35.996731] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-09T17:29:36.029748] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T17:29:36.656296] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T17:29:36.796703] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-09T17:29:37.596780] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-09T17:29:38.097238] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-09T17:29:38.396730] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-09T17:29:38.985965] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-09T17:29:39.035839] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T17:29:39.196733] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-09T17:29:39.996718] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-09T17:29:40.566796] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T17:29:40.644999] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-09T17:29:40.796740] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-09T17:29:41.439181] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:29:41.596703] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-09T17:29:42.396728] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-09T17:29:42.839360] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T17:29:43.196737] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-09T17:29:43.288162] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-09T17:29:43.292592] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-09T17:29:43.292739] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-09T17:29:43.685121] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-09T17:29:43.685225] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-09T17:29:43.686045] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-09T17:29:43.686111] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-09T17:29:43.687581] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54210 (keeping 200 days of data) [2025-10-09T17:29:43.996403] [DEBUG] [LOCAL ] BBAI: Primary data saved (54210 records). [2025-10-09T17:29:43.996548] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-09T17:29:43.996629] [INFO ] [MAIN ] Update Progress: 220/2373 symbols completed. BBAI took 47.1s. Estimated remaining: 4h 50m 24s. Rate: 7.4 symbols/min [2025-10-09T17:29:44.008770] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-09T17:29:44.173265] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:44.193860] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T17:29:44.215038] [DEBUG] [LOCAL ] BBN: Loaded 18059 existing records from primary storage. [2025-10-09T17:29:44.215305] [INFO ] [MAIN ] BBN: Loaded 18059 existing records. [2025-10-09T17:29:44.429506] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:29:44.429874] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-09T17:29:44.429930] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-09T17:29:44.432564] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T17:29:44.432633] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-09T17:29:44.432899] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-09T17:29:44.695389] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T17:29:44.801196] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-09T17:29:44.805834] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:45.596770] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-09T17:29:46.151736] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:29:46.396727] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-09T17:29:46.667158] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T17:29:47.196751] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-09T17:29:47.957551] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T17:29:47.996665] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-09T17:29:48.508167] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-09T17:29:48.796728] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-09T17:29:48.909055] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T17:29:49.470721] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T17:29:49.596728] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-09T17:29:50.396756] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-09T17:29:50.520452] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T17:29:51.196841] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-09T17:29:51.996833] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-09T17:29:52.247936] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T17:29:52.253128] [INFO ] [REMOTE ] BBD: Full fetch complete (77108 records). [2025-10-09T17:29:52.253328] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-09T17:29:52.676106] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-09T17:29:52.676345] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-09T17:29:52.677307] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-09T17:29:52.677572] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-09T17:29:52.689164] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T17:29:52.693977] [DEBUG] [LOCAL ] BBD: Trimmed 77108 records to 53631 (keeping 200 days of data) [2025-10-09T17:29:52.696106] [INFO ] [REMOTE ] BBDC: Full fetch complete (48525 records). [2025-10-09T17:29:52.696424] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-09T17:29:52.804583] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-09T17:29:52.883747] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T17:29:53.344497] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-09T17:29:53.349136] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-09T17:29:53.351905] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-09T17:29:53.351990] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-09T17:29:53.365009] [DEBUG] [LOCAL ] BBDC: Trimmed 48525 records to 33271 (keeping 200 days of data) [2025-10-09T17:29:53.610305] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-09T17:29:53.643543] [DEBUG] [LOCAL ] BBD: Primary data saved (53631 records). [2025-10-09T17:29:53.644306] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-09T17:29:53.644885] [INFO ] [MAIN ] Update Progress: 221/2373 symbols completed. BBD took 36.3s. Estimated remaining: 4h 50m 31s. Rate: 7.4 symbols/min [2025-10-09T17:29:53.843692] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:53.845524] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-09T17:29:53.845601] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-09T17:29:53.845798] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-09T17:29:53.845875] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-09T17:29:53.847037] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-09T17:29:53.847421] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-09T17:29:53.919919] [DEBUG] [LOCAL ] BBDC: Primary data saved (33271 records). [2025-10-09T17:29:53.932299] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-09T17:29:53.962732] [INFO ] [MAIN ] Update Progress: 222/2373 symbols completed. BBDC took 29.9s. Estimated remaining: 4h 49m 8s. Rate: 7.4 symbols/min [2025-10-09T17:29:54.159311] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T17:29:54.371604] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T17:29:54.402992] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-09T17:29:54.402896] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:54.472312] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:54.478896] [DEBUG] [LOCAL ] BBU: Loaded 5128 existing records from primary storage. [2025-10-09T17:29:54.479260] [INFO ] [MAIN ] BBU: Loaded 5128 existing records. [2025-10-09T17:29:54.675210] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:29:54.675499] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-09T17:29:54.675552] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-09T17:29:54.675813] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-09T17:29:54.675877] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-09T17:29:55.045807] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:55.196712] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-09T17:29:55.440942] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T17:29:55.891503] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T17:29:55.996749] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-09T17:29:56.590822] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T17:29:56.796721] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-09T17:29:57.596730] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-09T17:29:57.794406] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:29:57.794834] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-09T17:29:57.794971] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:29:57.795055] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-09T17:29:57.795129] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:29:57.795217] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-09T17:29:57.795294] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-09T17:29:57.795333] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-09T17:29:57.795389] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-09T17:29:57.795460] [INFO ] [MAIN ] Update Progress: 223/2373 symbols completed. BBT took 4.2s. Estimated remaining: 4h 48m 19s. Rate: 7.5 symbols/min [2025-10-09T17:29:57.949207] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T17:29:58.022226] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:29:58.037612] [DEBUG] [LOCAL ] BBUC: Loaded 13474 existing records from primary storage. [2025-10-09T17:29:58.037863] [INFO ] [MAIN ] BBUC: Loaded 13474 existing records. [2025-10-09T17:29:58.251146] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:29:58.251384] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-09T17:29:58.251432] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-09T17:29:58.251699] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-09T17:29:58.251759] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-09T17:29:58.401862] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-09T17:29:58.630834] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:29:59.196773] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-09T17:29:59.550252] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T17:29:59.772368] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T17:29:59.996739] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-09T17:30:00.796743] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-09T17:30:01.015168] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T17:30:01.596815] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-09T17:30:01.758965] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T17:30:02.248177] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T17:30:02.396729] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-09T17:30:03.055011] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T17:30:03.196744] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-09T17:30:03.992323] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T17:30:03.996666] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-09T17:30:04.796686] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-09T17:30:04.960419] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:30:05.349246] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T17:30:05.596745] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-09T17:30:06.396708] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-09T17:30:06.744764] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T17:30:07.194774] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T17:30:07.196667] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-09T17:30:07.849703] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T17:30:07.996745] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-09T17:30:08.456815] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T17:30:08.796730] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-09T17:30:09.574228] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T17:30:09.596735] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-09T17:30:09.981852] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-09T17:30:10.396731] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-09T17:30:11.196721] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-09T17:30:11.497819] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:30:11.499516] [INFO ] [REMOTE ] BBN: Full fetch complete (26018 records). [2025-10-09T17:30:11.499590] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-09T17:30:11.893184] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-09T17:30:11.898058] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-09T17:30:11.899038] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-09T17:30:11.899837] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-09T17:30:11.900106] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T17:30:11.904009] [DEBUG] [LOCAL ] BBN: Trimmed 26018 records to 18140 (keeping 200 days of data) [2025-10-09T17:30:11.996696] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-09T17:30:12.026790] [DEBUG] [LOCAL ] BBN: Primary data saved (18140 records). [2025-10-09T17:30:12.026938] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-09T17:30:12.027020] [INFO ] [MAIN ] Update Progress: 224/2373 symbols completed. BBN took 28.0s. Estimated remaining: 4h 49m 10s. Rate: 7.4 symbols/min [2025-10-09T17:30:12.206070] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:12.255080] [DEBUG] [LOCAL ] BBVA: Loaded 49165 existing records from primary storage. [2025-10-09T17:30:12.255454] [INFO ] [MAIN ] BBVA: Loaded 49165 existing records. [2025-10-09T17:30:12.431083] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:12.431278] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-09T17:30:12.431371] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-09T17:30:12.431709] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-09T17:30:12.431768] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-09T17:30:12.540224] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T17:30:12.798827] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-09T17:30:12.811724] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:13.596732] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-09T17:30:13.646688] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T17:30:14.274450] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T17:30:14.396721] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-09T17:30:15.150109] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T17:30:15.151544] [INFO ] [REMOTE ] BBU: Full fetch complete (6967 records). [2025-10-09T17:30:15.151613] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-09T17:30:15.152021] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:30:15.152103] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:30:15.152146] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:30:15.152184] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-09T17:30:15.152239] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-09T17:30:15.152274] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-10-09T17:30:15.152547] [DEBUG] [LOCAL ] BBU: Deleted derivative data file. [2025-10-09T17:30:15.152635] [INFO ] [MAIN ] Update Progress: 225/2373 symbols completed. BBU took 21.2s. Estimated remaining: 4h 48m 15s. Rate: 7.5 symbols/min [2025-10-09T17:30:15.205076] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-09T17:30:15.321538] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:15.348193] [DEBUG] [LOCAL ] BBW: Loaded 27086 existing records from primary storage. [2025-10-09T17:30:15.348461] [INFO ] [MAIN ] BBW: Loaded 27086 existing records. [2025-10-09T17:30:15.524245] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:15.524489] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-09T17:30:15.524535] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-09T17:30:15.524793] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-09T17:30:15.524850] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-09T17:30:15.872883] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:15.996730] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-09T17:30:16.796709] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-09T17:30:16.881222] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T17:30:17.233766] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T17:30:17.596719] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-09T17:30:18.345231] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:30:18.387537] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T17:30:18.396670] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-09T17:30:19.131521] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T17:30:19.196681] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-09T17:30:19.824665] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T17:30:19.996723] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-09T17:30:20.605071] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T17:30:20.796725] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-09T17:30:21.596722] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-09T17:30:21.700832] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T17:30:22.312196] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:30:22.313302] [INFO ] [REMOTE ] BBDO: Full fetch complete (7573 records). [2025-10-09T17:30:22.313371] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-09T17:30:22.401899] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-09T17:30:22.700729] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-09T17:30:22.700816] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-09T17:30:22.701025] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-09T17:30:22.701065] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-09T17:30:22.701453] [DEBUG] [LOCAL ] BBDO: Trimmed 7573 records to 5042 (keeping 200 days of data) [2025-10-09T17:30:22.730851] [DEBUG] [LOCAL ] BBDO: Primary data saved (5042 records). [2025-10-09T17:30:22.730948] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-09T17:30:22.731016] [INFO ] [MAIN ] Update Progress: 226/2373 symbols completed. BBDO took 50.3s. Estimated remaining: 4h 48m 2s. Rate: 7.5 symbols/min [2025-10-09T17:30:22.898765] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:22.953277] [DEBUG] [LOCAL ] BBWI: Loaded 53582 existing records from primary storage. [2025-10-09T17:30:22.953601] [INFO ] [MAIN ] BBWI: Loaded 53582 existing records. [2025-10-09T17:30:23.131700] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:23.131932] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-09T17:30:23.131980] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-09T17:30:23.132194] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-09T17:30:23.132252] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-09T17:30:23.205280] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-09T17:30:23.490399] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:23.996683] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-09T17:30:24.112598] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T17:30:24.567158] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-09T17:30:24.796705] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-09T17:30:25.360853] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T17:30:25.596692] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-09T17:30:25.994786] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T17:30:26.396765] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-09T17:30:27.196708] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-09T17:30:27.230334] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T17:30:27.232336] [INFO ] [REMOTE ] BBUC: Full fetch complete (18467 records). [2025-10-09T17:30:27.232451] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-09T17:30:27.576718] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T17:30:27.719873] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-09T17:30:27.719961] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-09T17:30:27.720302] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-09T17:30:27.720345] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-09T17:30:27.720938] [DEBUG] [LOCAL ] BBUC: Trimmed 18467 records to 13573 (keeping 200 days of data) [2025-10-09T17:30:27.812415] [DEBUG] [LOCAL ] BBUC: Primary data saved (13573 records). [2025-10-09T17:30:27.812568] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-09T17:30:27.812678] [INFO ] [MAIN ] Update Progress: 227/2373 symbols completed. BBUC took 30.0s. Estimated remaining: 4h 47m 26s. Rate: 7.5 symbols/min [2025-10-09T17:30:27.981743] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:27.996679] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-09T17:30:28.033689] [DEBUG] [LOCAL ] BBY: Loaded 53453 existing records from primary storage. [2025-10-09T17:30:28.034039] [INFO ] [MAIN ] BBY: Loaded 53453 existing records. [2025-10-09T17:30:28.212387] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:28.212675] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-09T17:30:28.212738] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-09T17:30:28.212981] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-09T17:30:28.213041] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-09T17:30:28.582826] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:28.599698] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T17:30:28.796714] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-09T17:30:29.575791] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T17:30:29.596664] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-09T17:30:29.713244] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T17:30:30.396784] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-09T17:30:30.978379] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T17:30:31.196700] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-09T17:30:31.996690] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-09T17:30:32.110001] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T17:30:32.752723] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T17:30:32.796695] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-09T17:30:32.882412] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T17:30:33.596698] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-09T17:30:33.971985] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T17:30:34.396735] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-09T17:30:35.196764] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-09T17:30:35.240533] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:30:35.996679] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-09T17:30:36.102912] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T17:30:36.347992] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T17:30:36.796714] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-09T17:30:37.596739] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-09T17:30:37.840392] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T17:30:37.967591] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T17:30:38.396778] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-09T17:30:39.196796] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-09T17:30:39.264320] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:30:39.763354] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T17:30:39.996713] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-09T17:30:40.764312] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T17:30:40.796677] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-09T17:30:41.596766] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-09T17:30:41.812163] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T17:30:42.396698] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-09T17:30:42.523388] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T17:30:42.956590] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T17:30:43.196712] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-09T17:30:43.996732] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-09T17:30:44.248102] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T17:30:44.628895] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T17:30:44.796767] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-09T17:30:45.596738] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-09T17:30:45.795297] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:30:45.798499] [INFO ] [REMOTE ] BBW: Full fetch complete (39602 records). [2025-10-09T17:30:45.798585] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-09T17:30:46.217031] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-09T17:30:46.217137] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-09T17:30:46.217662] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-09T17:30:46.217741] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-09T17:30:46.218709] [DEBUG] [LOCAL ] BBW: Trimmed 39602 records to 27318 (keeping 200 days of data) [2025-10-09T17:30:46.390965] [DEBUG] [LOCAL ] BBW: Primary data saved (27318 records). [2025-10-09T17:30:46.391106] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-09T17:30:46.391194] [INFO ] [MAIN ] Update Progress: 228/2373 symbols completed. BBW took 31.2s. Estimated remaining: 4h 48m 57s. Rate: 7.4 symbols/min [2025-10-09T17:30:46.425217] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-09T17:30:46.592887] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:46.646012] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T17:30:46.673834] [DEBUG] [LOCAL ] BC: Loaded 44121 existing records from primary storage. [2025-10-09T17:30:46.674231] [INFO ] [MAIN ] BC: Loaded 44121 existing records. [2025-10-09T17:30:46.895116] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:46.895341] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-09T17:30:46.895391] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-09T17:30:46.895784] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-09T17:30:46.895842] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-09T17:30:47.206285] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-09T17:30:47.342210] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:47.996796] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-09T17:30:48.383458] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T17:30:48.796749] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-09T17:30:49.232327] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (3.64 seconds). [2025-10-09T17:30:49.596706] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-09T17:30:50.584719] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:30:50.596203] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-09T17:30:50.959758] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T17:30:51.196743] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-09T17:30:51.961518] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (4.76 seconds). [2025-10-09T17:30:51.996673] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-09T17:30:52.858396] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T17:30:52.869044] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-09T17:30:53.462031] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:30:53.466471] [INFO ] [REMOTE ] BBWI: Full fetch complete (77441 records). [2025-10-09T17:30:53.466589] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-09T17:30:53.759286] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (5.76 seconds). [2025-10-09T17:30:53.779716] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-09T17:30:53.905967] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-09T17:30:53.906060] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-09T17:30:53.906927] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-09T17:30:53.906995] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-09T17:30:53.908453] [DEBUG] [LOCAL ] BBWI: Trimmed 77441 records to 53972 (keeping 200 days of data) [2025-10-09T17:30:54.248926] [DEBUG] [LOCAL ] BBWI: Primary data saved (53972 records). [2025-10-09T17:30:54.249069] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-09T17:30:54.249787] [INFO ] [MAIN ] Update Progress: 229/2373 symbols completed. BBWI took 31.5s. Estimated remaining: 4h 48m 47s. Rate: 7.4 symbols/min [2025-10-09T17:30:54.420125] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:54.457376] [DEBUG] [LOCAL ] BCAT: Loaded 34116 existing records from primary storage. [2025-10-09T17:30:54.457633] [INFO ] [MAIN ] BCAT: Loaded 34116 existing records. [2025-10-09T17:30:54.641869] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:54.642162] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-09T17:30:54.642252] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-09T17:30:54.642543] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-09T17:30:54.642605] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-09T17:30:54.947137] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-09T17:30:54.992188] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-09T17:30:55.069703] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:55.196665] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-09T17:30:55.402445] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (4.81 seconds). [2025-10-09T17:30:55.996715] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-09T17:30:56.610752] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-10-09T17:30:56.638602] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T17:30:56.642843] [INFO ] [REMOTE ] BBVA: Full fetch complete (71604 records). [2025-10-09T17:30:56.642984] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-09T17:30:56.799709] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-09T17:30:57.043859] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-09T17:30:57.043954] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-09T17:30:57.044767] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-09T17:30:57.044832] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-09T17:30:57.046239] [DEBUG] [LOCAL ] BBVA: Trimmed 71604 records to 49530 (keeping 200 days of data) [2025-10-09T17:30:57.358009] [DEBUG] [LOCAL ] BBVA: Primary data saved (49530 records). [2025-10-09T17:30:57.358196] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-09T17:30:57.358377] [INFO ] [MAIN ] Update Progress: 230/2373 symbols completed. BBVA took 45.3s. Estimated remaining: 4h 47m 53s. Rate: 7.4 symbols/min [2025-10-09T17:30:57.506181] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-09T17:30:57.583188] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:30:57.599932] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-09T17:30:57.614084] [DEBUG] [LOCAL ] BCC: Loaded 28199 existing records from primary storage. [2025-10-09T17:30:57.614377] [INFO ] [MAIN ] BCC: Loaded 28199 existing records. [2025-10-09T17:30:57.795168] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:30:57.795563] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-09T17:30:57.795697] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-09T17:30:57.806530] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-09T17:30:57.824081] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-09T17:30:57.857730] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T17:30:58.200538] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:30:58.396716] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-09T17:30:58.536290] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T17:30:58.851026] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T17:30:59.196740] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-09T17:30:59.607901] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:30:59.996718] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-09T17:31:00.390282] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:31:00.796780] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-09T17:31:01.596851] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-09T17:31:01.805757] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T17:31:02.396757] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-09T17:31:02.467270] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:31:02.596621] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T17:31:03.196713] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-09T17:31:03.996734] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-09T17:31:04.151049] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T17:31:04.536324] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T17:31:04.796749] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-09T17:31:05.131040] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T17:31:05.596770] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-09T17:31:06.396763] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-09T17:31:06.620278] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-09T17:31:06.625070] [INFO ] [REMOTE ] BBY: Full fetch complete (77229 records). [2025-10-09T17:31:06.625234] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-09T17:31:07.027167] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-09T17:31:07.027319] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-09T17:31:07.028489] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-09T17:31:07.028599] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-09T17:31:07.030377] [DEBUG] [LOCAL ] BBY: Trimmed 77229 records to 53840 (keeping 200 days of data) [2025-10-09T17:31:07.146071] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T17:31:07.239003] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-09T17:31:07.293192] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T17:31:07.419138] [DEBUG] [LOCAL ] BBY: Primary data saved (53840 records). [2025-10-09T17:31:07.419291] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-09T17:31:07.419403] [INFO ] [MAIN ] Update Progress: 231/2373 symbols completed. BBY took 39.6s. Estimated remaining: 4h 48m 3s. Rate: 7.4 symbols/min [2025-10-09T17:31:07.588396] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:07.640693] [DEBUG] [LOCAL ] BCE: Loaded 52209 existing records from primary storage. [2025-10-09T17:31:07.641060] [INFO ] [MAIN ] BCE: Loaded 52209 existing records. [2025-10-09T17:31:07.818588] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:31:07.818850] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-09T17:31:07.818907] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-09T17:31:07.819301] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-09T17:31:07.819364] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-09T17:31:08.007130] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-09T17:31:08.175673] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:08.796778] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-09T17:31:08.980904] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T17:31:09.440160] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T17:31:09.596712] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-09T17:31:10.396781] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-09T17:31:10.687446] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T17:31:10.915366] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-09T17:31:11.196788] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-09T17:31:11.996760] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-09T17:31:12.700635] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T17:31:12.796671] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-09T17:31:13.058409] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T17:31:13.458981] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (3.06 seconds). [2025-10-09T17:31:13.596730] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-09T17:31:14.356508] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T17:31:14.396747] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-09T17:31:15.031956] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T17:31:15.196734] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-09T17:31:15.735303] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T17:31:15.738324] [INFO ] [REMOTE ] BCAT: Full fetch complete (50009 records). [2025-10-09T17:31:15.738416] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-09T17:31:16.004290] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-09T17:31:16.122864] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-09T17:31:16.122943] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-09T17:31:16.123507] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-09T17:31:16.123547] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-09T17:31:16.124609] [DEBUG] [LOCAL ] BCAT: Trimmed 50009 records to 34322 (keeping 200 days of data) [2025-10-09T17:31:16.337400] [DEBUG] [LOCAL ] BCAT: Primary data saved (34322 records). [2025-10-09T17:31:16.337564] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-09T17:31:16.338172] [INFO ] [MAIN ] Update Progress: 232/2373 symbols completed. BCAT took 22.1s. Estimated remaining: 4h 48m 3s. Rate: 7.4 symbols/min [2025-10-09T17:31:16.515534] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:16.515759] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-10-09T17:31:16.515827] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-10-09T17:31:16.516101] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-09T17:31:16.516165] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-09T17:31:16.516308] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-10-09T17:31:16.516352] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-09T17:31:16.642079] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T17:31:16.803391] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-09T17:31:16.913249] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:17.596715] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-09T17:31:17.783964] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T17:31:18.043764] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T17:31:18.396772] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-09T17:31:19.069476] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:31:19.196720] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-09T17:31:19.681984] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T17:31:19.984463] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T17:31:19.996684] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-09T17:31:20.796770] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-09T17:31:21.457533] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:31:21.596725] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-09T17:31:22.169899] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T17:31:22.396733] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-09T17:31:23.134877] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T17:31:23.196721] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-09T17:31:23.956626] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T17:31:23.996680] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-09T17:31:24.093608] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T17:31:24.796721] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-09T17:31:25.473241] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T17:31:25.476670] [INFO ] [REMOTE ] BC: Full fetch complete (63603 records). [2025-10-09T17:31:25.476794] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-09T17:31:25.601838] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-09T17:31:25.877892] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-09T17:31:25.878130] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-09T17:31:25.878882] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-09T17:31:25.878948] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-09T17:31:25.880362] [DEBUG] [LOCAL ] BC: Trimmed 63603 records to 44402 (keeping 200 days of data) [2025-10-09T17:31:26.118464] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:31:26.180465] [DEBUG] [LOCAL ] BC: Primary data saved (44402 records). [2025-10-09T17:31:26.180616] [INFO ] [MAIN ] BC: Full history saved. [2025-10-09T17:31:26.181247] [INFO ] [MAIN ] Update Progress: 233/2373 symbols completed. BC took 39.8s. Estimated remaining: 4h 48m 11s. Rate: 7.4 symbols/min [2025-10-09T17:31:26.360638] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:26.390144] [DEBUG] [LOCAL ] BCO: Loaded 25786 existing records from primary storage. [2025-10-09T17:31:26.390437] [INFO ] [MAIN ] BCO: Loaded 25786 existing records. [2025-10-09T17:31:26.403187] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-09T17:31:26.593147] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:31:26.593405] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-09T17:31:26.593453] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-09T17:31:26.593708] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-09T17:31:26.593770] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-09T17:31:26.942769] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:27.196697] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-09T17:31:27.664486] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T17:31:27.996722] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-09T17:31:28.242342] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-09T17:31:28.260901] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T17:31:28.264151] [INFO ] [REMOTE ] BCC: Full fetch complete (40940 records). [2025-10-09T17:31:28.264299] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-09T17:31:28.653703] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-09T17:31:28.653804] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-09T17:31:28.654306] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-09T17:31:28.654347] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-09T17:31:28.655387] [DEBUG] [LOCAL ] BCC: Trimmed 40940 records to 28437 (keeping 200 days of data) [2025-10-09T17:31:28.800908] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-09T17:31:28.832949] [DEBUG] [LOCAL ] BCC: Primary data saved (28437 records). [2025-10-09T17:31:28.833072] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-09T17:31:28.833157] [INFO ] [MAIN ] Update Progress: 234/2373 symbols completed. BCC took 31.5s. Estimated remaining: 4h 47m 13s. Rate: 7.4 symbols/min [2025-10-09T17:31:29.008150] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:29.062475] [DEBUG] [LOCAL ] BCS: Loaded 53444 existing records from primary storage. [2025-10-09T17:31:29.062842] [INFO ] [MAIN ] BCS: Loaded 53444 existing records. [2025-10-09T17:31:29.266543] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:31:29.266934] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-09T17:31:29.266992] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-09T17:31:29.267405] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-09T17:31:29.267481] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-09T17:31:29.580502] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T17:31:29.601937] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-09T17:31:29.665346] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:30.396730] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-09T17:31:30.627239] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T17:31:30.685328] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T17:31:31.196793] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-09T17:31:31.641731] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T17:31:31.996760] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-09T17:31:32.796696] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-09T17:31:33.165096] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T17:31:33.287462] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T17:31:33.596776] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-09T17:31:34.396683] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-09T17:31:34.495603] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T17:31:34.553147] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T17:31:35.196718] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-09T17:31:35.996711] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-09T17:31:36.151542] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T17:31:36.796733] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-09T17:31:36.877862] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T17:31:37.331088] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T17:31:37.596739] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-09T17:31:38.380084] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T17:31:38.396670] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-09T17:31:38.714729] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T17:31:39.196785] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-09T17:31:39.996754] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-09T17:31:40.210044] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T17:31:40.332274] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T17:31:40.796770] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-09T17:31:41.154639] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T17:31:41.596756] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-09T17:31:42.396726] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-09T17:31:42.435844] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T17:31:42.935753] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T17:31:43.196737] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-09T17:31:43.407756] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:31:43.996799] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-09T17:31:44.796796] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-09T17:31:45.260954] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T17:31:45.449619] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-09T17:31:45.596751] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-09T17:31:46.396696] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-09T17:31:46.507282] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T17:31:46.711520] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T17:31:47.196689] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-09T17:31:47.282348] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T17:31:47.996736] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-09T17:31:48.805181] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-09T17:31:48.826956] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:31:49.596694] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-09T17:31:49.817854] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T17:31:49.900908] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T17:31:50.396697] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-09T17:31:50.804546] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T17:31:50.807860] [INFO ] [REMOTE ] BCH: Full fetch complete (41118 records). [2025-10-09T17:31:50.807946] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-09T17:31:51.196123] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-09T17:31:51.196226] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-09T17:31:51.196751] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-09T17:31:51.196916] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-09T17:31:51.196811] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-09T17:31:51.198779] [DEBUG] [LOCAL ] BCH: Trimmed 41118 records to 30038 (keeping 200 days of data) [2025-10-09T17:31:51.372729] [DEBUG] [LOCAL ] BCH: Primary data saved (30038 records). [2025-10-09T17:31:51.372869] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-09T17:31:51.372943] [INFO ] [MAIN ] Update Progress: 235/2373 symbols completed. BCH took 35.0s. Estimated remaining: 4h 49m 17s. Rate: 7.4 symbols/min [2025-10-09T17:31:51.540991] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:51.570912] [DEBUG] [LOCAL ] BCSF: Loaded 27944 existing records from primary storage. [2025-10-09T17:31:51.571176] [INFO ] [MAIN ] BCSF: Loaded 27944 existing records. [2025-10-09T17:31:51.763626] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:31:51.763873] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-09T17:31:51.763921] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-09T17:31:51.764134] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-09T17:31:51.764190] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-09T17:31:52.001867] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-09T17:31:52.148886] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:52.183484] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T17:31:52.248744] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T17:31:52.796715] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-09T17:31:53.596799] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-09T17:31:54.115178] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-09T17:31:54.396786] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-09T17:31:54.592080] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T17:31:54.998547] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T17:31:55.196730] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-09T17:31:55.996731] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-09T17:31:56.040029] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T17:31:56.796718] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-09T17:31:56.913601] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T17:31:56.918030] [INFO ] [REMOTE ] BCE: Full fetch complete (75947 records). [2025-10-09T17:31:56.918138] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-09T17:31:57.158227] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T17:31:57.324926] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-09T17:31:57.325010] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-09T17:31:57.325784] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-09T17:31:57.325850] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-09T17:31:57.327395] [DEBUG] [LOCAL ] BCE: Trimmed 75947 records to 52590 (keeping 200 days of data) [2025-10-09T17:31:57.614532] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-09T17:31:57.661635] [DEBUG] [LOCAL ] BCE: Primary data saved (52590 records). [2025-10-09T17:31:57.661779] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-09T17:31:57.663041] [INFO ] [MAIN ] Update Progress: 236/2373 symbols completed. BCE took 50.2s. Estimated remaining: 4h 48m 52s. Rate: 7.4 symbols/min [2025-10-09T17:31:57.833638] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:31:57.857850] [DEBUG] [LOCAL ] BCX: Loaded 21636 existing records from primary storage. [2025-10-09T17:31:57.858173] [INFO ] [MAIN ] BCX: Loaded 21636 existing records. [2025-10-09T17:31:58.074265] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:31:58.074532] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-09T17:31:58.074592] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-09T17:31:58.074907] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-09T17:31:58.074966] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-09T17:31:58.410589] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-09T17:31:58.466983] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:31:58.696720] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T17:31:58.733950] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T17:31:59.196718] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-09T17:31:59.620604] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T17:31:59.996724] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-09T17:32:00.551676] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T17:32:00.796744] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-09T17:32:01.596795] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-09T17:32:01.877877] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T17:32:01.882010] [INFO ] [REMOTE ] BCS: Full fetch complete (76943 records). [2025-10-09T17:32:01.882191] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-09T17:32:01.883109] [FATAL] [VALIDATOR ] BCS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:32:01.883246] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:32:01.883323] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:32:01.883399] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-09T17:32:01.883481] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-09T17:32:01.883554] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-10-09T17:32:01.883858] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-10-09T17:32:01.883962] [INFO ] [MAIN ] Update Progress: 237/2373 symbols completed. BCS took 33.1s. Estimated remaining: 4h 48m 9s. Rate: 7.4 symbols/min [2025-10-09T17:32:02.306043] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T17:32:02.396729] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-09T17:32:02.562475] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T17:32:02.564823] [INFO ] [REMOTE ] BCO: Full fetch complete (36377 records). [2025-10-09T17:32:02.564967] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-09T17:32:02.952518] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-09T17:32:02.952704] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-09T17:32:02.953248] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-09T17:32:02.953293] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-09T17:32:02.954091] [DEBUG] [LOCAL ] BCO: Trimmed 36377 records to 25899 (keeping 200 days of data) [2025-10-09T17:32:03.127375] [DEBUG] [LOCAL ] BCO: Primary data saved (25899 records). [2025-10-09T17:32:03.127521] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-09T17:32:03.127605] [INFO ] [MAIN ] Update Progress: 238/2373 symbols completed. BCO took 36.9s. Estimated remaining: 4h 46m 60s. Rate: 7.4 symbols/min [2025-10-09T17:32:03.196755] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-09T17:32:03.730931] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T17:32:03.996755] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-09T17:32:04.020108] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T17:32:04.796797] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-09T17:32:05.157590] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:32:05.596707] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-09T17:32:05.887774] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T17:32:06.396745] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-09T17:32:06.439991] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T17:32:07.196767] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-09T17:32:07.539949] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T17:32:07.996716] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-09T17:32:08.262923] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T17:32:08.796776] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-09T17:32:09.007019] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T17:32:09.596684] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-09T17:32:09.653236] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T17:32:10.396762] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-09T17:32:10.873165] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T17:32:11.196748] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-09T17:32:11.315528] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T17:32:11.996753] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-09T17:32:11.997186] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T17:32:12.796778] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-09T17:32:13.216680] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T17:32:13.219805] [INFO ] [REMOTE ] BCSF: Full fetch complete (38974 records). [2025-10-09T17:32:13.219882] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-09T17:32:13.587807] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-09T17:32:13.587895] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-09T17:32:13.588370] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-09T17:32:13.588431] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-09T17:32:13.589262] [DEBUG] [LOCAL ] BCSF: Trimmed 38974 records to 28234 (keeping 200 days of data) [2025-10-09T17:32:13.766922] [DEBUG] [LOCAL ] BCSF: Primary data saved (28234 records). [2025-10-09T17:32:13.767051] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-09T17:32:13.767556] [INFO ] [MAIN ] Update Progress: 239/2373 symbols completed. BCSF took 22.4s. Estimated remaining: 4h 47m 15s. Rate: 7.4 symbols/min [2025-10-09T17:32:14.124424] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:32:14.130394] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-09T17:32:14.912009] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T17:32:14.916434] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-09T17:32:15.964416] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T17:32:15.971467] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-09T17:32:17.072189] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:32:17.074528] [INFO ] [REMOTE ] BCX: Full fetch complete (33575 records). [2025-10-09T17:32:17.074617] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-09T17:32:17.475049] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-09T17:32:17.475133] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-09T17:32:17.475563] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-09T17:32:17.475603] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-09T17:32:17.476510] [DEBUG] [LOCAL ] BCX: Trimmed 33575 records to 21780 (keeping 200 days of data) [2025-10-09T17:32:17.617950] [DEBUG] [LOCAL ] BCX: Primary data saved (21780 records). [2025-10-09T17:32:17.618113] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-09T17:32:17.618200] [INFO ] [MAIN ] Update Progress: 240/2373 symbols completed. BCX took 20.0s. Estimated remaining: 4h 46m 29s. Rate: 7.4 symbols/min [2025-10-09T17:32:18.373186] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:18.368484] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:18.335701] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:18.367693] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:18.414606] [DEBUG] [LOCAL ] BDJ: Loaded 29178 existing records from primary storage. [2025-10-09T17:32:18.435500] [INFO ] [MAIN ] BDJ: Loaded 29178 existing records. [2025-10-09T17:32:18.487449] [DEBUG] [LOCAL ] BDC: Loaded 24540 existing records from primary storage. [2025-10-09T17:32:18.515045] [INFO ] [MAIN ] BDC: Loaded 24540 existing records. [2025-10-09T17:32:18.597035] [DEBUG] [LOCAL ] BDX: Loaded 52250 existing records from primary storage. [2025-10-09T17:32:18.608970] [INFO ] [MAIN ] BDX: Loaded 52250 existing records. [2025-10-09T17:32:18.686137] [DEBUG] [LOCAL ] BDN: Loaded 47560 existing records from primary storage. [2025-10-09T17:32:18.836012] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:32:18.768837] [INFO ] [MAIN ] BDN: Loaded 47560 existing records. [2025-10-09T17:32:18.904240] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-09T17:32:18.909675] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-09T17:32:18.937023] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-09T17:32:19.022932] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-09T17:32:19.098378] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:32:19.152017] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-09T17:32:19.200852] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-09T17:32:19.252826] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-09T17:32:19.253002] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-09T17:32:19.331480] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:32:19.449163] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:32:19.459704] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-09T17:32:19.470160] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-09T17:32:19.490957] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-09T17:32:19.485762] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-09T17:32:19.574203] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-09T17:32:19.588132] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-09T17:32:19.559568] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-09T17:32:19.669089] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-09T17:32:20.381981] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:20.426723] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-09T17:32:20.611121] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:20.666505] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-09T17:32:20.882894] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:20.906597] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-09T17:32:20.943847] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:20.944178] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-09T17:32:21.893491] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T17:32:21.900368] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-09T17:32:21.980360] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:32:21.986927] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-09T17:32:22.323210] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T17:32:22.332869] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-09T17:32:22.442344] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T17:32:22.453161] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-09T17:32:22.698323] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T17:32:22.703359] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-09T17:32:23.218807] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T17:32:23.225359] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-09T17:32:24.193792] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-09T17:32:24.204504] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-09T17:32:24.222116] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T17:32:24.260887] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T17:32:24.512292] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T17:32:24.796743] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-09T17:32:25.596680] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-09T17:32:25.859904] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T17:32:26.051857] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T17:32:26.396779] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-09T17:32:27.124571] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:32:27.196706] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-09T17:32:27.596460] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T17:32:27.996730] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-09T17:32:28.262483] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T17:32:28.796785] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-09T17:32:29.596694] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-09T17:32:29.680586] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T17:32:30.183140] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T17:32:30.396722] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-09T17:32:30.465276] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:32:31.196684] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-09T17:32:31.996736] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-09T17:32:32.143331] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T17:32:32.796737] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-09T17:32:33.022863] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T17:32:33.209838] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T17:32:33.596777] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-09T17:32:34.050392] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T17:32:34.396759] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-09T17:32:35.196710] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-09T17:32:35.247689] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T17:32:35.996707] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-09T17:32:36.374165] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T17:32:36.375193] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T17:32:36.796727] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-09T17:32:37.249396] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T17:32:37.596732] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-09T17:32:37.695419] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T17:32:38.396758] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-09T17:32:38.899156] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T17:32:39.196751] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-09T17:32:39.996795] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-09T17:32:40.108502] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:32:40.407986] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T17:32:40.796710] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-09T17:32:41.180354] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T17:32:41.596711] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-09T17:32:42.396688] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-09T17:32:42.488382] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T17:32:42.875625] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-09T17:32:43.196718] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-09T17:32:43.914807] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T17:32:43.996684] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-09T17:32:44.518155] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T17:32:44.521072] [INFO ] [REMOTE ] BDJ: Full fetch complete (43010 records). [2025-10-09T17:32:44.521158] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-09T17:32:44.801843] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-09T17:32:44.889182] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-09T17:32:44.889262] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-09T17:32:44.889795] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-09T17:32:44.889859] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-09T17:32:44.890740] [DEBUG] [LOCAL ] BDJ: Trimmed 43010 records to 29460 (keeping 200 days of data) [2025-10-09T17:32:45.060493] [DEBUG] [LOCAL ] BDJ: Primary data saved (29460 records). [2025-10-09T17:32:45.060638] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-09T17:32:45.061600] [INFO ] [MAIN ] Update Progress: 241/2373 symbols completed. BDJ took 27.4s. Estimated remaining: 4h 49m 12s. Rate: 7.4 symbols/min [2025-10-09T17:32:45.231699] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:45.287259] [DEBUG] [LOCAL ] BE: Loaded 53659 existing records from primary storage. [2025-10-09T17:32:45.287674] [INFO ] [MAIN ] BE: Loaded 53659 existing records. [2025-10-09T17:32:45.469445] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:32:45.469756] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-09T17:32:45.469901] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-09T17:32:45.470195] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-09T17:32:45.470254] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-09T17:32:45.606703] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-09T17:32:45.931420] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T17:32:46.003334] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:46.402903] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-09T17:32:46.416576] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T17:32:46.560619] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T17:32:46.565258] [INFO ] [REMOTE ] BDC: Full fetch complete (35825 records). [2025-10-09T17:32:46.565536] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-09T17:32:46.982058] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-09T17:32:46.982139] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-09T17:32:46.982615] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-09T17:32:46.982684] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-09T17:32:46.983462] [DEBUG] [LOCAL ] BDC: Trimmed 35825 records to 24705 (keeping 200 days of data) [2025-10-09T17:32:47.138808] [DEBUG] [LOCAL ] BDC: Primary data saved (24705 records). [2025-10-09T17:32:47.138942] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-09T17:32:47.139021] [INFO ] [MAIN ] Update Progress: 242/2373 symbols completed. BDC took 29.5s. Estimated remaining: 4h 48m 11s. Rate: 7.4 symbols/min [2025-10-09T17:32:47.201996] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-09T17:32:47.311350] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:32:47.311556] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-09T17:32:47.311600] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-09T17:32:47.311741] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-09T17:32:47.311786] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-09T17:32:47.311829] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-09T17:32:47.311864] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-09T17:32:47.690395] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:32:47.996693] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-09T17:32:48.278056] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T17:32:48.560438] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-09T17:32:48.796855] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-09T17:32:49.361197] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-09T17:32:49.596776] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-09T17:32:50.396731] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-09T17:32:50.731330] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-09T17:32:51.196684] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-09T17:32:51.637693] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-09T17:32:51.714634] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:32:51.996794] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-09T17:32:52.796779] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-09T17:32:52.983520] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T17:32:53.066619] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-09T17:32:53.596693] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-09T17:32:53.822536] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T17:32:53.908636] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-09T17:32:54.396697] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-09T17:32:54.822340] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T17:32:55.196753] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-09T17:32:55.996694] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-09T17:32:56.418589] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T17:32:56.796730] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-09T17:32:57.074234] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T17:32:57.137808] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-09T17:32:57.596722] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-09T17:32:58.396688] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-09T17:32:59.196692] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-09T17:32:59.277875] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:32:59.281967] [INFO ] [REMOTE ] BDN: Full fetch complete (69222 records). [2025-10-09T17:32:59.282083] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-09T17:32:59.645265] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T17:32:59.667111] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-09T17:32:59.667170] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-09T17:32:59.667940] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-09T17:32:59.668022] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-09T17:32:59.669281] [DEBUG] [LOCAL ] BDN: Trimmed 69222 records to 47913 (keeping 200 days of data) [2025-10-09T17:32:59.945449] [DEBUG] [LOCAL ] BDN: Primary data saved (47913 records). [2025-10-09T17:32:59.945616] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-09T17:32:59.946309] [INFO ] [MAIN ] Update Progress: 243/2373 symbols completed. BDN took 42.3s. Estimated remaining: 4h 48m 44s. Rate: 7.4 symbols/min [2025-10-09T17:33:00.009032] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-09T17:33:00.116129] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:00.167970] [DEBUG] [LOCAL ] BEKE: Loaded 53231 existing records from primary storage. [2025-10-09T17:33:00.168314] [INFO ] [MAIN ] BEKE: Loaded 53231 existing records. [2025-10-09T17:33:00.350442] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-09T17:33:00.350325] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:00.351843] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-09T17:33:00.351923] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-09T17:33:00.352361] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-09T17:33:00.352437] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-09T17:33:00.725084] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:00.761363] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-09T17:33:00.796706] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-09T17:33:01.596715] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-09T17:33:02.396738] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-09T17:33:02.623196] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-09T17:33:02.825994] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-09T17:33:03.103295] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T17:33:03.107679] [INFO ] [REMOTE ] BDX: Full fetch complete (75580 records). [2025-10-09T17:33:03.107815] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-09T17:33:03.203063] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-09T17:33:03.492064] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-09T17:33:03.492146] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-09T17:33:03.492944] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-09T17:33:03.493009] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-09T17:33:03.494453] [DEBUG] [LOCAL ] BDX: Trimmed 75580 records to 52620 (keeping 200 days of data) [2025-10-09T17:33:03.843190] [DEBUG] [LOCAL ] BDX: Primary data saved (52620 records). [2025-10-09T17:33:03.843360] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-09T17:33:03.844399] [INFO ] [MAIN ] Update Progress: 244/2373 symbols completed. BDX took 46.2s. Estimated remaining: 4h 47m 59s. Rate: 7.4 symbols/min [2025-10-09T17:33:04.021832] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:04.017686] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-09T17:33:04.022066] [DEBUG] [LOCAL ] BEN: No existing data file found in primary storage. [2025-10-09T17:33:04.022329] [WARN ] [MAIN ] BEN: No existing data found, performing full refresh instead. [2025-10-09T17:33:04.023275] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-09T17:33:04.023323] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-09T17:33:04.023368] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-10-09T17:33:04.023402] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-09T17:33:04.467802] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:04.796703] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-09T17:33:05.161704] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T17:33:05.596695] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-09T17:33:05.816487] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T17:33:06.396683] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-09T17:33:06.779821] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-09T17:33:06.784956] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-09T17:33:07.196682] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-09T17:33:07.474213] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T17:33:07.996722] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-09T17:33:08.720579] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T17:33:08.796673] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-09T17:33:09.596732] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-09T17:33:10.184543] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-09T17:33:10.266734] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T17:33:10.267403] [INFO ] [REMOTE ] BEDU: Full fetch complete (1419 records). [2025-10-09T17:33:10.267468] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-09T17:33:10.406612] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-09T17:33:10.448477] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-09T17:33:10.449427] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:33:10.449545] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:33:10.449606] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-09T17:33:10.449830] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-09T17:33:10.449987] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-09T17:33:10.450138] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-09T17:33:10.450239] [INFO ] [MAIN ] Update Progress: 245/2373 symbols completed. BEDU took 23.3s. Estimated remaining: 4h 47m 38s. Rate: 7.4 symbols/min [2025-10-09T17:33:10.670560] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:10.691492] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-09T17:33:10.745836] [DEBUG] [LOCAL ] BEP: Loaded 38922 existing records from primary storage. [2025-10-09T17:33:10.746243] [INFO ] [MAIN ] BEP: Loaded 38922 existing records. [2025-10-09T17:33:10.930277] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:10.930501] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-09T17:33:10.930549] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-09T17:33:10.930816] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-09T17:33:10.930875] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-09T17:33:11.206010] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-09T17:33:11.293055] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:11.996698] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-09T17:33:12.165266] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:33:12.796722] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-09T17:33:13.212119] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-09T17:33:13.282477] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T17:33:13.596692] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-09T17:33:14.396685] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-09T17:33:14.821295] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T17:33:15.077130] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T17:33:15.196782] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-09T17:33:15.999894] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-09T17:33:16.006201] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:33:16.383814] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:33:16.796773] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-09T17:33:17.596801] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-09T17:33:17.895520] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T17:33:18.304265] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T17:33:18.396677] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-09T17:33:19.196690] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-09T17:33:19.397108] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:33:19.996773] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-09T17:33:20.781769] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T17:33:20.782241] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-09T17:33:20.796938] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-09T17:33:20.797175] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-09T17:33:20.798393] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-09T17:33:21.250409] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-09T17:33:21.250506] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-09T17:33:21.251447] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-09T17:33:21.251515] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-09T17:33:21.253146] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54049 (keeping 200 days of data) [2025-10-09T17:33:21.517567] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T17:33:21.599062] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-09T17:33:21.655868] [DEBUG] [LOCAL ] BE: Primary data saved (54049 records). [2025-10-09T17:33:21.656017] [INFO ] [MAIN ] BE: Full history saved. [2025-10-09T17:33:21.656667] [INFO ] [MAIN ] Update Progress: 246/2373 symbols completed. BE took 36.6s. Estimated remaining: 4h 47m 56s. Rate: 7.4 symbols/min [2025-10-09T17:33:21.845406] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:21.845578] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-10-09T17:33:21.845665] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-10-09T17:33:21.845810] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-09T17:33:21.845865] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-09T17:33:21.845917] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-09T17:33:21.845952] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-09T17:33:22.296720] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:22.333830] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T17:33:22.396737] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-09T17:33:23.196727] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-09T17:33:23.296815] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T17:33:23.959131] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T17:33:23.996792] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-09T17:33:24.696077] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T17:33:24.796761] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-09T17:33:25.243548] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T17:33:25.596732] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-09T17:33:26.396752] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-09T17:33:26.556484] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T17:33:27.079593] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T17:33:27.196680] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-09T17:33:27.965556] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:33:27.996693] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-09T17:33:28.552684] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T17:33:28.796793] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-09T17:33:29.401151] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T17:33:29.596734] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-09T17:33:30.203890] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T17:33:30.396733] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-09T17:33:31.196705] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-09T17:33:31.467906] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:33:31.715217] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:33:31.996802] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-09T17:33:32.483274] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T17:33:32.796796] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-09T17:33:33.316267] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:33:33.596744] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-09T17:33:34.235407] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:33:34.396682] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-09T17:33:35.196700] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-09T17:33:35.239714] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:33:35.996705] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-09T17:33:36.112055] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T17:33:36.116500] [INFO ] [REMOTE ] BEN: Full fetch complete (76911 records). [2025-10-09T17:33:36.116626] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-09T17:33:36.539474] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-09T17:33:36.539576] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-09T17:33:36.540384] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-09T17:33:36.540450] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-09T17:33:36.542244] [DEBUG] [LOCAL ] BEN: Trimmed 76911 records to 53434 (keeping 200 days of data) [2025-10-09T17:33:36.746228] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T17:33:36.779438] [INFO ] [REMOTE ] BEP: Full fetch complete (58683 records). [2025-10-09T17:33:36.782775] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-09T17:33:36.802208] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-09T17:33:37.229854] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-09T17:33:37.230039] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-09T17:33:37.230807] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-09T17:33:37.230890] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-09T17:33:37.297246] [DEBUG] [LOCAL ] BEP: Trimmed 58683 records to 39259 (keeping 200 days of data) [2025-10-09T17:33:37.406044] [DEBUG] [LOCAL ] BEN: Primary data saved (53434 records). [2025-10-09T17:33:37.406619] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-09T17:33:37.406801] [INFO ] [MAIN ] Update Progress: 247/2373 symbols completed. BEN took 33.6s. Estimated remaining: 4h 48m 54s. Rate: 7.4 symbols/min [2025-10-09T17:33:37.589544] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:37.600848] [DEBUG] [LOCAL ] BEPH: Loaded 5349 existing records from primary storage. [2025-10-09T17:33:37.601295] [INFO ] [MAIN ] BEPH: Loaded 5349 existing records. [2025-10-09T17:33:37.894346] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:37.895845] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-09T17:33:37.895929] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-09T17:33:37.898627] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-09T17:33:37.899012] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-09T17:33:38.122466] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-09T17:33:38.221854] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-09T17:33:38.324993] [DEBUG] [LOCAL ] BEP: Primary data saved (39259 records). [2025-10-09T17:33:38.330847] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-09T17:33:38.341858] [INFO ] [MAIN ] Update Progress: 248/2373 symbols completed. BEP took 27.9s. Estimated remaining: 4h 47m 44s. Rate: 7.4 symbols/min [2025-10-09T17:33:38.566637] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:38.567455] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-09T17:33:38.716376] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T17:33:38.809588] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:38.818845] [DEBUG] [LOCAL ] BEPI: Loaded 3606 existing records from primary storage. [2025-10-09T17:33:38.819135] [INFO ] [MAIN ] BEPI: Loaded 3606 existing records. [2025-10-09T17:33:39.065363] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:39.065736] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-09T17:33:39.065811] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-09T17:33:39.066066] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-09T17:33:39.066139] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-09T17:33:39.201837] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-09T17:33:39.589308] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:39.888125] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T17:33:39.992600] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T17:33:40.002948] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-09T17:33:40.311768] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T17:33:40.488665] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-09T17:33:40.796718] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-09T17:33:41.360472] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T17:33:41.596808] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-09T17:33:42.079291] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T17:33:42.396719] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-09T17:33:42.862271] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T17:33:43.196767] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-09T17:33:43.866132] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T17:33:43.996780] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-09T17:33:44.479229] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T17:33:44.796758] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-09T17:33:45.430982] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T17:33:45.596736] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-09T17:33:46.396752] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-09T17:33:47.028302] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T17:33:47.196696] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-09T17:33:47.365266] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T17:33:47.370116] [INFO ] [REMOTE ] BEKE: Full fetch complete (77189 records). [2025-10-09T17:33:47.370305] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-09T17:33:47.753918] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T17:33:47.782032] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-09T17:33:47.782180] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-09T17:33:47.783108] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-09T17:33:47.783173] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-09T17:33:47.784538] [DEBUG] [LOCAL ] BEKE: Trimmed 77189 records to 53617 (keeping 200 days of data) [2025-10-09T17:33:47.998720] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-09T17:33:48.112674] [DEBUG] [LOCAL ] BEKE: Primary data saved (53617 records). [2025-10-09T17:33:48.112813] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-09T17:33:48.113569] [INFO ] [MAIN ] Update Progress: 249/2373 symbols completed. BEKE took 48.2s. Estimated remaining: 4h 47m 50s. Rate: 7.4 symbols/min [2025-10-09T17:33:48.279620] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:48.286130] [DEBUG] [LOCAL ] BEPJ: Loaded 3132 existing records from primary storage. [2025-10-09T17:33:48.286323] [INFO ] [MAIN ] BEPJ: Loaded 3132 existing records. [2025-10-09T17:33:48.445091] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T17:33:48.481831] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:48.481981] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-09T17:33:48.482078] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-09T17:33:48.482278] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-09T17:33:48.482336] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-09T17:33:48.802138] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-09T17:33:48.842507] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:49.419106] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T17:33:49.596706] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-09T17:33:50.396743] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-09T17:33:50.553862] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T17:33:50.554891] [INFO ] [REMOTE ] BEPH: Full fetch complete (7649 records). [2025-10-09T17:33:50.554960] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-09T17:33:50.906680] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-09T17:33:50.906771] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-09T17:33:50.906979] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-09T17:33:50.907017] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-09T17:33:50.907410] [DEBUG] [LOCAL ] BEPH: Trimmed 7649 records to 5383 (keeping 200 days of data) [2025-10-09T17:33:50.940218] [DEBUG] [LOCAL ] BEPH: Primary data saved (5383 records). [2025-10-09T17:33:50.940319] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-09T17:33:50.940394] [INFO ] [MAIN ] Update Progress: 250/2373 symbols completed. BEPH took 13.5s. Estimated remaining: 4h 46m 57s. Rate: 7.4 symbols/min [2025-10-09T17:33:51.049977] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T17:33:51.112827] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:33:51.147857] [DEBUG] [LOCAL ] BFAM: Loaded 33473 existing records from primary storage. [2025-10-09T17:33:51.148164] [INFO ] [MAIN ] BFAM: Loaded 33473 existing records. [2025-10-09T17:33:51.201901] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-09T17:33:51.340288] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:33:51.340572] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-09T17:33:51.340620] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-09T17:33:51.340848] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-09T17:33:51.340904] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-09T17:33:51.702066] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:33:51.926155] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T17:33:51.996684] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-09T17:33:52.421876] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T17:33:52.796739] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-09T17:33:53.596720] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-09T17:33:54.160673] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T17:33:54.208383] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:33:54.396734] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-09T17:33:54.848913] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T17:33:55.196724] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-09T17:33:55.996763] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-09T17:33:56.338678] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T17:33:56.796782] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-09T17:33:57.554084] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T17:33:57.596673] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-09T17:33:58.103990] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T17:33:58.396710] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-09T17:33:58.963775] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T17:33:59.196692] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-09T17:33:59.267545] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T17:33:59.530926] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-09T17:33:59.996726] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-09T17:34:00.472522] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T17:34:00.796727] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-09T17:34:01.358106] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T17:34:01.596755] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-09T17:34:02.126111] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-09T17:34:02.396793] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-09T17:34:03.196719] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-09T17:34:03.636016] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T17:34:03.996717] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-09T17:34:04.385454] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T17:34:04.796686] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-09T17:34:04.842378] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T17:34:05.596714] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-09T17:34:06.156475] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:34:06.287879] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T17:34:06.396713] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-09T17:34:07.196725] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-09T17:34:07.468256] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T17:34:07.513636] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-09T17:34:07.996717] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-09T17:34:08.796719] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-09T17:34:08.903550] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T17:34:09.350572] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T17:34:09.596714] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-09T17:34:09.974496] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-09T17:34:10.396730] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-09T17:34:11.196714] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-09T17:34:11.536318] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T17:34:11.759565] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T17:34:11.764012] [INFO ] [REMOTE ] BEPC: Full fetch complete (68675 records). [2025-10-09T17:34:11.764174] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-09T17:34:12.001869] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-09T17:34:12.164582] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-09T17:34:12.164696] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-09T17:34:12.165463] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-09T17:34:12.165518] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-09T17:34:12.166944] [DEBUG] [LOCAL ] BEPC: Trimmed 68675 records to 46858 (keeping 200 days of data) [2025-10-09T17:34:12.460741] [DEBUG] [LOCAL ] BEPC: Primary data saved (46858 records). [2025-10-09T17:34:12.460885] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-09T17:34:12.460959] [INFO ] [MAIN ] Update Progress: 251/2373 symbols completed. BEPC took 50.8s. Estimated remaining: 4h 48m 42s. Rate: 7.4 symbols/min [2025-10-09T17:34:12.629891] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:12.670863] [DEBUG] [LOCAL ] BFH: Loaded 41446 existing records from primary storage. [2025-10-09T17:34:12.671207] [INFO ] [MAIN ] BFH: Loaded 41446 existing records. [2025-10-09T17:34:12.752231] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T17:34:12.777889] [INFO ] [REMOTE ] BEPI: Full fetch complete (4834 records). [2025-10-09T17:34:12.778020] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-09T17:34:12.801823] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-09T17:34:12.992809] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:34:13.003482] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-09T17:34:13.008722] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-09T17:34:13.057246] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-09T17:34:13.108919] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-09T17:34:13.415271] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-09T17:34:13.441305] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-09T17:34:13.468311] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-09T17:34:13.480005] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-09T17:34:13.536523] [DEBUG] [LOCAL ] BEPI: Trimmed 4834 records to 3623 (keeping 200 days of data) [2025-10-09T17:34:13.602228] [DEBUG] [LOCAL ] BEPI: Primary data saved (3623 records). [2025-10-09T17:34:13.602625] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-09T17:34:13.613112] [INFO ] [MAIN ] Update Progress: 252/2373 symbols completed. BEPI took 35.3s. Estimated remaining: 4h 47m 35s. Rate: 7.4 symbols/min [2025-10-09T17:34:13.602385] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-09T17:34:13.660069] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:13.863276] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:13.890554] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T17:34:13.904155] [DEBUG] [LOCAL ] BFK: Loaded 13712 existing records from primary storage. [2025-10-09T17:34:13.904399] [INFO ] [MAIN ] BFK: Loaded 13712 existing records. [2025-10-09T17:34:14.090003] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-09T17:34:14.093697] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:34:14.095715] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-09T17:34:14.095771] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-09T17:34:14.096063] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-09T17:34:14.096122] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-09T17:34:14.401816] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-09T17:34:14.458206] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:14.781131] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-09T17:34:15.196769] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-09T17:34:15.919014] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T17:34:15.996768] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-09T17:34:16.796727] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-09T17:34:17.172161] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T17:34:17.278364] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T17:34:17.596741] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-09T17:34:17.989714] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T17:34:17.990406] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4458 records). [2025-10-09T17:34:17.990472] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-09T17:34:17.990846] [FATAL] [VALIDATOR ] BEPJ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:34:17.990927] [FATAL] [MAIN ] BEPJ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:34:17.990990] [WARN ] [MAIN ] BEPJ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:34:17.991061] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-09T17:34:17.991123] [DEBUG] [LOCAL ] BEPJ: No primary data file found to delete. [2025-10-09T17:34:17.991158] [INFO ] [LOCAL ] BEPJ: Starting deletion of derivative data. [2025-10-09T17:34:17.991405] [DEBUG] [LOCAL ] BEPJ: Deleted derivative data file. [2025-10-09T17:34:17.991535] [INFO ] [MAIN ] Update Progress: 253/2373 symbols completed. BEPJ took 29.9s. Estimated remaining: 4h 46m 55s. Rate: 7.4 symbols/min [2025-10-09T17:34:18.156157] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:18.205137] [DEBUG] [LOCAL ] BFLY: Loaded 51825 existing records from primary storage. [2025-10-09T17:34:18.205448] [INFO ] [MAIN ] BFLY: Loaded 51825 existing records. [2025-10-09T17:34:18.405343] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-09T17:34:18.405245] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:34:18.405804] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-09T17:34:18.405877] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-09T17:34:18.406833] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-09T17:34:18.406898] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-09T17:34:18.759477] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:19.196742] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-09T17:34:19.851401] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T17:34:19.996688] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-09T17:34:20.088786] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T17:34:20.477479] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T17:34:20.796772] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-09T17:34:21.596712] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-09T17:34:22.015706] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T17:34:22.396686] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-09T17:34:22.874232] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T17:34:23.107255] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T17:34:23.196733] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-09T17:34:23.996745] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-09T17:34:24.207539] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T17:34:24.796727] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-09T17:34:25.602203] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-09T17:34:25.621485] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:34:25.816466] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T17:34:26.396699] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-09T17:34:26.890474] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T17:34:26.893673] [INFO ] [REMOTE ] BFAM: Full fetch complete (46964 records). [2025-10-09T17:34:26.893758] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-09T17:34:27.201892] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-09T17:34:27.275358] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-09T17:34:27.275436] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-09T17:34:27.276015] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-09T17:34:27.276078] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-09T17:34:27.277175] [DEBUG] [LOCAL ] BFAM: Trimmed 46964 records to 33733 (keeping 200 days of data) [2025-10-09T17:34:27.374054] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T17:34:27.496782] [DEBUG] [LOCAL ] BFAM: Primary data saved (33733 records). [2025-10-09T17:34:27.496936] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-09T17:34:27.497038] [INFO ] [MAIN ] Update Progress: 254/2373 symbols completed. BFAM took 36.6s. Estimated remaining: 4h 46m 59s. Rate: 7.4 symbols/min [2025-10-09T17:34:27.663015] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:27.663156] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-10-09T17:34:27.663193] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-10-09T17:34:27.663297] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-09T17:34:27.663337] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-09T17:34:27.663376] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-09T17:34:27.663406] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-09T17:34:28.011341] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:28.006718] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-09T17:34:28.796687] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-09T17:34:29.032104] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T17:34:29.480261] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T17:34:29.596726] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-09T17:34:29.820199] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T17:34:30.344220] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T17:34:30.396733] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-09T17:34:30.888881] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-09T17:34:31.196707] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-09T17:34:31.996725] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-09T17:34:32.803941] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-09T17:34:32.809936] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T17:34:32.949401] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T17:34:33.534944] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T17:34:33.596775] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-09T17:34:34.396709] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-09T17:34:35.139943] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T17:34:35.196677] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-09T17:34:35.300300] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T17:34:35.765110] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T17:34:35.996728] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-09T17:34:36.796709] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-09T17:34:37.492314] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T17:34:37.596679] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-09T17:34:37.928711] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T17:34:38.372527] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T17:34:38.396668] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-09T17:34:39.167216] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T17:34:39.196675] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-09T17:34:39.996687] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-09T17:34:40.006278] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T17:34:40.796766] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-09T17:34:41.588173] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T17:34:41.596672] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-09T17:34:41.651172] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T17:34:42.347599] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T17:34:42.348976] [INFO ] [REMOTE ] BFS: Full fetch complete (12737 records). [2025-10-09T17:34:42.349116] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-09T17:34:42.349707] [FATAL] [VALIDATOR ] BFS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:34:42.349798] [FATAL] [MAIN ] BFS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:34:42.349879] [WARN ] [MAIN ] BFS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:34:42.349964] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-09T17:34:42.350047] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-10-09T17:34:42.350087] [INFO ] [LOCAL ] BFS: Starting deletion of derivative data. [2025-10-09T17:34:42.350144] [DEBUG] [LOCAL ] BFS: No derivative data file found to delete. [2025-10-09T17:34:42.350223] [INFO ] [MAIN ] Update Progress: 255/2373 symbols completed. BFS took 14.9s. Estimated remaining: 4h 47m 46s. Rate: 7.4 symbols/min [2025-10-09T17:34:42.401812] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-09T17:34:42.520246] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:42.534676] [DEBUG] [LOCAL ] BFZ: Loaded 11932 existing records from primary storage. [2025-10-09T17:34:42.534906] [INFO ] [MAIN ] BFZ: Loaded 11932 existing records. [2025-10-09T17:34:42.712096] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:34:42.712356] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-09T17:34:42.712411] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-09T17:34:42.712834] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-09T17:34:42.712894] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-09T17:34:43.078092] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:43.196702] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-09T17:34:43.996689] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-09T17:34:44.073558] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T17:34:44.285680] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T17:34:44.796722] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-09T17:34:45.253232] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T17:34:45.561409] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T17:34:45.596748] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-09T17:34:46.396687] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-09T17:34:46.470909] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T17:34:47.189494] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T17:34:47.196783] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-09T17:34:47.996801] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-09T17:34:48.151069] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T17:34:48.796720] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-09T17:34:49.490540] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T17:34:49.492588] [INFO ] [REMOTE ] BFK: Full fetch complete (19035 records). [2025-10-09T17:34:49.492706] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-09T17:34:49.600578] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-09T17:34:49.765855] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T17:34:49.923572] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-09T17:34:49.923690] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-09T17:34:49.924071] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-09T17:34:49.924116] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-09T17:34:49.924926] [DEBUG] [LOCAL ] BFK: Trimmed 19035 records to 13777 (keeping 200 days of data) [2025-10-09T17:34:50.013687] [DEBUG] [LOCAL ] BFK: Primary data saved (13777 records). [2025-10-09T17:34:50.013835] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-09T17:34:50.013920] [INFO ] [MAIN ] Update Progress: 256/2373 symbols completed. BFK took 36.4s. Estimated remaining: 4h 47m 34s. Rate: 7.4 symbols/min [2025-10-09T17:34:50.194362] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:34:50.242595] [DEBUG] [LOCAL ] BG: Loaded 50428 existing records from primary storage. [2025-10-09T17:34:50.242927] [INFO ] [MAIN ] BG: Loaded 50428 existing records. [2025-10-09T17:34:50.401061] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-09T17:34:50.423758] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:34:50.425067] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-09T17:34:50.425171] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-09T17:34:50.430763] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-09T17:34:50.435442] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-09T17:34:50.448583] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T17:34:50.794354] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:34:51.196735] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-09T17:34:51.939164] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T17:34:51.996690] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-09T17:34:52.129723] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T17:34:52.796761] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-09T17:34:53.205489] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T17:34:53.596721] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-09T17:34:54.396797] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-09T17:34:54.606059] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T17:34:54.689540] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T17:34:55.196719] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-09T17:34:55.996736] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-09T17:34:56.177887] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T17:34:56.522841] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T17:34:56.796693] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-09T17:34:56.857331] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T17:34:57.596722] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-09T17:34:58.396708] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-09T17:34:58.726988] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T17:34:59.196712] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-09T17:34:59.386383] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-09T17:34:59.389888] [INFO ] [REMOTE ] BFH: Full fetch complete (59679 records). [2025-10-09T17:34:59.390020] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-09T17:34:59.771141] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-09T17:34:59.771218] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-09T17:34:59.771870] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-09T17:34:59.771932] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-09T17:34:59.773196] [DEBUG] [LOCAL ] BFH: Trimmed 59679 records to 41731 (keeping 200 days of data) [2025-10-09T17:34:59.996749] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-09T17:35:00.035624] [DEBUG] [LOCAL ] BFH: Primary data saved (41731 records). [2025-10-09T17:35:00.035764] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-09T17:35:00.036576] [INFO ] [MAIN ] Update Progress: 257/2373 symbols completed. BFH took 47.6s. Estimated remaining: 4h 47m 41s. Rate: 7.4 symbols/min [2025-10-09T17:35:00.149855] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T17:35:00.226299] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:00.246022] [DEBUG] [LOCAL ] BGB: Loaded 17893 existing records from primary storage. [2025-10-09T17:35:00.246261] [INFO ] [MAIN ] BGB: Loaded 17893 existing records. [2025-10-09T17:35:00.432450] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:00.432803] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-09T17:35:00.432892] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-09T17:35:00.442328] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-09T17:35:00.455058] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-09T17:35:00.533835] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-09T17:35:00.805677] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-09T17:35:00.825867] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:01.596742] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-09T17:35:01.688571] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-09T17:35:01.914355] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-09T17:35:02.396707] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-09T17:35:02.830308] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T17:35:03.196781] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-09T17:35:03.996700] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-09T17:35:04.221673] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T17:35:04.486123] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-09T17:35:04.796689] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-09T17:35:05.596699] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-09T17:35:05.652880] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T17:35:05.759926] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T17:35:06.261981] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-09T17:35:06.396701] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-09T17:35:07.189199] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T17:35:07.196664] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-09T17:35:07.996710] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-09T17:35:08.796714] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-09T17:35:09.080389] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T17:35:09.155126] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T17:35:09.158970] [INFO ] [REMOTE ] BFLY: Full fetch complete (74934 records). [2025-10-09T17:35:09.159070] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-09T17:35:09.159853] [FATAL] [VALIDATOR ] BFLY: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:35:09.159944] [FATAL] [MAIN ] BFLY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:35:09.159987] [WARN ] [MAIN ] BFLY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:35:09.160051] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-09T17:35:09.160113] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-10-09T17:35:09.160151] [INFO ] [LOCAL ] BFLY: Starting deletion of derivative data. [2025-10-09T17:35:09.160373] [DEBUG] [LOCAL ] BFLY: Deleted derivative data file. [2025-10-09T17:35:09.160674] [INFO ] [MAIN ] Update Progress: 258/2373 symbols completed. BFLY took 51.2s. Estimated remaining: 4h 47m 41s. Rate: 7.4 symbols/min [2025-10-09T17:35:09.325560] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:09.345019] [DEBUG] [LOCAL ] BGH: Loaded 17188 existing records from primary storage. [2025-10-09T17:35:09.345253] [INFO ] [MAIN ] BGH: Loaded 17188 existing records. [2025-10-09T17:35:09.521998] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:09.522197] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-09T17:35:09.522243] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-09T17:35:09.522397] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-09T17:35:09.522435] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-09T17:35:09.601940] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-09T17:35:09.878969] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:10.033896] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T17:35:10.396734] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-09T17:35:10.669610] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T17:35:10.670982] [INFO ] [REMOTE ] BFZ: Full fetch complete (17716 records). [2025-10-09T17:35:10.671075] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-09T17:35:11.055055] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-09T17:35:11.055134] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-09T17:35:11.055463] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-09T17:35:11.055502] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-09T17:35:11.056050] [DEBUG] [LOCAL ] BFZ: Trimmed 17716 records to 11992 (keeping 200 days of data) [2025-10-09T17:35:11.133579] [DEBUG] [LOCAL ] BFZ: Primary data saved (11992 records). [2025-10-09T17:35:11.133733] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-09T17:35:11.133835] [INFO ] [MAIN ] Update Progress: 259/2373 symbols completed. BFZ took 28.8s. Estimated remaining: 4h 46m 42s. Rate: 7.4 symbols/min [2025-10-09T17:35:11.201407] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-09T17:35:11.313694] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:11.328473] [DEBUG] [LOCAL ] BGR: Loaded 13572 existing records from primary storage. [2025-10-09T17:35:11.328717] [INFO ] [MAIN ] BGR: Loaded 13572 existing records. [2025-10-09T17:35:11.459272] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T17:35:11.529681] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:11.529920] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-09T17:35:11.529970] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-09T17:35:11.530170] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-09T17:35:11.530232] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-09T17:35:11.896446] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:11.996677] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-09T17:35:12.301501] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T17:35:12.796688] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-09T17:35:13.014186] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T17:35:13.596679] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-09T17:35:13.967677] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:35:14.400974] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-09T17:35:14.401999] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T17:35:15.055293] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T17:35:15.196794] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-09T17:35:15.996724] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-09T17:35:16.121301] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T17:35:16.796700] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-09T17:35:16.966416] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T17:35:17.477021] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T17:35:17.596706] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-09T17:35:18.396761] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-09T17:35:18.476483] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-09T17:35:19.196687] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-09T17:35:19.345787] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T17:35:19.843466] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T17:35:19.996728] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-09T17:35:20.796774] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-09T17:35:21.600098] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-09T17:35:21.607181] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T17:35:21.628446] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T17:35:22.396688] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-09T17:35:22.570508] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T17:35:22.572683] [INFO ] [REMOTE ] BGB: Full fetch complete (26991 records). [2025-10-09T17:35:22.572758] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-09T17:35:22.938823] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-09T17:35:22.938909] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-09T17:35:22.939311] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-09T17:35:22.939353] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-09T17:35:22.940200] [DEBUG] [LOCAL ] BGB: Trimmed 26991 records to 18011 (keeping 200 days of data) [2025-10-09T17:35:23.050780] [DEBUG] [LOCAL ] BGB: Primary data saved (18011 records). [2025-10-09T17:35:23.050924] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-09T17:35:23.051005] [INFO ] [MAIN ] Update Progress: 260/2373 symbols completed. BGB took 23.0s. Estimated remaining: 4h 47m 5s. Rate: 7.4 symbols/min [2025-10-09T17:35:23.202092] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-09T17:35:23.225184] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:23.274254] [DEBUG] [LOCAL ] BGS: Loaded 50497 existing records from primary storage. [2025-10-09T17:35:23.274542] [INFO ] [MAIN ] BGS: Loaded 50497 existing records. [2025-10-09T17:35:23.457209] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:23.457449] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-09T17:35:23.457499] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-09T17:35:23.457811] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-09T17:35:23.457872] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-09T17:35:23.821583] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:23.996736] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-09T17:35:24.265375] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T17:35:24.287483] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T17:35:24.726608] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T17:35:24.796682] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-09T17:35:25.596714] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-09T17:35:25.647792] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T17:35:26.396724] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-09T17:35:27.196710] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-09T17:35:27.315291] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T17:35:27.338540] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-09T17:35:27.996722] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-09T17:35:28.796690] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-09T17:35:28.840152] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T17:35:28.960870] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:35:29.402162] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T17:35:29.596794] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-09T17:35:30.396769] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-09T17:35:31.196687] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-09T17:35:31.474583] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T17:35:31.512531] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T17:35:31.996686] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-09T17:35:32.034749] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T17:35:32.036241] [INFO ] [REMOTE ] BGR: Full fetch complete (20157 records). [2025-10-09T17:35:32.036311] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-09T17:35:32.427287] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-09T17:35:32.427404] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-09T17:35:32.428147] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-09T17:35:32.428213] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-09T17:35:32.429076] [DEBUG] [LOCAL ] BGR: Trimmed 20157 records to 13650 (keeping 200 days of data) [2025-10-09T17:35:32.523754] [DEBUG] [LOCAL ] BGR: Primary data saved (13650 records). [2025-10-09T17:35:32.523916] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-09T17:35:32.524107] [INFO ] [MAIN ] Update Progress: 261/2373 symbols completed. BGR took 21.4s. Estimated remaining: 4h 47m 8s. Rate: 7.4 symbols/min [2025-10-09T17:35:32.712875] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:32.722204] [DEBUG] [LOCAL ] BGSF: Loaded 7730 existing records from primary storage. [2025-10-09T17:35:32.722395] [INFO ] [MAIN ] BGSF: Loaded 7730 existing records. [2025-10-09T17:35:32.800242] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-09T17:35:32.900504] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:32.900865] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-09T17:35:32.900923] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-09T17:35:32.901150] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-09T17:35:32.901211] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-09T17:35:33.012861] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T17:35:33.265026] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:33.596725] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-09T17:35:34.396685] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-09T17:35:34.562177] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T17:35:34.593608] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T17:35:35.049384] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T17:35:35.196752] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-09T17:35:35.996777] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-09T17:35:36.179604] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T17:35:36.774588] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T17:35:36.796691] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-09T17:35:37.596690] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-09T17:35:37.739244] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-09T17:35:38.011346] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-09T17:35:38.396735] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-09T17:35:39.196736] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-09T17:35:39.388055] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T17:35:39.996796] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-09T17:35:40.796738] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-09T17:35:40.945607] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T17:35:41.358526] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T17:35:41.577419] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T17:35:41.596694] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-09T17:35:41.931913] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-09T17:35:42.396718] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-09T17:35:42.854178] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T17:35:43.196720] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-09T17:35:43.996713] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-09T17:35:44.796694] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-09T17:35:45.000303] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:35:45.004525] [INFO ] [REMOTE ] BG: Full fetch complete (72731 records). [2025-10-09T17:35:45.004684] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-09T17:35:45.113510] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T17:35:45.133531] [INFO ] [REMOTE ] BGH: Full fetch complete (22719 records). [2025-10-09T17:35:45.143894] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-09T17:35:45.609815] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-09T17:35:45.750448] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-09T17:35:45.777702] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-09T17:35:45.779014] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T17:35:45.778714] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-09T17:35:45.839413] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-09T17:35:45.840997] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-09T17:35:45.841169] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-09T17:35:45.841448] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-09T17:35:45.841723] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-09T17:35:45.842794] [DEBUG] [LOCAL ] BGH: Trimmed 22719 records to 17324 (keeping 200 days of data) [2025-10-09T17:35:45.842705] [DEBUG] [LOCAL ] BG: Trimmed 72731 records to 50781 (keeping 200 days of data) [2025-10-09T17:35:46.257565] [DEBUG] [LOCAL ] BG: Primary data saved (50781 records). [2025-10-09T17:35:46.258471] [INFO ] [MAIN ] BG: Full history saved. [2025-10-09T17:35:46.258903] [INFO ] [MAIN ] Update Progress: 262/2373 symbols completed. BG took 56.2s. Estimated remaining: 4h 47m 44s. Rate: 7.3 symbols/min [2025-10-09T17:35:46.400218] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-09T17:35:46.428475] [DEBUG] [LOCAL ] BGH: Primary data saved (17324 records). [2025-10-09T17:35:46.457248] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-09T17:35:46.457138] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:46.457413] [INFO ] [MAIN ] Update Progress: 263/2373 symbols completed. BGH took 37.3s. Estimated remaining: 4h 46m 32s. Rate: 7.4 symbols/min [2025-10-09T17:35:46.605025] [DEBUG] [LOCAL ] BGT: Loaded 16621 existing records from primary storage. [2025-10-09T17:35:46.652308] [INFO ] [MAIN ] BGT: Loaded 16621 existing records. [2025-10-09T17:35:46.652199] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:46.820901] [DEBUG] [LOCAL ] BGX: Loaded 11113 existing records from primary storage. [2025-10-09T17:35:46.832010] [INFO ] [MAIN ] BGX: Loaded 11113 existing records. [2025-10-09T17:35:46.852542] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:46.918827] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-09T17:35:46.931438] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-09T17:35:46.958799] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-09T17:35:46.969359] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-09T17:35:47.128262] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:47.153738] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-09T17:35:47.154204] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-09T17:35:47.180496] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-09T17:35:47.195544] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-09T17:35:47.436241] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T17:35:47.477188] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-09T17:35:47.602684] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:47.767937] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-09T17:35:47.875877] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:47.996681] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-09T17:35:48.185775] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T17:35:48.796749] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-09T17:35:48.901131] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T17:35:49.596700] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-09T17:35:49.836461] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T17:35:50.396723] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-09T17:35:51.151050] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T17:35:51.196671] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-09T17:35:51.231314] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T17:35:51.996720] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-09T17:35:52.395771] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T17:35:52.796714] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-09T17:35:53.596685] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-09T17:35:53.712736] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T17:35:53.913775] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T17:35:53.915748] [INFO ] [REMOTE ] BGSF: Full fetch complete (9320 records). [2025-10-09T17:35:53.915819] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-09T17:35:54.290519] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-09T17:35:54.290628] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-09T17:35:54.290998] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-09T17:35:54.291075] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-09T17:35:54.291596] [DEBUG] [LOCAL ] BGSF: Trimmed 9320 records to 7799 (keeping 200 days of data) [2025-10-09T17:35:54.337705] [DEBUG] [LOCAL ] BGSF: Primary data saved (7799 records). [2025-10-09T17:35:54.337818] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-09T17:35:54.337900] [INFO ] [MAIN ] Update Progress: 264/2373 symbols completed. BGSF took 21.8s. Estimated remaining: 4h 46m 22s. Rate: 7.4 symbols/min [2025-10-09T17:35:54.401856] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-09T17:35:54.459345] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T17:35:54.567996] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:35:54.591092] [DEBUG] [LOCAL ] BGY: Loaded 21967 existing records from primary storage. [2025-10-09T17:35:54.591482] [INFO ] [MAIN ] BGY: Loaded 21967 existing records. [2025-10-09T17:35:54.793476] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:35:54.793806] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-09T17:35:54.793869] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-09T17:35:54.794122] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-09T17:35:54.794180] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-09T17:35:55.148759] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:35:55.196691] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-09T17:35:55.466341] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T17:35:55.996686] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-09T17:35:56.055444] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T17:35:56.796720] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-09T17:35:57.596791] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-09T17:35:57.774943] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T17:35:57.933545] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T17:35:58.351950] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T17:35:58.396694] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-09T17:35:59.196765] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-09T17:35:59.996691] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-09T17:36:00.055001] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:36:00.083454] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T17:36:00.796713] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-09T17:36:00.925258] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T17:36:01.596714] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-09T17:36:02.396698] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-09T17:36:02.802089] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T17:36:03.175312] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T17:36:03.196672] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-09T17:36:03.317231] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-09T17:36:03.748485] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T17:36:03.996712] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-09T17:36:04.796744] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-09T17:36:04.891028] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T17:36:05.596701] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-09T17:36:06.188570] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T17:36:06.204617] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T17:36:06.396712] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-09T17:36:07.196624] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-09T17:36:07.410341] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T17:36:07.996742] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-09T17:36:08.182570] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T17:36:08.796734] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-09T17:36:08.990317] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T17:36:09.596759] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-09T17:36:09.659539] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T17:36:10.396726] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-09T17:36:11.176929] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T17:36:11.196675] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-09T17:36:11.320911] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T17:36:11.996688] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-09T17:36:12.308383] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T17:36:12.796706] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-09T17:36:13.140024] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T17:36:13.141961] [INFO ] [REMOTE ] BGX: Full fetch complete (16398 records). [2025-10-09T17:36:13.142035] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-09T17:36:13.504587] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-09T17:36:13.504763] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-09T17:36:13.505107] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-09T17:36:13.505158] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-09T17:36:13.505687] [DEBUG] [LOCAL ] BGX: Trimmed 16398 records to 11222 (keeping 200 days of data) [2025-10-09T17:36:13.575273] [DEBUG] [LOCAL ] BGX: Primary data saved (11222 records). [2025-10-09T17:36:13.575409] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-09T17:36:13.575506] [INFO ] [MAIN ] Update Progress: 265/2373 symbols completed. BGX took 27.1s. Estimated remaining: 4h 47m 42s. Rate: 7.3 symbols/min [2025-10-09T17:36:13.605969] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-09T17:36:13.749434] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:13.766061] [DEBUG] [LOCAL ] BH: Loaded 16182 existing records from primary storage. [2025-10-09T17:36:13.766292] [INFO ] [MAIN ] BH: Loaded 16182 existing records. [2025-10-09T17:36:13.959091] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:13.959319] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-09T17:36:13.959374] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-09T17:36:13.959591] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-09T17:36:13.959681] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-09T17:36:14.335928] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:14.396690] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-09T17:36:14.580450] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T17:36:14.725132] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T17:36:15.167008] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T17:36:15.196678] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-09T17:36:15.996728] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-09T17:36:16.259176] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T17:36:16.796697] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-09T17:36:17.132570] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T17:36:17.596686] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-09T17:36:17.866201] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T17:36:18.396719] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-09T17:36:18.423123] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T17:36:19.196730] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-09T17:36:19.403901] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T17:36:19.996694] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-09T17:36:20.198682] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T17:36:20.755538] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T17:36:20.796681] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-09T17:36:21.596675] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-09T17:36:21.907692] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T17:36:22.392308] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-09T17:36:22.393976] [INFO ] [REMOTE ] BGT: Full fetch complete (24266 records). [2025-10-09T17:36:22.394066] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-09T17:36:22.405320] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-09T17:36:22.787883] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-09T17:36:22.788018] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-09T17:36:22.788487] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-09T17:36:22.788554] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-09T17:36:22.789472] [DEBUG] [LOCAL ] BGT: Trimmed 24266 records to 16689 (keeping 200 days of data) [2025-10-09T17:36:22.892406] [DEBUG] [LOCAL ] BGT: Primary data saved (16689 records). [2025-10-09T17:36:22.892558] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-09T17:36:22.892677] [INFO ] [MAIN ] Update Progress: 266/2373 symbols completed. BGT took 36.6s. Estimated remaining: 4h 47m 43s. Rate: 7.3 symbols/min [2025-10-09T17:36:23.070800] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:23.104274] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T17:36:23.121141] [DEBUG] [LOCAL ] BHC: Loaded 46776 existing records from primary storage. [2025-10-09T17:36:23.121485] [INFO ] [MAIN ] BHC: Loaded 46776 existing records. [2025-10-09T17:36:23.201875] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-09T17:36:23.304808] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:23.305035] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-09T17:36:23.305085] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-09T17:36:23.305386] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-09T17:36:23.305447] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-09T17:36:23.677393] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:23.996724] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-09T17:36:24.251114] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T17:36:24.253373] [INFO ] [REMOTE ] BGY: Full fetch complete (33014 records). [2025-10-09T17:36:24.253447] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-09T17:36:24.637370] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-09T17:36:24.637482] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-09T17:36:24.638017] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-09T17:36:24.638080] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-09T17:36:24.638966] [DEBUG] [LOCAL ] BGY: Trimmed 33014 records to 22233 (keeping 200 days of data) [2025-10-09T17:36:24.771122] [DEBUG] [LOCAL ] BGY: Primary data saved (22233 records). [2025-10-09T17:36:24.771248] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-09T17:36:24.771330] [INFO ] [MAIN ] Update Progress: 267/2373 symbols completed. BGY took 30.4s. Estimated remaining: 4h 46m 45s. Rate: 7.3 symbols/min [2025-10-09T17:36:24.801817] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-09T17:36:24.882983] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T17:36:24.957611] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:24.981320] [DEBUG] [LOCAL ] BHE: Loaded 24052 existing records from primary storage. [2025-10-09T17:36:24.981573] [INFO ] [MAIN ] BHE: Loaded 24052 existing records. [2025-10-09T17:36:25.158808] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:25.158994] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-09T17:36:25.159040] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-09T17:36:25.159222] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-09T17:36:25.159279] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-09T17:36:25.523611] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:25.596673] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-09T17:36:26.405293] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-09T17:36:26.410356] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T17:36:26.865519] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T17:36:27.182449] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T17:36:27.196665] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-09T17:36:27.996697] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-09T17:36:28.122470] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T17:36:28.796737] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-09T17:36:29.333607] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T17:36:29.596706] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-09T17:36:29.896027] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T17:36:30.396694] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-09T17:36:30.656348] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T17:36:31.196723] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-09T17:36:31.885246] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T17:36:31.889869] [INFO ] [REMOTE ] BGS: Full fetch complete (72492 records). [2025-10-09T17:36:31.890038] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-09T17:36:31.997036] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-09T17:36:32.446174] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T17:36:32.471396] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-09T17:36:32.478540] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-09T17:36:32.480631] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-09T17:36:32.480766] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-09T17:36:32.482771] [DEBUG] [LOCAL ] BGS: Trimmed 72492 records to 50853 (keeping 200 days of data) [2025-10-09T17:36:32.796944] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-09T17:36:32.905505] [DEBUG] [LOCAL ] BGS: Primary data saved (50853 records). [2025-10-09T17:36:32.905689] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-09T17:36:32.906809] [INFO ] [MAIN ] Update Progress: 268/2373 symbols completed. BGS took 1m 10s. Estimated remaining: 4h 46m 36s. Rate: 7.3 symbols/min [2025-10-09T17:36:33.088804] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:33.115045] [DEBUG] [LOCAL ] BHK: Loaded 23435 existing records from primary storage. [2025-10-09T17:36:33.115285] [INFO ] [MAIN ] BHK: Loaded 23435 existing records. [2025-10-09T17:36:33.260286] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T17:36:33.323340] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:33.323581] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-09T17:36:33.323636] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-09T17:36:33.323976] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-09T17:36:33.324049] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-09T17:36:33.602016] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-09T17:36:33.675287] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:34.049163] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T17:36:34.396701] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-09T17:36:35.022568] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T17:36:35.196700] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-09T17:36:35.500351] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T17:36:35.996726] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-09T17:36:36.096816] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T17:36:36.796729] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-09T17:36:37.439096] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:36:37.596738] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-09T17:36:37.764285] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T17:36:38.396750] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-09T17:36:39.196698] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-09T17:36:39.293565] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T17:36:39.349020] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T17:36:39.996734] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-09T17:36:40.546569] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T17:36:40.797677] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-09T17:36:40.799560] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T17:36:41.596688] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-09T17:36:41.752497] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T17:36:42.396746] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-09T17:36:42.630744] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T17:36:43.196712] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-09T17:36:43.945869] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T17:36:43.996675] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-09T17:36:44.408559] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T17:36:44.796689] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-09T17:36:45.520458] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T17:36:45.596682] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-09T17:36:45.873477] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T17:36:46.396722] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-09T17:36:46.925540] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T17:36:47.196687] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-09T17:36:47.393527] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T17:36:47.828350] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T17:36:47.830018] [INFO ] [REMOTE ] BH: Full fetch complete (19670 records). [2025-10-09T17:36:47.830087] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-09T17:36:47.998171] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-09T17:36:48.229872] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-09T17:36:48.229951] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-09T17:36:48.230346] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-09T17:36:48.230389] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-09T17:36:48.231001] [DEBUG] [LOCAL ] BH: Trimmed 19670 records to 16265 (keeping 200 days of data) [2025-10-09T17:36:48.328109] [DEBUG] [LOCAL ] BH: Primary data saved (16265 records). [2025-10-09T17:36:48.328258] [INFO ] [MAIN ] BH: Full history saved. [2025-10-09T17:36:48.328341] [INFO ] [MAIN ] Update Progress: 269/2373 symbols completed. BH took 34.8s. Estimated remaining: 4h 47m 25s. Rate: 7.3 symbols/min [2025-10-09T17:36:48.506030] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:48.554163] [DEBUG] [LOCAL ] BHP: Loaded 53372 existing records from primary storage. [2025-10-09T17:36:48.554507] [INFO ] [MAIN ] BHP: Loaded 53372 existing records. [2025-10-09T17:36:48.739438] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:48.739719] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-09T17:36:48.739776] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-09T17:36:48.740064] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-09T17:36:48.740135] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-09T17:36:48.799300] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-09T17:36:49.135769] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:49.136313] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T17:36:49.596772] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-09T17:36:50.396684] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-09T17:36:50.481906] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T17:36:50.537822] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T17:36:50.539911] [INFO ] [REMOTE ] BHE: Full fetch complete (36375 records). [2025-10-09T17:36:50.539991] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-09T17:36:50.917556] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-09T17:36:50.917634] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-09T17:36:50.918175] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-09T17:36:50.918236] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-09T17:36:50.919051] [DEBUG] [LOCAL ] BHE: Trimmed 36375 records to 24178 (keeping 200 days of data) [2025-10-09T17:36:51.065971] [DEBUG] [LOCAL ] BHE: Primary data saved (24178 records). [2025-10-09T17:36:51.066102] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-09T17:36:51.066182] [INFO ] [MAIN ] Update Progress: 270/2373 symbols completed. BHE took 26.3s. Estimated remaining: 4h 46m 34s. Rate: 7.3 symbols/min [2025-10-09T17:36:51.206692] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-09T17:36:51.240135] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:36:51.257097] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-09T17:36:51.280028] [DEBUG] [LOCAL ] BHR: Loaded 21855 existing records from primary storage. [2025-10-09T17:36:51.280274] [INFO ] [MAIN ] BHR: Loaded 21855 existing records. [2025-10-09T17:36:51.456947] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:36:51.457195] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-09T17:36:51.457248] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-09T17:36:51.457489] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-09T17:36:51.457546] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-09T17:36:51.821093] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:36:51.996694] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-09T17:36:52.796731] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-09T17:36:52.878131] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T17:36:53.215973] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T17:36:53.596765] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-09T17:36:54.396758] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-09T17:36:54.484304] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:36:55.196751] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-09T17:36:55.468741] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:36:55.502568] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-09T17:36:55.996721] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-09T17:36:56.269243] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T17:36:56.796713] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-09T17:36:57.605681] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-09T17:36:57.639537] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T17:36:58.292879] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:36:58.396682] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-09T17:36:58.863896] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T17:36:59.196771] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-09T17:36:59.996687] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-09T17:37:00.027607] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T17:37:00.031722] [INFO ] [REMOTE ] BHC: Full fetch complete (67107 records). [2025-10-09T17:37:00.031846] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-09T17:37:00.446871] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-09T17:37:00.447559] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T17:37:00.447915] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-09T17:37:00.454425] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-09T17:37:00.454620] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-09T17:37:00.456242] [DEBUG] [LOCAL ] BHC: Trimmed 67107 records to 47131 (keeping 200 days of data) [2025-10-09T17:37:00.722732] [DEBUG] [LOCAL ] BHC: Primary data saved (47131 records). [2025-10-09T17:37:00.722870] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-09T17:37:00.722951] [INFO ] [MAIN ] Update Progress: 271/2373 symbols completed. BHC took 37.8s. Estimated remaining: 4h 46m 37s. Rate: 7.3 symbols/min [2025-10-09T17:37:00.797588] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-09T17:37:00.895863] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:00.896032] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-09T17:37:00.896070] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-09T17:37:00.896236] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-09T17:37:00.896278] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-09T17:37:00.896322] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-09T17:37:00.896354] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-09T17:37:01.189338] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:37:01.273602] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:01.596714] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-09T17:37:01.877438] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T17:37:02.396736] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-09T17:37:03.196688] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-09T17:37:03.477056] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T17:37:03.480351] [INFO ] [REMOTE ] BHK: Full fetch complete (30588 records). [2025-10-09T17:37:03.480475] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-09T17:37:03.617316] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T17:37:03.897157] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-09T17:37:03.897237] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-09T17:37:03.897667] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-09T17:37:03.897728] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-09T17:37:03.898485] [DEBUG] [LOCAL ] BHK: Trimmed 30588 records to 23537 (keeping 200 days of data) [2025-10-09T17:37:03.996811] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-09T17:37:04.046826] [DEBUG] [LOCAL ] BHK: Primary data saved (23537 records). [2025-10-09T17:37:04.046988] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-09T17:37:04.047077] [INFO ] [MAIN ] Update Progress: 272/2373 symbols completed. BHK took 31.1s. Estimated remaining: 4h 45m 52s. Rate: 7.3 symbols/min [2025-10-09T17:37:04.218096] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:04.265865] [DEBUG] [LOCAL ] BHVN: Loaded 50190 existing records from primary storage. [2025-10-09T17:37:04.266224] [INFO ] [MAIN ] BHVN: Loaded 50190 existing records. [2025-10-09T17:37:04.440608] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T17:37:04.466937] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:37:04.472999] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-09T17:37:04.473058] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-09T17:37:04.473435] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-09T17:37:04.473494] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-09T17:37:04.798928] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-09T17:37:04.822108] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:05.596738] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-09T17:37:05.790176] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T17:37:05.971000] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-09T17:37:05.987408] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T17:37:06.396734] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-09T17:37:07.196731] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-09T17:37:07.973394] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T17:37:07.996694] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-09T17:37:08.066757] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:37:08.796721] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-09T17:37:09.283845] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T17:37:09.596725] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-09T17:37:09.805468] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T17:37:10.396769] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-09T17:37:11.196688] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-09T17:37:11.333694] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-09T17:37:11.392461] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T17:37:11.996821] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-09T17:37:12.313312] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-09T17:37:12.394970] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T17:37:12.796800] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-09T17:37:13.182768] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-09T17:37:13.596796] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-09T17:37:14.396759] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-09T17:37:15.196686] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-09T17:37:15.480532] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T17:37:15.543713] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T17:37:15.996739] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-09T17:37:16.146065] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-09T17:37:16.796718] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-09T17:37:17.596754] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-09T17:37:18.026633] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T17:37:18.035146] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-09T17:37:18.396686] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-09T17:37:18.473386] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T17:37:19.196743] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-09T17:37:19.996698] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-09T17:37:20.271259] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:37:20.368582] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T17:37:20.796742] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-09T17:37:21.507408] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:37:21.596723] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-09T17:37:21.815849] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T17:37:21.818555] [INFO ] [REMOTE ] BHR: Full fetch complete (31243 records). [2025-10-09T17:37:21.818631] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-09T17:37:22.186985] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-09T17:37:22.187081] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-09T17:37:22.187516] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-09T17:37:22.187559] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-09T17:37:22.188985] [DEBUG] [LOCAL ] BHR: Trimmed 31243 records to 22080 (keeping 200 days of data) [2025-10-09T17:37:22.327505] [DEBUG] [LOCAL ] BHR: Primary data saved (22080 records). [2025-10-09T17:37:22.327632] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-09T17:37:22.327765] [INFO ] [MAIN ] Update Progress: 273/2373 symbols completed. BHR took 31.3s. Estimated remaining: 4h 47m 1s. Rate: 7.3 symbols/min [2025-10-09T17:37:22.402733] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-09T17:37:22.509703] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:22.566589] [DEBUG] [LOCAL ] BILL: Loaded 52405 existing records from primary storage. [2025-10-09T17:37:22.566970] [INFO ] [MAIN ] BILL: Loaded 52405 existing records. [2025-10-09T17:37:22.745263] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:37:22.746117] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-09T17:37:22.746175] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-09T17:37:22.746409] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-09T17:37:22.746467] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-09T17:37:22.823390] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T17:37:23.113896] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:23.141500] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T17:37:23.196673] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-09T17:37:23.996702] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-09T17:37:24.796783] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-09T17:37:25.012204] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T17:37:25.596714] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-09T17:37:25.838959] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T17:37:26.040662] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T17:37:26.396743] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-09T17:37:26.647291] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T17:37:26.731417] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T17:37:27.196801] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-09T17:37:27.996781] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-09T17:37:28.592773] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T17:37:28.796696] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-09T17:37:28.938936] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T17:37:29.229299] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-09T17:37:29.596709] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-09T17:37:30.036711] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T17:37:30.396781] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-09T17:37:31.196762] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-09T17:37:31.996746] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-09T17:37:32.220355] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T17:37:32.559327] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T17:37:32.560105] [INFO ] [REMOTE ] BHV: Full fetch complete (1381 records). [2025-10-09T17:37:32.560173] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-09T17:37:32.744513] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-09T17:37:32.744744] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:37:32.744817] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:37:32.744931] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-09T17:37:32.745006] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-09T17:37:32.745045] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-09T17:37:32.745099] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-09T17:37:32.745182] [INFO ] [MAIN ] Update Progress: 274/2373 symbols completed. BHV took 32.0s. Estimated remaining: 4h 47m 10s. Rate: 7.3 symbols/min [2025-10-09T17:37:32.809055] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-09T17:37:32.989149] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:33.015912] [DEBUG] [LOCAL ] BIO: Loaded 24324 existing records from primary storage. [2025-10-09T17:37:33.016269] [INFO ] [MAIN ] BIO: Loaded 24324 existing records. [2025-10-09T17:37:33.150863] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-09T17:37:33.189941] [INFO ] [REMOTE ] BHP: Full fetch complete (77267 records). [2025-10-09T17:37:33.199811] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-09T17:37:33.221332] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:37:33.298855] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-09T17:37:33.310489] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-09T17:37:33.334101] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-09T17:37:33.349830] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-09T17:37:33.607078] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-09T17:37:34.015606] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-09T17:37:34.047457] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-09T17:37:34.048334] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-09T17:37:34.048415] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-09T17:37:34.047403] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:34.050056] [DEBUG] [LOCAL ] BHP: Trimmed 77267 records to 53762 (keeping 200 days of data) [2025-10-09T17:37:34.385449] [DEBUG] [LOCAL ] BHP: Primary data saved (53762 records). [2025-10-09T17:37:34.385584] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-09T17:37:34.386194] [INFO ] [MAIN ] Update Progress: 275/2373 symbols completed. BHP took 46.1s. Estimated remaining: 4h 46m 12s. Rate: 7.3 symbols/min [2025-10-09T17:37:34.417323] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-09T17:37:34.562988] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:34.605350] [DEBUG] [LOCAL ] BIP: Loaded 39333 existing records from primary storage. [2025-10-09T17:37:34.605680] [INFO ] [MAIN ] BIP: Loaded 39333 existing records. [2025-10-09T17:37:34.791990] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:37:34.792310] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-09T17:37:34.792479] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-09T17:37:34.792735] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-09T17:37:34.792793] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-09T17:37:34.940105] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-09T17:37:35.201022] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-09T17:37:35.274576] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:35.288227] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T17:37:35.321995] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T17:37:35.996783] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-09T17:37:36.796698] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-09T17:37:37.260194] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T17:37:37.596690] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-09T17:37:37.735137] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T17:37:37.749546] [INFO ] [REMOTE ] BHVN: Full fetch complete (70113 records). [2025-10-09T17:37:37.750636] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T17:37:37.750235] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-09T17:37:38.149141] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-09T17:37:38.149227] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-09T17:37:38.150712] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-09T17:37:38.150778] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-09T17:37:38.152230] [DEBUG] [LOCAL ] BHVN: Trimmed 70113 records to 50578 (keeping 200 days of data) [2025-10-09T17:37:38.396718] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-09T17:37:38.469558] [DEBUG] [LOCAL ] BHVN: Primary data saved (50578 records). [2025-10-09T17:37:38.469736] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-09T17:37:38.470366] [INFO ] [MAIN ] Update Progress: 276/2373 symbols completed. BHVN took 34.4s. Estimated remaining: 4h 45m 32s. Rate: 7.3 symbols/min [2025-10-09T17:37:38.675245] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:37:38.719314] [DEBUG] [LOCAL ] BIPC: Loaded 41294 existing records from primary storage. [2025-10-09T17:37:38.719677] [INFO ] [MAIN ] BIPC: Loaded 41294 existing records. [2025-10-09T17:37:38.931918] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:37:38.932225] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-09T17:37:38.932303] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-09T17:37:38.932588] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-09T17:37:38.932702] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-09T17:37:39.207396] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-09T17:37:39.280612] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T17:37:39.369762] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:37:39.996750] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-09T17:37:40.158465] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T17:37:40.438999] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T17:37:40.796773] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-09T17:37:41.335441] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T17:37:41.596682] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-09T17:37:42.026895] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T17:37:42.396717] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-09T17:37:42.963487] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:37:43.196721] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-09T17:37:43.996724] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-09T17:37:44.212216] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:37:44.398056] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T17:37:44.796736] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-09T17:37:45.409937] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:37:45.596714] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-09T17:37:46.396749] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-09T17:37:46.474970] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:37:47.130446] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:37:47.196734] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-09T17:37:47.990752] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:37:47.998760] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-09T17:37:48.796756] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-09T17:37:49.189399] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-09T17:37:49.596728] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-09T17:37:49.733525] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T17:37:49.960055] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T17:37:50.396736] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-09T17:37:51.180821] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T17:37:51.196668] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-09T17:37:51.596045] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T17:37:51.996712] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-09T17:37:52.679274] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T17:37:52.796686] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-09T17:37:53.344328] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T17:37:53.596716] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-09T17:37:54.260870] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T17:37:54.396740] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-09T17:37:55.031566] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T17:37:55.196737] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-09T17:37:55.996693] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-09T17:37:56.118698] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T17:37:56.543684] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T17:37:56.796895] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-09T17:37:56.796812] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T17:37:57.596716] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-09T17:37:58.396800] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-09T17:37:58.487506] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T17:37:59.024525] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T17:37:59.196679] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-09T17:37:59.586356] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T17:37:59.996760] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-09T17:38:00.796689] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-09T17:38:01.051690] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-09T17:38:01.056173] [INFO ] [REMOTE ] BILL: Full fetch complete (75888 records). [2025-10-09T17:38:01.056296] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-09T17:38:01.372177] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T17:38:01.473626] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-09T17:38:01.473751] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-09T17:38:01.474568] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-09T17:38:01.474611] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-09T17:38:01.476260] [DEBUG] [LOCAL ] BILL: Trimmed 75888 records to 52792 (keeping 200 days of data) [2025-10-09T17:38:01.642812] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-09T17:38:01.785452] [DEBUG] [LOCAL ] BILL: Primary data saved (52792 records). [2025-10-09T17:38:01.785596] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-09T17:38:01.786776] [INFO ] [MAIN ] Update Progress: 277/2373 symbols completed. BILL took 39.5s. Estimated remaining: 4h 47m 19s. Rate: 7.3 symbols/min [2025-10-09T17:38:02.396728] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-09T17:38:02.561275] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T17:38:02.604689] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T17:38:03.196744] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-09T17:38:03.973747] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T17:38:03.996692] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-09T17:38:04.671240] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T17:38:04.796678] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-09T17:38:05.063187] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T17:38:05.596714] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-09T17:38:06.396701] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-09T17:38:06.592457] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:38:06.596925] [INFO ] [REMOTE ] BIP: Full fetch complete (56966 records). [2025-10-09T17:38:06.597081] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-09T17:38:06.997493] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-09T17:38:06.997597] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-09T17:38:06.998420] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-09T17:38:06.998539] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-09T17:38:06.999830] [DEBUG] [LOCAL ] BIP: Trimmed 56966 records to 39590 (keeping 200 days of data) [2025-10-09T17:38:07.127612] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T17:38:07.139342] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T17:38:07.152824] [INFO ] [REMOTE ] BIO: Full fetch complete (33951 records). [2025-10-09T17:38:07.157217] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-09T17:38:07.161190] [FATAL] [VALIDATOR ] BIO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:38:07.161976] [FATAL] [MAIN ] BIO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:38:07.163152] [WARN ] [MAIN ] BIO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:38:07.166279] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-09T17:38:07.166906] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-09T17:38:07.170523] [INFO ] [LOCAL ] BIO: Starting deletion of derivative data. [2025-10-09T17:38:07.176220] [DEBUG] [LOCAL ] BIO: Deleted derivative data file. [2025-10-09T17:38:07.176347] [INFO ] [MAIN ] Update Progress: 278/2373 symbols completed. BIO took 34.4s. Estimated remaining: 4h 46m 49s. Rate: 7.3 symbols/min [2025-10-09T17:38:07.224765] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-09T17:38:07.295819] [DEBUG] [LOCAL ] BIP: Primary data saved (39590 records). [2025-10-09T17:38:07.295990] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-09T17:38:07.296524] [INFO ] [MAIN ] Update Progress: 279/2373 symbols completed. BIP took 32.9s. Estimated remaining: 4h 45m 40s. Rate: 7.3 symbols/min [2025-10-09T17:38:08.618424] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T17:38:08.621727] [INFO ] [REMOTE ] BIPC: Full fetch complete (59680 records). [2025-10-09T17:38:08.621848] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-09T17:38:08.622539] [FATAL] [VALIDATOR ] BIPC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:38:08.622631] [FATAL] [MAIN ] BIPC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:38:08.622719] [WARN ] [MAIN ] BIPC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:38:08.622763] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-09T17:38:08.622820] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-09T17:38:08.622852] [INFO ] [LOCAL ] BIPC: Starting deletion of derivative data. [2025-10-09T17:38:08.623066] [DEBUG] [LOCAL ] BIPC: Deleted derivative data file. [2025-10-09T17:38:08.623486] [INFO ] [MAIN ] Update Progress: 280/2373 symbols completed. BIPC took 30.2s. Estimated remaining: 4h 44m 41s. Rate: 7.4 symbols/min [2025-10-09T17:38:09.234971] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:09.332021] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:09.393826] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:09.421732] [DEBUG] [LOCAL ] BIPI: Loaded 3152 existing records from primary storage. [2025-10-09T17:38:09.425337] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:09.426039] [INFO ] [MAIN ] BIPI: Loaded 3152 existing records. [2025-10-09T17:38:09.498057] [DEBUG] [LOCAL ] BIPJ: Loaded 3153 existing records from primary storage. [2025-10-09T17:38:09.506071] [DEBUG] [LOCAL ] BIPH: Loaded 2566 existing records from primary storage. [2025-10-09T17:38:09.512416] [INFO ] [MAIN ] BIPH: Loaded 2566 existing records. [2025-10-09T17:38:09.524138] [INFO ] [MAIN ] BIPJ: Loaded 3153 existing records. [2025-10-09T17:38:09.870962] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:09.941593] [DEBUG] [LOCAL ] BIRK: Loaded 50994 existing records from primary storage. [2025-10-09T17:38:09.957456] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-09T17:38:09.984350] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-09T17:38:09.984236] [INFO ] [MAIN ] BIRK: Loaded 50994 existing records. [2025-10-09T17:38:09.973400] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:10.086695] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:10.100081] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-09T17:38:10.100329] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-09T17:38:10.081309] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-09T17:38:10.111486] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-09T17:38:10.121348] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-09T17:38:10.130358] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-09T17:38:10.150075] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-09T17:38:10.160457] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-09T17:38:10.216306] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-09T17:38:10.207790] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-09T17:38:10.638082] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:10.763943] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-09T17:38:10.823214] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-09T17:38:10.983246] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-09T17:38:11.020027] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-09T17:38:11.136854] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:11.150184] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-09T17:38:11.399328] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:11.425337] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-09T17:38:11.587628] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:11.615527] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-09T17:38:11.731532] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:11.731873] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-09T17:38:12.081179] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T17:38:12.083193] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-09T17:38:12.318982] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T17:38:12.320695] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-09T17:38:12.397342] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T17:38:12.541577] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T17:38:12.635933] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-09T17:38:12.796756] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-09T17:38:13.103269] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:38:13.271581] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T17:38:13.596697] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-09T17:38:14.229716] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T17:38:14.396807] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-09T17:38:15.196773] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-09T17:38:15.812239] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T17:38:15.996692] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-09T17:38:16.164273] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T17:38:16.572755] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T17:38:16.796719] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-09T17:38:17.233041] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T17:38:17.596714] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-09T17:38:18.396770] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-09T17:38:19.052071] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T17:38:19.164888] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:38:19.196703] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-09T17:38:19.785293] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T17:38:19.996724] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-09T17:38:20.414531] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-09T17:38:20.796707] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-09T17:38:21.249257] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T17:38:21.596705] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-09T17:38:22.121762] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T17:38:22.396736] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-09T17:38:22.948663] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T17:38:23.196735] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-09T17:38:23.747163] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-09T17:38:23.996715] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-09T17:38:24.560449] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T17:38:24.796721] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-09T17:38:25.342453] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T17:38:25.596714] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-09T17:38:26.396731] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-09T17:38:27.045718] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T17:38:27.196700] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-09T17:38:27.326214] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T17:38:27.730933] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T17:38:27.996741] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-09T17:38:28.409857] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-09T17:38:28.796710] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-09T17:38:29.236147] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T17:38:29.596704] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-09T17:38:30.396726] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-09T17:38:30.948355] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T17:38:31.197269] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-09T17:38:31.200445] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T17:38:31.741215] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T17:38:31.996732] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-09T17:38:32.749301] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-09T17:38:32.796697] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-09T17:38:33.246836] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T17:38:33.248173] [INFO ] [REMOTE ] BIPI: Full fetch complete (4953 records). [2025-10-09T17:38:33.248290] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-09T17:38:33.602234] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-09T17:38:33.795612] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-09T17:38:33.795804] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-09T17:38:33.796251] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-09T17:38:33.796336] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-09T17:38:33.797446] [DEBUG] [LOCAL ] BIPI: Trimmed 4953 records to 3170 (keeping 200 days of data) [2025-10-09T17:38:33.833024] [DEBUG] [LOCAL ] BIPI: Primary data saved (3170 records). [2025-10-09T17:38:33.833306] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-09T17:38:33.833494] [INFO ] [MAIN ] Update Progress: 281/2373 symbols completed. BIPI took 25.2s. Estimated remaining: 4h 46m 40s. Rate: 7.3 symbols/min [2025-10-09T17:38:34.071991] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:34.103739] [DEBUG] [LOCAL ] BIT: Loaded 23233 existing records from primary storage. [2025-10-09T17:38:34.104148] [INFO ] [MAIN ] BIT: Loaded 23233 existing records. [2025-10-09T17:38:34.309899] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T17:38:34.337018] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:34.337237] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-09T17:38:34.337286] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-09T17:38:34.337492] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-09T17:38:34.337550] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-09T17:38:34.402277] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-09T17:38:34.716202] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:35.196768] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-09T17:38:35.996720] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-09T17:38:36.407055] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:38:36.796729] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-09T17:38:37.375909] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-09T17:38:37.376889] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4368 records). [2025-10-09T17:38:37.376968] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-09T17:38:37.608886] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-09T17:38:37.770067] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-09T17:38:37.770472] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-09T17:38:37.770701] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-09T17:38:37.770776] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-09T17:38:37.771301] [DEBUG] [LOCAL ] BIPJ: Trimmed 4368 records to 3177 (keeping 200 days of data) [2025-10-09T17:38:37.792424] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T17:38:37.807130] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3177 records). [2025-10-09T17:38:37.807308] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-09T17:38:37.807471] [INFO ] [MAIN ] Update Progress: 282/2373 symbols completed. BIPJ took 29.2s. Estimated remaining: 4h 45m 60s. Rate: 7.3 symbols/min [2025-10-09T17:38:37.979742] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:38.020743] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T17:38:38.084160] [DEBUG] [LOCAL ] BJ: Loaded 51508 existing records from primary storage. [2025-10-09T17:38:38.084553] [INFO ] [MAIN ] BJ: Loaded 51508 existing records. [2025-10-09T17:38:38.180187] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T17:38:38.269964] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:38.270248] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-09T17:38:38.270299] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-09T17:38:38.270553] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-09T17:38:38.270613] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-09T17:38:38.408493] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-09T17:38:38.626130] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:38.903350] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T17:38:39.196738] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-09T17:38:39.996732] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-09T17:38:40.703937] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:38:40.796703] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-09T17:38:41.253404] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T17:38:41.598110] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-09T17:38:41.601430] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T17:38:42.396697] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-09T17:38:42.534896] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:38:42.753686] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T17:38:42.754429] [INFO ] [REMOTE ] BIPH: Full fetch complete (4179 records). [2025-10-09T17:38:42.754496] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-09T17:38:43.103076] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-09T17:38:43.103156] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-09T17:38:43.103294] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-09T17:38:43.103333] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-09T17:38:43.103710] [DEBUG] [LOCAL ] BIPH: Trimmed 4179 records to 2577 (keeping 200 days of data) [2025-10-09T17:38:43.120364] [DEBUG] [LOCAL ] BIPH: Primary data saved (2577 records). [2025-10-09T17:38:43.120436] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-09T17:38:43.120507] [INFO ] [MAIN ] Update Progress: 283/2373 symbols completed. BIPH took 34.5s. Estimated remaining: 4h 45m 30s. Rate: 7.3 symbols/min [2025-10-09T17:38:43.201898] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-09T17:38:43.290979] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:38:43.344512] [DEBUG] [LOCAL ] BK: Loaded 53532 existing records from primary storage. [2025-10-09T17:38:43.344848] [INFO ] [MAIN ] BK: Loaded 53532 existing records. [2025-10-09T17:38:43.530290] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:38:43.530566] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-09T17:38:43.530670] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-09T17:38:43.531072] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-09T17:38:43.531137] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-09T17:38:43.887126] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:38:43.996684] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-09T17:38:44.244847] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T17:38:44.796732] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-09T17:38:45.531711] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T17:38:45.602999] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-09T17:38:45.606570] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T17:38:46.396751] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-09T17:38:47.196721] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-09T17:38:47.561189] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T17:38:47.996719] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-09T17:38:48.180699] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T17:38:48.796682] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-09T17:38:48.849038] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T17:38:49.143682] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-09T17:38:49.596702] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-09T17:38:50.267293] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:38:50.396677] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-09T17:38:51.196704] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-09T17:38:51.415467] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T17:38:51.996692] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-09T17:38:52.111379] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T17:38:52.427147] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:38:52.796713] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-09T17:38:53.316947] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T17:38:53.596722] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-09T17:38:54.398218] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-09T17:38:54.401232] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T17:38:55.196693] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-09T17:38:55.499082] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T17:38:55.996727] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-09T17:38:56.045455] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T17:38:56.748166] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T17:38:56.796673] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-09T17:38:57.062237] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T17:38:57.596716] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-09T17:38:58.405490] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-09T17:38:58.410821] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T17:38:59.196719] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-09T17:38:59.506053] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T17:38:59.878509] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:38:59.883126] [INFO ] [REMOTE ] BIRK: Full fetch complete (73049 records). [2025-10-09T17:38:59.883281] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-09T17:39:00.001828] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-09T17:39:00.307971] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-09T17:39:00.308076] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-09T17:39:00.308963] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-09T17:39:00.309031] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-09T17:39:00.310566] [DEBUG] [LOCAL ] BIRK: Trimmed 73049 records to 51374 (keeping 200 days of data) [2025-10-09T17:39:00.628423] [DEBUG] [LOCAL ] BIRK: Primary data saved (51374 records). [2025-10-09T17:39:00.628571] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-09T17:39:00.629547] [INFO ] [MAIN ] Update Progress: 284/2373 symbols completed. BIRK took 52.0s. Estimated remaining: 4h 46m 31s. Rate: 7.3 symbols/min [2025-10-09T17:39:00.814175] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-09T17:39:00.814065] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:00.861575] [DEBUG] [LOCAL ] BKD: Loaded 50322 existing records from primary storage. [2025-10-09T17:39:00.861920] [INFO ] [MAIN ] BKD: Loaded 50322 existing records. [2025-10-09T17:39:01.072541] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:01.073021] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-09T17:39:01.073137] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-09T17:39:01.073398] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-09T17:39:01.073476] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-09T17:39:01.230494] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T17:39:01.510970] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:01.522268] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T17:39:01.596690] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-09T17:39:02.277786] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T17:39:02.396670] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-09T17:39:03.179917] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T17:39:03.196657] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-09T17:39:03.996704] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-09T17:39:04.331938] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T17:39:04.537279] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T17:39:04.796772] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-09T17:39:05.229127] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:39:05.596719] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-09T17:39:06.396686] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-09T17:39:06.546713] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T17:39:06.578169] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T17:39:07.196785] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-09T17:39:07.964952] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:39:07.996722] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-09T17:39:08.401730] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T17:39:08.404438] [INFO ] [REMOTE ] BIT: Full fetch complete (31844 records). [2025-10-09T17:39:08.404510] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-09T17:39:08.791843] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-09T17:39:08.791955] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-09T17:39:08.792398] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-09T17:39:08.792444] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-09T17:39:08.793267] [DEBUG] [LOCAL ] BIT: Trimmed 31844 records to 23392 (keeping 200 days of data) [2025-10-09T17:39:08.847213] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-09T17:39:08.936106] [DEBUG] [LOCAL ] BIT: Primary data saved (23392 records). [2025-10-09T17:39:08.936244] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-09T17:39:08.936325] [INFO ] [MAIN ] Update Progress: 285/2373 symbols completed. BIT took 35.1s. Estimated remaining: 4h 46m 23s. Rate: 7.3 symbols/min [2025-10-09T17:39:09.100628] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:09.134856] [DEBUG] [LOCAL ] BKE: Loaded 33971 existing records from primary storage. [2025-10-09T17:39:09.135134] [INFO ] [MAIN ] BKE: Loaded 33971 existing records. [2025-10-09T17:39:09.307826] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:09.308051] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-09T17:39:09.308101] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-09T17:39:09.308328] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-09T17:39:09.308413] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-09T17:39:09.601879] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-09T17:39:09.663847] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:09.834829] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T17:39:10.396694] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-09T17:39:10.510071] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T17:39:11.196771] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-09T17:39:11.394577] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T17:39:11.766469] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T17:39:11.996738] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-09T17:39:12.319019] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T17:39:12.796730] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-09T17:39:13.415872] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T17:39:13.420493] [INFO ] [REMOTE ] BJ: Full fetch complete (74030 records). [2025-10-09T17:39:13.420700] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-09T17:39:13.600613] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-09T17:39:13.819727] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-09T17:39:13.819812] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-09T17:39:13.820564] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-09T17:39:13.820604] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-09T17:39:13.821956] [DEBUG] [LOCAL ] BJ: Trimmed 74030 records to 51896 (keeping 200 days of data) [2025-10-09T17:39:14.138244] [DEBUG] [LOCAL ] BJ: Primary data saved (51896 records). [2025-10-09T17:39:14.138476] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-09T17:39:14.139024] [INFO ] [MAIN ] Update Progress: 286/2373 symbols completed. BJ took 36.3s. Estimated remaining: 4h 45m 53s. Rate: 7.3 symbols/min [2025-10-09T17:39:14.312987] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:14.349455] [DEBUG] [LOCAL ] BKH: Loaded 36923 existing records from primary storage. [2025-10-09T17:39:14.349770] [INFO ] [MAIN ] BKH: Loaded 36923 existing records. [2025-10-09T17:39:14.402744] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-09T17:39:14.533170] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:14.533452] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-09T17:39:14.548865] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-09T17:39:14.559297] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-09T17:39:14.559432] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-09T17:39:14.605970] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T17:39:14.947837] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:15.196737] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-09T17:39:15.239490] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:39:15.996731] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-09T17:39:16.084851] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:39:16.089344] [INFO ] [REMOTE ] BK: Full fetch complete (77481 records). [2025-10-09T17:39:16.089461] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-09T17:39:16.475209] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-09T17:39:16.475293] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-09T17:39:16.476094] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-09T17:39:16.476161] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-09T17:39:16.477608] [DEBUG] [LOCAL ] BK: Trimmed 77481 records to 53922 (keeping 200 days of data) [2025-10-09T17:39:16.800750] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-09T17:39:16.829867] [DEBUG] [LOCAL ] BK: Primary data saved (53922 records). [2025-10-09T17:39:16.830028] [INFO ] [MAIN ] BK: Full history saved. [2025-10-09T17:39:16.830952] [INFO ] [MAIN ] Update Progress: 287/2373 symbols completed. BK took 33.7s. Estimated remaining: 4h 45m 4s. Rate: 7.3 symbols/min [2025-10-09T17:39:16.994579] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T17:39:17.052699] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:17.091424] [DEBUG] [LOCAL ] BKKT: Loaded 35721 existing records from primary storage. [2025-10-09T17:39:17.091811] [INFO ] [MAIN ] BKKT: Loaded 35721 existing records. [2025-10-09T17:39:17.273278] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:17.273545] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-09T17:39:17.273597] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-09T17:39:17.273940] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-09T17:39:17.274041] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-09T17:39:17.567658] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T17:39:17.601786] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-09T17:39:17.668180] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:18.215922] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T17:39:18.396721] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-09T17:39:19.196762] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-09T17:39:19.301847] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T17:39:19.996682] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-09T17:39:20.456556] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-09T17:39:20.482092] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T17:39:20.796772] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-09T17:39:21.596689] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-09T17:39:21.631321] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T17:39:22.176588] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T17:39:22.396708] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-09T17:39:22.906635] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T17:39:23.196723] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-09T17:39:23.663469] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T17:39:23.996777] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-09T17:39:24.697138] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:39:24.796766] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-09T17:39:25.176122] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T17:39:25.596779] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-09T17:39:26.193162] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:39:26.396786] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-09T17:39:27.126798] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T17:39:27.196682] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-09T17:39:27.805600] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:39:27.996712] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-09T17:39:28.414135] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T17:39:28.796712] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-09T17:39:29.467369] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:39:29.471773] [INFO ] [REMOTE ] BKD: Full fetch complete (71794 records). [2025-10-09T17:39:29.471893] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-09T17:39:29.612025] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-09T17:39:29.872793] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-09T17:39:29.872952] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-09T17:39:29.873872] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-09T17:39:29.873941] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-09T17:39:29.875434] [DEBUG] [LOCAL ] BKD: Trimmed 71794 records to 50711 (keeping 200 days of data) [2025-10-09T17:39:30.103318] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T17:39:30.197878] [DEBUG] [LOCAL ] BKD: Primary data saved (50711 records). [2025-10-09T17:39:30.198058] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-09T17:39:30.198780] [INFO ] [MAIN ] Update Progress: 288/2373 symbols completed. BKD took 29.6s. Estimated remaining: 4h 45m 34s. Rate: 7.3 symbols/min [2025-10-09T17:39:30.366682] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:30.378161] [DEBUG] [LOCAL ] BKN: Loaded 7681 existing records from primary storage. [2025-10-09T17:39:30.378419] [INFO ] [MAIN ] BKN: Loaded 7681 existing records. [2025-10-09T17:39:30.402233] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-09T17:39:30.569908] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:30.570228] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-09T17:39:30.570289] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-09T17:39:30.570792] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-09T17:39:30.570859] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-09T17:39:30.959316] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:31.020154] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T17:39:31.196687] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-09T17:39:31.948792] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T17:39:31.957240] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T17:39:31.996664] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-09T17:39:32.796709] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-09T17:39:33.488542] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T17:39:33.596728] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-09T17:39:34.194180] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T17:39:34.396704] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-09T17:39:34.472447] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T17:39:35.196719] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-09T17:39:35.647315] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T17:39:35.996750] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-09T17:39:36.730815] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:39:36.796718] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-09T17:39:37.565703] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T17:39:37.596730] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-09T17:39:38.220814] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T17:39:38.396764] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-09T17:39:39.002043] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T17:39:39.005034] [INFO ] [REMOTE ] BKE: Full fetch complete (50099 records). [2025-10-09T17:39:39.005166] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-09T17:39:39.205470] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-09T17:39:39.388165] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-09T17:39:39.388251] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-09T17:39:39.388898] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-09T17:39:39.388964] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-09T17:39:39.390134] [DEBUG] [LOCAL ] BKE: Trimmed 50099 records to 34235 (keeping 200 days of data) [2025-10-09T17:39:39.604192] [DEBUG] [LOCAL ] BKE: Primary data saved (34235 records). [2025-10-09T17:39:39.604355] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-09T17:39:39.604473] [INFO ] [MAIN ] Update Progress: 289/2373 symbols completed. BKE took 30.7s. Estimated remaining: 4h 45m 34s. Rate: 7.3 symbols/min [2025-10-09T17:39:39.780744] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:39.799725] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T17:39:39.810945] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T17:39:39.853992] [DEBUG] [LOCAL ] BKSY: Loaded 48470 existing records from primary storage. [2025-10-09T17:39:39.854309] [INFO ] [MAIN ] BKSY: Loaded 48470 existing records. [2025-10-09T17:39:40.003699] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-09T17:39:40.045555] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:40.045814] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-09T17:39:40.045892] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-09T17:39:40.046167] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-09T17:39:40.046270] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-09T17:39:40.404812] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:40.796761] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-09T17:39:41.522609] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:39:41.596677] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-09T17:39:42.396780] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-09T17:39:42.624620] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T17:39:43.146271] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T17:39:43.196680] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-09T17:39:43.996746] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-09T17:39:44.136620] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T17:39:44.527290] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T17:39:44.796692] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-09T17:39:44.881273] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T17:39:45.596709] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-09T17:39:46.404141] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-09T17:39:46.409474] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T17:39:46.953019] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:39:47.196757] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-09T17:39:47.996744] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-09T17:39:48.107862] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T17:39:48.427607] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T17:39:48.430935] [INFO ] [REMOTE ] BKH: Full fetch complete (52555 records). [2025-10-09T17:39:48.431026] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-09T17:39:48.805866] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-09T17:39:48.809539] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-09T17:39:48.809601] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-09T17:39:48.810267] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-09T17:39:48.810432] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-09T17:39:48.811569] [DEBUG] [LOCAL ] BKH: Trimmed 52555 records to 37211 (keeping 200 days of data) [2025-10-09T17:39:49.042119] [DEBUG] [LOCAL ] BKH: Primary data saved (37211 records). [2025-10-09T17:39:49.042247] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-09T17:39:49.042813] [INFO ] [MAIN ] Update Progress: 290/2373 symbols completed. BKH took 34.9s. Estimated remaining: 4h 45m 34s. Rate: 7.3 symbols/min [2025-10-09T17:39:49.239274] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:49.260109] [DEBUG] [LOCAL ] BKT: Loaded 11941 existing records from primary storage. [2025-10-09T17:39:49.260382] [INFO ] [MAIN ] BKT: Loaded 11941 existing records. [2025-10-09T17:39:49.457216] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:49.457396] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-09T17:39:49.457444] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-09T17:39:49.457621] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-09T17:39:49.457707] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-09T17:39:49.606913] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-09T17:39:49.822530] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:49.975312] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-09T17:39:50.214021] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T17:39:50.396683] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-09T17:39:50.662793] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T17:39:51.100011] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T17:39:51.196718] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-09T17:39:51.996729] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-09T17:39:52.783123] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T17:39:52.796674] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-09T17:39:53.596713] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-09T17:39:54.037883] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-09T17:39:54.042173] [INFO ] [REMOTE ] BKKT: Full fetch complete (50730 records). [2025-10-09T17:39:54.042278] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-09T17:39:54.340330] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T17:39:54.399347] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-09T17:39:54.455731] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-09T17:39:54.455825] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-09T17:39:54.456473] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-09T17:39:54.456520] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-09T17:39:54.457989] [DEBUG] [LOCAL ] BKKT: Trimmed 50730 records to 36101 (keeping 200 days of data) [2025-10-09T17:39:54.674310] [DEBUG] [LOCAL ] BKKT: Primary data saved (36101 records). [2025-10-09T17:39:54.674443] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-09T17:39:54.674522] [INFO ] [MAIN ] Update Progress: 291/2373 symbols completed. BKKT took 37.8s. Estimated remaining: 4h 45m 8s. Rate: 7.3 symbols/min [2025-10-09T17:39:54.875402] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:39:54.877310] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T17:39:54.922750] [DEBUG] [LOCAL ] BKU: Loaded 41680 existing records from primary storage. [2025-10-09T17:39:54.923088] [INFO ] [MAIN ] BKU: Loaded 41680 existing records. [2025-10-09T17:39:55.109541] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:39:55.109761] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-09T17:39:55.109813] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-09T17:39:55.110027] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-09T17:39:55.110085] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-09T17:39:55.203179] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-09T17:39:55.422254] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T17:39:55.498861] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:39:55.996749] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-09T17:39:56.807794] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-09T17:39:56.810876] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T17:39:57.291062] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T17:39:57.339024] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T17:39:57.596729] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-09T17:39:58.375953] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T17:39:58.396665] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-09T17:39:59.028040] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T17:39:59.196699] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-09T17:39:59.875903] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T17:39:59.996718] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-09T17:40:00.781985] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T17:40:00.796681] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-09T17:40:01.596837] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-09T17:40:01.625524] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T17:40:02.396752] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-09T17:40:02.439558] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T17:40:02.440609] [INFO ] [REMOTE ] BKN: Full fetch complete (11636 records). [2025-10-09T17:40:02.440757] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-09T17:40:02.818716] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-09T17:40:02.818814] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-09T17:40:02.819128] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-09T17:40:02.819168] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-09T17:40:02.819599] [DEBUG] [LOCAL ] BKN: Trimmed 11636 records to 7712 (keeping 200 days of data) [2025-10-09T17:40:02.867886] [DEBUG] [LOCAL ] BKN: Primary data saved (7712 records). [2025-10-09T17:40:02.868003] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-09T17:40:02.868092] [INFO ] [MAIN ] Update Progress: 292/2373 symbols completed. BKN took 32.7s. Estimated remaining: 4h 44m 59s. Rate: 7.3 symbols/min [2025-10-09T17:40:03.038660] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:03.067552] [DEBUG] [LOCAL ] BKV: Loaded 29885 existing records from primary storage. [2025-10-09T17:40:03.067841] [INFO ] [MAIN ] BKV: Loaded 29885 existing records. [2025-10-09T17:40:03.205196] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-09T17:40:03.245021] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:03.245222] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-09T17:40:03.245268] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-09T17:40:03.245523] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-09T17:40:03.245579] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-09T17:40:03.597902] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:03.901907] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T17:40:03.996684] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-09T17:40:04.156372] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T17:40:04.648492] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T17:40:04.796707] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-09T17:40:05.596742] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-09T17:40:06.015717] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T17:40:06.233073] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T17:40:06.396767] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-09T17:40:07.196733] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-09T17:40:07.996764] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-09T17:40:08.141108] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T17:40:08.796763] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-09T17:40:08.825611] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T17:40:09.137843] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T17:40:09.596682] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-09T17:40:10.045947] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T17:40:10.355186] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-09T17:40:10.396668] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-09T17:40:11.196723] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-09T17:40:11.482607] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T17:40:11.996771] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-09T17:40:12.480501] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T17:40:12.796787] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-09T17:40:13.596722] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-09T17:40:14.089884] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-09T17:40:14.264066] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T17:40:14.396723] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-09T17:40:14.615615] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T17:40:15.196800] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-09T17:40:15.996741] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-09T17:40:16.098961] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T17:40:16.644906] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T17:40:16.796708] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-09T17:40:17.219737] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T17:40:17.222433] [INFO ] [REMOTE ] BKT: Full fetch complete (15883 records). [2025-10-09T17:40:17.222515] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-09T17:40:17.629620] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-09T17:40:17.619319] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-09T17:40:17.631193] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-09T17:40:17.631614] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-09T17:40:17.631708] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-09T17:40:17.632468] [DEBUG] [LOCAL ] BKT: Trimmed 15883 records to 12044 (keeping 200 days of data) [2025-10-09T17:40:17.706189] [DEBUG] [LOCAL ] BKT: Primary data saved (12044 records). [2025-10-09T17:40:17.706311] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-09T17:40:17.706443] [INFO ] [MAIN ] Update Progress: 293/2373 symbols completed. BKT took 28.7s. Estimated remaining: 4h 45m 38s. Rate: 7.3 symbols/min [2025-10-09T17:40:17.870523] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:17.907164] [DEBUG] [LOCAL ] BLCO: Loaded 35542 existing records from primary storage. [2025-10-09T17:40:17.907463] [INFO ] [MAIN ] BLCO: Loaded 35542 existing records. [2025-10-09T17:40:18.079873] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:18.080068] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-09T17:40:18.080115] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-09T17:40:18.080347] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-09T17:40:18.080404] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-09T17:40:18.409715] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-09T17:40:18.442763] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:18.472623] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T17:40:18.968052] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T17:40:19.196797] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-09T17:40:19.996789] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-09T17:40:20.546978] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-09T17:40:20.552027] [INFO ] [REMOTE ] BKSY: Full fetch complete (69993 records). [2025-10-09T17:40:20.552146] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-09T17:40:20.704607] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:40:20.801912] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-09T17:40:20.985078] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-09T17:40:20.985190] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-09T17:40:20.986048] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-09T17:40:20.986129] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-09T17:40:21.006184] [DEBUG] [LOCAL ] BKSY: Trimmed 69993 records to 48849 (keeping 200 days of data) [2025-10-09T17:40:21.007132] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T17:40:21.327148] [DEBUG] [LOCAL ] BKSY: Primary data saved (48849 records). [2025-10-09T17:40:21.327382] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-09T17:40:21.327514] [INFO ] [MAIN ] Update Progress: 294/2373 symbols completed. BKSY took 41.7s. Estimated remaining: 4h 44m 57s. Rate: 7.3 symbols/min [2025-10-09T17:40:21.517213] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:21.517394] [DEBUG] [LOCAL ] BLD: No existing data file found in primary storage. [2025-10-09T17:40:21.517450] [WARN ] [MAIN ] BLD: No existing data found, performing full refresh instead. [2025-10-09T17:40:21.517560] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-09T17:40:21.517600] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-09T17:40:21.517662] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-09T17:40:21.517718] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-09T17:40:21.601807] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-09T17:40:21.905694] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:21.925268] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T17:40:22.396718] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-09T17:40:23.016806] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T17:40:23.196705] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-09T17:40:23.770519] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T17:40:23.996743] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-09T17:40:24.744211] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T17:40:24.796736] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-09T17:40:24.900117] [DEBUG] [REMOTE ] BLD: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-09T17:40:24.900434] [WARN ] [REMOTE ] BLD: No data returned for month 2025-01 [2025-10-09T17:40:24.900537] [FATAL] [REMOTE ] BLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:40:24.900669] [FATAL] [MAIN ] BLD: Failed to fetch primary data. [2025-10-09T17:40:24.900739] [WARN ] [MAIN ] BLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:40:24.900815] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-09T17:40:24.900899] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-09T17:40:24.900968] [INFO ] [LOCAL ] BLD: Starting deletion of derivative data. [2025-10-09T17:40:24.901039] [DEBUG] [LOCAL ] BLD: No derivative data file found to delete. [2025-10-09T17:40:24.901092] [INFO ] [MAIN ] Update Progress: 295/2373 symbols completed. BLD took 3.6s. Estimated remaining: 4h 44m 16s. Rate: 7.3 symbols/min [2025-10-09T17:40:25.092721] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:25.144778] [DEBUG] [LOCAL ] BLDR: Loaded 51707 existing records from primary storage. [2025-10-09T17:40:25.145070] [INFO ] [MAIN ] BLDR: Loaded 51707 existing records. [2025-10-09T17:40:25.314848] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T17:40:25.364162] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:25.364344] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-09T17:40:25.364389] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-09T17:40:25.364690] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-09T17:40:25.364748] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-09T17:40:25.601847] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-09T17:40:25.717513] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:26.396719] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-09T17:40:27.079871] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:40:27.196747] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-09T17:40:27.996686] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-09T17:40:28.040565] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T17:40:28.801841] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-09T17:40:28.818498] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T17:40:29.463711] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:40:29.596713] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-09T17:40:30.300210] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T17:40:30.396700] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-09T17:40:31.168146] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:40:31.196708] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-09T17:40:31.996752] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-09T17:40:32.265100] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T17:40:32.788350] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T17:40:32.796601] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-09T17:40:32.980222] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T17:40:33.596725] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-09T17:40:34.177706] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:40:34.396733] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-09T17:40:35.196696] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-09T17:40:35.231407] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T17:40:35.794822] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:40:35.996716] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-09T17:40:36.617994] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T17:40:36.796718] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-09T17:40:37.496304] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:40:37.596712] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-09T17:40:37.990153] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T17:40:38.396728] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-09T17:40:38.991312] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T17:40:38.995268] [INFO ] [REMOTE ] BKU: Full fetch complete (60215 records). [2025-10-09T17:40:38.995384] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-09T17:40:39.201911] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-09T17:40:39.400087] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-09T17:40:39.400168] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-09T17:40:39.400846] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-09T17:40:39.400911] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-09T17:40:39.402171] [DEBUG] [LOCAL ] BKU: Trimmed 60215 records to 42027 (keeping 200 days of data) [2025-10-09T17:40:39.671701] [DEBUG] [LOCAL ] BKU: Primary data saved (42027 records). [2025-10-09T17:40:39.671838] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-09T17:40:39.673037] [INFO ] [MAIN ] Update Progress: 296/2373 symbols completed. BKU took 45.0s. Estimated remaining: 4h 44m 54s. Rate: 7.3 symbols/min [2025-10-09T17:40:39.862330] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:39.880104] [DEBUG] [LOCAL ] BLE: Loaded 14063 existing records from primary storage. [2025-10-09T17:40:39.880353] [INFO ] [MAIN ] BLE: Loaded 14063 existing records. [2025-10-09T17:40:39.999380] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-09T17:40:40.077385] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:40.078985] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-09T17:40:40.079302] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-09T17:40:40.079699] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-09T17:40:40.079763] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-09T17:40:40.458448] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-09T17:40:40.499619] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:40.600797] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T17:40:40.796727] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-09T17:40:41.239905] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T17:40:41.596715] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-09T17:40:41.940675] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T17:40:42.396748] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-09T17:40:43.196756] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-09T17:40:43.487468] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T17:40:43.546715] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T17:40:43.996682] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-09T17:40:44.438039] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T17:40:44.796771] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-09T17:40:45.188145] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T17:40:45.191438] [INFO ] [REMOTE ] BLCO: Full fetch complete (52256 records). [2025-10-09T17:40:45.191677] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-09T17:40:45.583456] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-09T17:40:45.583545] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-09T17:40:45.584164] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-09T17:40:45.584227] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-09T17:40:45.585263] [DEBUG] [LOCAL ] BLCO: Trimmed 52256 records to 35773 (keeping 200 days of data) [2025-10-09T17:40:45.635062] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-09T17:40:45.719142] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T17:40:45.825827] [DEBUG] [LOCAL ] BLCO: Primary data saved (35773 records). [2025-10-09T17:40:45.826006] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-09T17:40:45.826894] [INFO ] [MAIN ] Update Progress: 297/2373 symbols completed. BLCO took 28.1s. Estimated remaining: 4h 44m 31s. Rate: 7.3 symbols/min [2025-10-09T17:40:45.992480] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:46.027392] [DEBUG] [LOCAL ] BLK: Loaded 34039 existing records from primary storage. [2025-10-09T17:40:46.027879] [INFO ] [MAIN ] BLK: Loaded 34039 existing records. [2025-10-09T17:40:46.200668] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:46.200949] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-09T17:40:46.200997] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-09T17:40:46.201258] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-09T17:40:46.201315] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-09T17:40:46.407973] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-09T17:40:46.558389] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:47.196703] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-09T17:40:47.232276] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T17:40:47.648080] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-09T17:40:47.996722] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-09T17:40:48.108595] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T17:40:48.112187] [INFO ] [REMOTE ] BKV: Full fetch complete (44798 records). [2025-10-09T17:40:48.112284] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-09T17:40:48.521359] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-09T17:40:48.521444] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-09T17:40:48.522062] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-09T17:40:48.522128] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-09T17:40:48.523141] [DEBUG] [LOCAL ] BKV: Trimmed 44798 records to 30121 (keeping 200 days of data) [2025-10-09T17:40:48.699774] [DEBUG] [LOCAL ] BKV: Primary data saved (30121 records). [2025-10-09T17:40:48.699920] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-09T17:40:48.700006] [INFO ] [MAIN ] Update Progress: 298/2373 symbols completed. BKV took 45.8s. Estimated remaining: 4h 43m 46s. Rate: 7.3 symbols/min [2025-10-09T17:40:48.797437] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-09T17:40:48.868954] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:48.911530] [DEBUG] [LOCAL ] BLND: Loaded 49201 existing records from primary storage. [2025-10-09T17:40:48.911936] [INFO ] [MAIN ] BLND: Loaded 49201 existing records. [2025-10-09T17:40:49.088559] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:40:49.088925] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-09T17:40:49.088975] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-09T17:40:49.089217] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-09T17:40:49.089274] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-09T17:40:49.450168] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:49.495320] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T17:40:49.596691] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-09T17:40:50.396685] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-09T17:40:50.690406] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T17:40:51.196746] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-09T17:40:51.369430] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T17:40:51.594235] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-09T17:40:51.996722] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-09T17:40:52.754896] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T17:40:52.796681] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-09T17:40:53.596683] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-09T17:40:53.683677] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T17:40:54.396796] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-09T17:40:54.603282] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T17:40:55.133419] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T17:40:55.137828] [INFO ] [REMOTE ] BLDR: Full fetch complete (74508 records). [2025-10-09T17:40:55.137961] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-09T17:40:55.202734] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-09T17:40:55.553021] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T17:40:55.552475] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-09T17:40:55.553144] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-09T17:40:55.558463] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-09T17:40:55.558533] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-09T17:40:55.559822] [DEBUG] [LOCAL ] BLDR: Trimmed 74508 records to 52091 (keeping 200 days of data) [2025-10-09T17:40:55.885071] [DEBUG] [LOCAL ] BLDR: Primary data saved (52091 records). [2025-10-09T17:40:55.885216] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-09T17:40:55.885298] [INFO ] [MAIN ] Update Progress: 299/2373 symbols completed. BLDR took 31.0s. Estimated remaining: 4h 43m 30s. Rate: 7.3 symbols/min [2025-10-09T17:40:56.001910] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-09T17:40:56.071966] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:40:56.072193] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-09T17:40:56.072240] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-09T17:40:56.072350] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-09T17:40:56.072392] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-09T17:40:56.072432] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-09T17:40:56.072502] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-09T17:40:56.427508] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:40:56.796689] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-09T17:40:57.057040] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T17:40:57.302453] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T17:40:57.596706] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-09T17:40:57.788122] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T17:40:58.396732] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-09T17:40:59.181098] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T17:40:59.196724] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-09T17:41:00.001811] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-09T17:41:00.021902] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T17:41:00.201762] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T17:41:00.234879] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:41:00.235174] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-09T17:41:00.235263] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:41:00.235332] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-09T17:41:00.235398] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:41:00.235468] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-09T17:41:00.235552] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-09T17:41:00.235607] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-09T17:41:00.235678] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-09T17:41:00.235743] [INFO ] [MAIN ] Update Progress: 300/2373 symbols completed. BLSH took 4.4s. Estimated remaining: 4h 42m 56s. Rate: 7.3 symbols/min [2025-10-09T17:41:00.408121] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:00.423511] [DEBUG] [LOCAL ] BLW: Loaded 13372 existing records from primary storage. [2025-10-09T17:41:00.423805] [INFO ] [MAIN ] BLW: Loaded 13372 existing records. [2025-10-09T17:41:00.601455] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:00.601690] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-09T17:41:00.601763] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-09T17:41:00.601974] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-09T17:41:00.602031] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-09T17:41:00.801805] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-09T17:41:00.966697] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:01.596690] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-09T17:41:01.663472] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T17:41:02.396725] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-09T17:41:03.196692] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-09T17:41:03.295045] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:41:03.779497] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T17:41:03.996701] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-09T17:41:04.085349] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T17:41:04.796694] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-09T17:41:05.103976] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T17:41:05.596690] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-09T17:41:05.714257] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T17:41:06.259453] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T17:41:06.396716] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-09T17:41:07.199109] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-09T17:41:07.202237] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T17:41:07.996729] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-09T17:41:08.712023] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:41:08.796763] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-09T17:41:09.596682] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-09T17:41:09.856278] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T17:41:10.396691] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-09T17:41:10.503297] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:41:10.562723] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T17:41:11.196799] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-09T17:41:11.996793] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-09T17:41:12.085461] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T17:41:12.087584] [INFO ] [REMOTE ] BLE: Full fetch complete (20041 records). [2025-10-09T17:41:12.087704] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-09T17:41:12.314165] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T17:41:12.518403] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-09T17:41:12.518496] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-09T17:41:12.518899] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-09T17:41:12.518963] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-09T17:41:12.519684] [DEBUG] [LOCAL ] BLE: Trimmed 20041 records to 14158 (keeping 200 days of data) [2025-10-09T17:41:12.605626] [DEBUG] [LOCAL ] BLE: Primary data saved (14158 records). [2025-10-09T17:41:12.605793] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-09T17:41:12.605882] [INFO ] [MAIN ] Update Progress: 301/2373 symbols completed. BLE took 32.9s. Estimated remaining: 4h 43m 16s. Rate: 7.3 symbols/min [2025-10-09T17:41:12.776766] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:12.793600] [DEBUG] [LOCAL ] BLX: Loaded 15620 existing records from primary storage. [2025-10-09T17:41:12.793844] [INFO ] [MAIN ] BLX: Loaded 15620 existing records. [2025-10-09T17:41:12.804887] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-09T17:41:12.975995] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:12.976268] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-09T17:41:12.976391] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-09T17:41:12.976569] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-09T17:41:12.976609] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-09T17:41:13.087525] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T17:41:13.342786] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:13.596696] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-09T17:41:14.355204] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T17:41:14.396666] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-09T17:41:14.538850] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T17:41:15.196733] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-09T17:41:15.864462] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:41:15.996693] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-09T17:41:16.118760] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T17:41:16.796695] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-09T17:41:17.586319] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T17:41:17.597132] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-09T17:41:18.256015] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T17:41:18.396748] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-09T17:41:18.415100] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T17:41:19.196719] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-09T17:41:19.827776] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T17:41:19.987336] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T17:41:19.996665] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-09T17:41:20.796740] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-09T17:41:20.943080] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T17:41:21.596729] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-09T17:41:22.393704] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T17:41:22.396685] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-09T17:41:22.433054] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T17:41:23.196762] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-09T17:41:23.837754] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T17:41:23.840892] [INFO ] [REMOTE ] BLK: Full fetch complete (52483 records). [2025-10-09T17:41:23.840992] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-09T17:41:23.998726] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-09T17:41:24.254258] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-09T17:41:24.254350] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-09T17:41:24.255046] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-09T17:41:24.255116] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-09T17:41:24.256354] [DEBUG] [LOCAL ] BLK: Trimmed 52483 records to 34297 (keeping 200 days of data) [2025-10-09T17:41:24.485476] [DEBUG] [LOCAL ] BLK: Primary data saved (34297 records). [2025-10-09T17:41:24.485610] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-09T17:41:24.486151] [INFO ] [MAIN ] Update Progress: 302/2373 symbols completed. BLK took 38.7s. Estimated remaining: 4h 43m 33s. Rate: 7.3 symbols/min [2025-10-09T17:41:24.618774] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T17:41:24.659894] [INFO ] [REMOTE ] BLND: Full fetch complete (72201 records). [2025-10-09T17:41:24.675151] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-09T17:41:24.677826] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:24.801236] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-09T17:41:25.020458] [DEBUG] [LOCAL ] BMA: Loaded 35575 existing records from primary storage. [2025-10-09T17:41:25.057299] [INFO ] [MAIN ] BMA: Loaded 35575 existing records. [2025-10-09T17:41:25.158292] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-09T17:41:25.169851] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-09T17:41:25.193757] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-09T17:41:25.211424] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-09T17:41:25.298001] [DEBUG] [LOCAL ] BLND: Trimmed 72201 records to 49568 (keeping 200 days of data) [2025-10-09T17:41:25.326699] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:25.328503] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T17:41:25.330262] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-09T17:41:25.378023] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-09T17:41:25.413568] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-09T17:41:25.414009] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-09T17:41:25.598256] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-09T17:41:25.833553] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T17:41:25.937450] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:26.015457] [DEBUG] [LOCAL ] BLND: Primary data saved (49568 records). [2025-10-09T17:41:26.015598] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-09T17:41:26.016581] [INFO ] [MAIN ] Update Progress: 303/2373 symbols completed. BLND took 37.3s. Estimated remaining: 4h 42m 39s. Rate: 7.3 symbols/min [2025-10-09T17:41:26.193417] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:26.207508] [DEBUG] [LOCAL ] BME: Loaded 11075 existing records from primary storage. [2025-10-09T17:41:26.207775] [INFO ] [MAIN ] BME: Loaded 11075 existing records. [2025-10-09T17:41:26.398173] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-09T17:41:26.401407] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:26.402513] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-09T17:41:26.402593] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-09T17:41:26.410189] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-09T17:41:26.412395] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T17:41:26.412509] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-09T17:41:26.788888] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:27.196760] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-09T17:41:27.810968] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:41:27.996673] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-09T17:41:28.014934] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T17:41:28.796799] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-09T17:41:29.418452] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T17:41:29.596721] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-09T17:41:29.675755] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-09T17:41:30.396744] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-09T17:41:30.399909] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T17:41:31.196695] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-09T17:41:31.238768] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T17:41:31.996760] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-09T17:41:32.195976] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T17:41:32.796776] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-09T17:41:32.921342] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T17:41:33.596747] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-09T17:41:33.847881] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T17:41:33.850066] [INFO ] [REMOTE ] BLW: Full fetch complete (19386 records). [2025-10-09T17:41:33.850136] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-09T17:41:34.214546] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-09T17:41:34.214757] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-09T17:41:34.215221] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-09T17:41:34.215264] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-09T17:41:34.215856] [DEBUG] [LOCAL ] BLW: Trimmed 19386 records to 13433 (keeping 200 days of data) [2025-10-09T17:41:34.299304] [DEBUG] [LOCAL ] BLW: Primary data saved (13433 records). [2025-10-09T17:41:34.299454] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-09T17:41:34.299542] [INFO ] [MAIN ] Update Progress: 304/2373 symbols completed. BLW took 34.1s. Estimated remaining: 4h 42m 32s. Rate: 7.3 symbols/min [2025-10-09T17:41:34.401706] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-09T17:41:34.480283] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:34.508264] [DEBUG] [LOCAL ] BMEZ: Loaded 26610 existing records from primary storage. [2025-10-09T17:41:34.508517] [INFO ] [MAIN ] BMEZ: Loaded 26610 existing records. [2025-10-09T17:41:34.617890] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T17:41:34.701272] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:34.701496] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-09T17:41:34.701543] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-09T17:41:34.701830] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-09T17:41:34.701888] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-09T17:41:35.094708] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:35.196684] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-09T17:41:35.216079] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T17:41:35.996828] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-09T17:41:36.621071] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T17:41:36.802700] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-09T17:41:36.803792] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T17:41:37.596770] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-09T17:41:38.169983] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-09T17:41:38.222908] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T17:41:38.396712] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-09T17:41:39.196693] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-09T17:41:39.666284] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T17:41:39.979764] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T17:41:39.996667] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-09T17:41:40.796704] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-09T17:41:40.805976] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T17:41:41.596769] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-09T17:41:42.190522] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T17:41:42.396811] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-09T17:41:42.897264] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T17:41:43.196709] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-09T17:41:43.518492] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T17:41:43.996707] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-09T17:41:44.078994] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-09T17:41:44.796701] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-09T17:41:44.937886] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T17:41:45.596729] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-09T17:41:45.908201] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T17:41:46.396716] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-09T17:41:46.485193] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T17:41:46.486915] [INFO ] [REMOTE ] BLX: Full fetch complete (22508 records). [2025-10-09T17:41:46.486985] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-09T17:41:46.860196] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-09T17:41:46.860287] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-09T17:41:46.860672] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-09T17:41:46.860735] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-09T17:41:46.861331] [DEBUG] [LOCAL ] BLX: Trimmed 22508 records to 15705 (keeping 200 days of data) [2025-10-09T17:41:46.960111] [DEBUG] [LOCAL ] BLX: Primary data saved (15705 records). [2025-10-09T17:41:46.960265] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-09T17:41:46.960357] [INFO ] [MAIN ] Update Progress: 305/2373 symbols completed. BLX took 34.4s. Estimated remaining: 4h 42m 54s. Rate: 7.3 symbols/min [2025-10-09T17:41:47.131462] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:47.153996] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T17:41:47.171633] [DEBUG] [LOCAL ] BMI: Loaded 24334 existing records from primary storage. [2025-10-09T17:41:47.172497] [INFO ] [MAIN ] BMI: Loaded 24334 existing records. [2025-10-09T17:41:47.201818] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-09T17:41:47.349619] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:47.349977] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-09T17:41:47.350035] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-09T17:41:47.350543] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-09T17:41:47.350601] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-09T17:41:47.698259] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:47.996762] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-09T17:41:48.471811] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T17:41:48.796682] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-09T17:41:49.130047] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T17:41:49.596751] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-09T17:41:49.918949] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T17:41:50.396688] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-09T17:41:50.402692] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T17:41:50.404321] [INFO ] [REMOTE ] BME: Full fetch complete (15998 records). [2025-10-09T17:41:50.404408] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-09T17:41:50.766432] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-09T17:41:50.766510] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-09T17:41:50.766853] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-09T17:41:50.766914] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-09T17:41:50.767507] [DEBUG] [LOCAL ] BME: Trimmed 15998 records to 11174 (keeping 200 days of data) [2025-10-09T17:41:50.837442] [DEBUG] [LOCAL ] BME: Primary data saved (11174 records). [2025-10-09T17:41:50.837576] [INFO ] [MAIN ] BME: Full history saved. [2025-10-09T17:41:50.837680] [INFO ] [MAIN ] Update Progress: 306/2373 symbols completed. BME took 24.8s. Estimated remaining: 4h 42m 16s. Rate: 7.3 symbols/min [2025-10-09T17:41:51.003471] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:41:51.008500] [DEBUG] [LOCAL ] BMN: Loaded 2586 existing records from primary storage. [2025-10-09T17:41:51.008672] [INFO ] [MAIN ] BMN: Loaded 2586 existing records. [2025-10-09T17:41:51.182867] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:41:51.183081] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-09T17:41:51.183152] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-09T17:41:51.183386] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-09T17:41:51.183456] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-09T17:41:51.203784] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-09T17:41:51.552762] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:41:51.570883] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T17:41:51.996767] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-09T17:41:52.566485] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T17:41:52.668591] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:41:52.796735] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-09T17:41:53.163569] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-09T17:41:53.596722] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-09T17:41:54.396719] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-09T17:41:54.961616] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T17:41:55.196681] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-09T17:41:55.608630] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T17:41:55.694525] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T17:41:55.996732] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-09T17:41:56.796702] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-09T17:41:57.082674] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T17:41:57.596687] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-09T17:41:57.833083] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T17:41:58.396704] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-09T17:41:59.096936] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:41:59.196678] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-09T17:41:59.555567] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T17:41:59.996732] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-09T17:42:00.487752] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-09T17:42:00.667788] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:42:00.671445] [INFO ] [REMOTE ] BMA: Full fetch complete (51471 records). [2025-10-09T17:42:00.671540] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-09T17:42:00.801788] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-09T17:42:01.066977] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-09T17:42:01.067060] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-09T17:42:01.067724] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-09T17:42:01.067788] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-09T17:42:01.068962] [DEBUG] [LOCAL ] BMA: Trimmed 51471 records to 35935 (keeping 200 days of data) [2025-10-09T17:42:01.294480] [DEBUG] [LOCAL ] BMA: Primary data saved (35935 records). [2025-10-09T17:42:01.294633] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-09T17:42:01.294757] [INFO ] [MAIN ] Update Progress: 307/2373 symbols completed. BMA took 36.8s. Estimated remaining: 4h 42m 24s. Rate: 7.3 symbols/min [2025-10-09T17:42:01.472483] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:01.512316] [DEBUG] [LOCAL ] BMO: Loaded 41139 existing records from primary storage. [2025-10-09T17:42:01.512810] [INFO ] [MAIN ] BMO: Loaded 41139 existing records. [2025-10-09T17:42:01.601941] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-09T17:42:01.694431] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:01.694706] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-09T17:42:01.694765] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-09T17:42:01.695003] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-09T17:42:01.695062] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-09T17:42:02.061564] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:02.076101] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T17:42:02.117851] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T17:42:02.396728] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-09T17:42:03.196740] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-09T17:42:03.996706] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-09T17:42:04.082701] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T17:42:04.157567] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T17:42:04.690380] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-09T17:42:04.796750] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-09T17:42:05.596791] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-09T17:42:05.818362] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T17:42:06.061824] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T17:42:06.396712] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-09T17:42:06.910508] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-09T17:42:07.196714] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-09T17:42:07.996731] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-09T17:42:08.181937] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:42:08.497766] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T17:42:08.796736] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-09T17:42:09.282776] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T17:42:09.596710] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-09T17:42:10.396690] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-09T17:42:10.700016] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T17:42:10.939160] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T17:42:10.939976] [INFO ] [REMOTE ] BMN: Full fetch complete (3704 records). [2025-10-09T17:42:10.940043] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-09T17:42:11.201834] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-09T17:42:11.307574] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-09T17:42:11.307673] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-09T17:42:11.307813] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-09T17:42:11.307854] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-09T17:42:11.308216] [DEBUG] [LOCAL ] BMN: Trimmed 3704 records to 2597 (keeping 200 days of data) [2025-10-09T17:42:11.324257] [DEBUG] [LOCAL ] BMN: Primary data saved (2597 records). [2025-10-09T17:42:11.324323] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-09T17:42:11.324394] [INFO ] [MAIN ] Update Progress: 308/2373 symbols completed. BMN took 20.5s. Estimated remaining: 4h 42m 28s. Rate: 7.3 symbols/min [2025-10-09T17:42:11.491339] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:11.542251] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-09T17:42:11.542562] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-09T17:42:11.722562] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:11.722807] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-09T17:42:11.722911] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-09T17:42:11.723233] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-09T17:42:11.723294] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-09T17:42:11.996798] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-09T17:42:12.090700] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:12.531739] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T17:42:12.796768] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-09T17:42:13.525044] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T17:42:13.596738] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-09T17:42:13.851631] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T17:42:14.396718] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-09T17:42:15.196745] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-09T17:42:15.354000] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:42:15.613585] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T17:42:15.996831] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-09T17:42:16.796762] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-09T17:42:17.056163] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T17:42:17.600427] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-09T17:42:17.603243] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:42:17.658559] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T17:42:18.397147] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-09T17:42:18.503383] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T17:42:19.196828] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-09T17:42:19.996751] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-09T17:42:20.339610] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T17:42:20.358244] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T17:42:20.360571] [INFO ] [REMOTE ] BMI: Full fetch complete (33036 records). [2025-10-09T17:42:20.360698] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-09T17:42:20.732846] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-09T17:42:20.732922] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-09T17:42:20.733348] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-09T17:42:20.733389] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-09T17:42:20.734156] [DEBUG] [LOCAL ] BMI: Trimmed 33036 records to 24507 (keeping 200 days of data) [2025-10-09T17:42:20.798711] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-09T17:42:20.890713] [DEBUG] [LOCAL ] BMI: Primary data saved (24507 records). [2025-10-09T17:42:20.890856] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-09T17:42:20.890955] [INFO ] [MAIN ] Update Progress: 309/2373 symbols completed. BMI took 33.9s. Estimated remaining: 4h 42m 28s. Rate: 7.3 symbols/min [2025-10-09T17:42:21.059023] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:21.059259] [DEBUG] [LOCAL ] BN: No existing data file found in primary storage. [2025-10-09T17:42:21.059311] [WARN ] [MAIN ] BN: No existing data found, performing full refresh instead. [2025-10-09T17:42:21.059421] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-09T17:42:21.059483] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-09T17:42:21.059525] [DEBUG] [LOCAL ] BN: No primary data file found to delete. [2025-10-09T17:42:21.059559] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-09T17:42:21.414568] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:21.442188] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T17:42:21.596705] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-09T17:42:22.180109] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T17:42:22.396747] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-09T17:42:23.196751] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-09T17:42:23.439211] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T17:42:23.996679] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-09T17:42:24.225404] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T17:42:24.231868] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40632 records). [2025-10-09T17:42:24.232010] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-09T17:42:24.619631] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-09T17:42:24.644624] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-09T17:42:24.645017] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-09T17:42:24.645831] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-09T17:42:24.645894] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-09T17:42:24.646736] [DEBUG] [LOCAL ] BMEZ: Trimmed 40632 records to 26718 (keeping 200 days of data) [2025-10-09T17:42:24.801864] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-09T17:42:24.814953] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26718 records). [2025-10-09T17:42:24.815029] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-09T17:42:24.815107] [INFO ] [MAIN ] Update Progress: 310/2373 symbols completed. BMEZ took 50.5s. Estimated remaining: 4h 41m 52s. Rate: 7.3 symbols/min [2025-10-09T17:42:24.982961] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:25.011481] [DEBUG] [LOCAL ] BNED: Loaded 29154 existing records from primary storage. [2025-10-09T17:42:25.011806] [INFO ] [MAIN ] BNED: Loaded 29154 existing records. [2025-10-09T17:42:25.196040] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:25.196274] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-09T17:42:25.196325] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-09T17:42:25.196599] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-09T17:42:25.196691] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-09T17:42:25.562134] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:25.584726] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T17:42:25.596680] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-09T17:42:26.358796] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T17:42:26.396731] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-09T17:42:27.034484] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:42:27.196735] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-09T17:42:27.974801] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T17:42:27.996669] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-09T17:42:28.796736] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-09T17:42:29.176700] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-09T17:42:29.205536] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T17:42:29.596754] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-09T17:42:30.406670] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-09T17:42:30.412380] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T17:42:30.747533] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T17:42:31.196733] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-09T17:42:31.803090] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T17:42:31.996732] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-09T17:42:32.796731] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-09T17:42:33.288511] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-09T17:42:33.330782] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T17:42:33.596727] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-09T17:42:34.173699] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T17:42:34.396757] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-09T17:42:34.742267] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T17:42:35.196719] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-09T17:42:35.838345] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T17:42:35.996765] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-09T17:42:36.796683] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-09T17:42:36.961772] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T17:42:37.226520] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T17:42:37.596735] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-09T17:42:38.396693] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-09T17:42:38.847740] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T17:42:39.011696] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T17:42:39.015248] [INFO ] [REMOTE ] BMO: Full fetch complete (59584 records). [2025-10-09T17:42:39.015357] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-09T17:42:39.197892] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-09T17:42:39.404567] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-09T17:42:39.404675] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-09T17:42:39.405357] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-09T17:42:39.405403] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-09T17:42:39.406622] [DEBUG] [LOCAL ] BMO: Trimmed 59584 records to 41397 (keeping 200 days of data) [2025-10-09T17:42:39.668202] [DEBUG] [LOCAL ] BMO: Primary data saved (41397 records). [2025-10-09T17:42:39.668343] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-09T17:42:39.668923] [INFO ] [MAIN ] Update Progress: 311/2373 symbols completed. BMO took 38.4s. Estimated remaining: 4h 42m 28s. Rate: 7.3 symbols/min [2025-10-09T17:42:39.848166] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:39.857456] [DEBUG] [LOCAL ] BNH: Loaded 5238 existing records from primary storage. [2025-10-09T17:42:39.857803] [INFO ] [MAIN ] BNH: Loaded 5238 existing records. [2025-10-09T17:42:40.005445] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-09T17:42:40.048228] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:40.049328] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-09T17:42:40.049455] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-09T17:42:40.049747] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-09T17:42:40.049815] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-09T17:42:40.280406] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T17:42:40.483332] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:40.802466] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-09T17:42:40.825108] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T17:42:41.420583] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T17:42:41.596737] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-09T17:42:42.396707] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-09T17:42:42.692851] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T17:42:42.911119] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-09T17:42:43.196738] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-09T17:42:43.804373] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-09T17:42:43.996725] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-09T17:42:44.732563] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T17:42:44.796685] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-09T17:42:45.596690] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-09T17:42:46.108544] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T17:42:46.265188] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:42:46.396694] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-09T17:42:47.036276] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:42:47.196716] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-09T17:42:47.996699] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-09T17:42:48.399064] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T17:42:48.437691] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T17:42:48.796784] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-09T17:42:49.288021] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T17:42:49.596777] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-09T17:42:50.216410] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-09T17:42:50.396747] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-09T17:42:50.750891] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T17:42:51.078018] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T17:42:51.196707] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-09T17:42:51.765390] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T17:42:51.996717] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-09T17:42:52.686605] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T17:42:52.796677] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-09T17:42:53.596708] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-09T17:42:53.671039] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T17:42:53.675795] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-09T17:42:53.675978] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-09T17:42:54.089364] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-09T17:42:54.089461] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-09T17:42:54.090301] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-09T17:42:54.090369] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-09T17:42:54.091858] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54147 (keeping 200 days of data) [2025-10-09T17:42:54.409497] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-09T17:42:54.436550] [DEBUG] [LOCAL ] BMY: Primary data saved (54147 records). [2025-10-09T17:42:54.436768] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-09T17:42:54.437553] [INFO ] [MAIN ] Update Progress: 312/2373 symbols completed. BMY took 43.1s. Estimated remaining: 4h 43m 3s. Rate: 7.3 symbols/min [2025-10-09T17:42:54.620179] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:54.626219] [DEBUG] [LOCAL ] BNJ: Loaded 2673 existing records from primary storage. [2025-10-09T17:42:54.626448] [INFO ] [MAIN ] BNJ: Loaded 2673 existing records. [2025-10-09T17:42:54.814092] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:54.814398] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-09T17:42:54.814460] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-09T17:42:54.814674] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-09T17:42:54.814733] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-09T17:42:55.016896] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T17:42:55.197138] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-09T17:42:55.223364] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:55.858711] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T17:42:56.004552] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-09T17:42:56.006587] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T17:42:56.011604] [INFO ] [REMOTE ] BN: Full fetch complete (76706 records). [2025-10-09T17:42:56.011755] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-09T17:42:56.421299] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-09T17:42:56.421389] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-09T17:42:56.422296] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-09T17:42:56.422361] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-09T17:42:56.423851] [DEBUG] [LOCAL ] BN: Trimmed 76706 records to 53376 (keeping 200 days of data) [2025-10-09T17:42:56.767880] [DEBUG] [LOCAL ] BN: Primary data saved (53376 records). [2025-10-09T17:42:56.768059] [INFO ] [MAIN ] BN: Full history saved. [2025-10-09T17:42:56.768221] [INFO ] [MAIN ] Update Progress: 313/2373 symbols completed. BN took 35.9s. Estimated remaining: 4h 42m 16s. Rate: 7.3 symbols/min [2025-10-09T17:42:56.800841] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-09T17:42:56.950810] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:56.995087] [DEBUG] [LOCAL ] BNL: Loaded 47176 existing records from primary storage. [2025-10-09T17:42:56.995489] [INFO ] [MAIN ] BNL: Loaded 47176 existing records. [2025-10-09T17:42:57.181528] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:42:57.182328] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T17:42:57.182486] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-09T17:42:57.184500] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-09T17:42:57.184842] [INFO ] [REMOTE ] BNED: Full fetch complete (43130 records). [2025-10-09T17:42:57.184902] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-09T17:42:57.184961] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-09T17:42:57.185157] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-09T17:42:57.602743] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-09T17:42:57.602682] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T17:42:57.920508] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:57.951680] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-09T17:42:57.951755] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-09T17:42:57.952318] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-09T17:42:57.952359] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-09T17:42:57.953309] [DEBUG] [LOCAL ] BNED: Trimmed 43130 records to 29262 (keeping 200 days of data) [2025-10-09T17:42:58.117365] [DEBUG] [LOCAL ] BNED: Primary data saved (29262 records). [2025-10-09T17:42:58.117503] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-09T17:42:58.117597] [INFO ] [MAIN ] Update Progress: 314/2373 symbols completed. BNED took 33.3s. Estimated remaining: 4h 41m 22s. Rate: 7.3 symbols/min [2025-10-09T17:42:58.284015] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:42:58.284194] [DEBUG] [LOCAL ] BNS: No existing data file found in primary storage. [2025-10-09T17:42:58.284249] [WARN ] [MAIN ] BNS: No existing data found, performing full refresh instead. [2025-10-09T17:42:58.284357] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-09T17:42:58.284398] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-09T17:42:58.284458] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-10-09T17:42:58.284527] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-09T17:42:58.401800] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-09T17:42:58.578329] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T17:42:58.661941] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:42:59.016150] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T17:42:59.196722] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-09T17:42:59.996770] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-09T17:43:00.516095] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T17:43:00.796683] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-09T17:43:00.998344] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T17:43:01.385423] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T17:43:01.596775] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-09T17:43:02.080344] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T17:43:02.396738] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-09T17:43:03.196718] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-09T17:43:03.742313] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T17:43:03.996684] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-09T17:43:04.098159] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T17:43:04.549402] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T17:43:04.796703] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-09T17:43:05.596714] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-09T17:43:06.067219] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T17:43:06.396742] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-09T17:43:06.449582] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T17:43:07.090734] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T17:43:07.196713] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-09T17:43:07.996791] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-09T17:43:08.506155] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-09T17:43:08.669541] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:43:08.796721] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-09T17:43:09.382169] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T17:43:09.383516] [INFO ] [REMOTE ] BNH: Full fetch complete (6948 records). [2025-10-09T17:43:09.383607] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-09T17:43:09.601963] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-09T17:43:09.769397] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-09T17:43:09.769477] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-09T17:43:09.769748] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-09T17:43:09.769811] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-09T17:43:09.770204] [DEBUG] [LOCAL ] BNH: Trimmed 6948 records to 5264 (keeping 200 days of data) [2025-10-09T17:43:09.803271] [DEBUG] [LOCAL ] BNH: Primary data saved (5264 records). [2025-10-09T17:43:09.803370] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-09T17:43:09.803461] [INFO ] [MAIN ] Update Progress: 315/2373 symbols completed. BNH took 30.1s. Estimated remaining: 4h 41m 37s. Rate: 7.3 symbols/min [2025-10-09T17:43:09.981245] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:09.987348] [DEBUG] [LOCAL ] BNT: Loaded 3347 existing records from primary storage. [2025-10-09T17:43:09.987506] [INFO ] [MAIN ] BNT: Loaded 3347 existing records. [2025-10-09T17:43:10.178989] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-09T17:43:10.178787] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:10.180741] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-09T17:43:10.180804] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-09T17:43:10.180964] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-09T17:43:10.181023] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-09T17:43:10.402021] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-09T17:43:10.556288] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:10.915130] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T17:43:11.196721] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-09T17:43:11.741728] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-09T17:43:11.996767] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-09T17:43:12.564246] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T17:43:12.796816] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-09T17:43:13.596718] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-09T17:43:14.397502] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-09T17:43:14.403339] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T17:43:14.958967] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T17:43:14.961605] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T17:43:15.196689] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-09T17:43:15.996766] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-09T17:43:16.368293] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T17:43:16.730831] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:43:16.796691] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-09T17:43:17.596695] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-09T17:43:18.156281] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T17:43:18.338619] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T17:43:18.396676] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-09T17:43:19.196715] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-09T17:43:19.861056] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-09T17:43:19.996698] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-09T17:43:20.035850] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T17:43:20.796746] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-09T17:43:21.405921] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T17:43:21.406839] [INFO ] [REMOTE ] BNJ: Full fetch complete (4205 records). [2025-10-09T17:43:21.406914] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-09T17:43:21.600430] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-09T17:43:21.808624] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T17:43:21.839560] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-09T17:43:21.839754] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-09T17:43:21.839908] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-09T17:43:21.840221] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-09T17:43:21.840596] [DEBUG] [LOCAL ] BNJ: Trimmed 4205 records to 2684 (keeping 200 days of data) [2025-10-09T17:43:21.857253] [DEBUG] [LOCAL ] BNJ: Primary data saved (2684 records). [2025-10-09T17:43:21.857313] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-09T17:43:21.857405] [INFO ] [MAIN ] Update Progress: 316/2373 symbols completed. BNJ took 27.4s. Estimated remaining: 4h 41m 54s. Rate: 7.3 symbols/min [2025-10-09T17:43:22.024326] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:22.033744] [DEBUG] [LOCAL ] BNY: Loaded 7144 existing records from primary storage. [2025-10-09T17:43:22.033976] [INFO ] [MAIN ] BNY: Loaded 7144 existing records. [2025-10-09T17:43:22.210233] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:22.210535] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-09T17:43:22.210593] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-09T17:43:22.210938] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-09T17:43:22.210995] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-09T17:43:22.396775] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-09T17:43:22.557464] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:23.068682] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T17:43:23.196728] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-09T17:43:23.417269] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T17:43:23.644731] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T17:43:23.996778] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-09T17:43:24.566098] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T17:43:24.796783] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-09T17:43:25.119156] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-09T17:43:25.596709] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-09T17:43:26.396784] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-09T17:43:26.502429] [DEBUG] [REMOTE ] BNY: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-09T17:43:26.502733] [WARN ] [REMOTE ] BNY: No data returned for month 2024-12 [2025-10-09T17:43:26.502833] [FATAL] [REMOTE ] BNY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:43:26.502897] [FATAL] [MAIN ] BNY: Failed to fetch primary data. [2025-10-09T17:43:26.502958] [WARN ] [MAIN ] BNY: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:43:26.503026] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-09T17:43:26.503088] [DEBUG] [LOCAL ] BNY: No primary data file found to delete. [2025-10-09T17:43:26.503125] [INFO ] [LOCAL ] BNY: Starting deletion of derivative data. [2025-10-09T17:43:26.503386] [DEBUG] [LOCAL ] BNY: Deleted derivative data file. [2025-10-09T17:43:26.503479] [INFO ] [MAIN ] Update Progress: 317/2373 symbols completed. BNY took 4.6s. Estimated remaining: 4h 41m 22s. Rate: 7.3 symbols/min [2025-10-09T17:43:27.196722] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-09T17:43:27.473811] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T17:43:27.935247] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T17:43:27.996731] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-09T17:43:28.796832] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-09T17:43:29.306123] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T17:43:29.307111] [INFO ] [REMOTE ] BNT: Full fetch complete (4518 records). [2025-10-09T17:43:29.307182] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-09T17:43:29.597113] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-09T17:43:29.681508] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-09T17:43:29.681783] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-09T17:43:29.682084] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-09T17:43:29.682229] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-09T17:43:29.682832] [DEBUG] [LOCAL ] BNT: Trimmed 4518 records to 3368 (keeping 200 days of data) [2025-10-09T17:43:29.704186] [DEBUG] [LOCAL ] BNT: Primary data saved (3368 records). [2025-10-09T17:43:29.704313] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-09T17:43:29.704485] [INFO ] [MAIN ] Update Progress: 318/2373 symbols completed. BNT took 19.9s. Estimated remaining: 4h 40m 42s. Rate: 7.3 symbols/min [2025-10-09T17:43:29.784923] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T17:43:30.396764] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-09T17:43:31.357333] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:43:31.367808] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-09T17:43:31.918407] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:43:31.996676] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-09T17:43:32.964864] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:43:32.975326] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-09T17:43:33.760610] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:43:33.771967] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-09T17:43:34.407219] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T17:43:34.417585] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-09T17:43:35.223280] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T17:43:35.234569] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-09T17:43:35.991409] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T17:43:35.995907] [INFO ] [REMOTE ] BNL: Full fetch complete (67094 records). [2025-10-09T17:43:35.996078] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-09T17:43:36.401270] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-09T17:43:36.401354] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-09T17:43:36.402105] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-09T17:43:36.402171] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-09T17:43:36.403462] [DEBUG] [LOCAL ] BNL: Trimmed 67094 records to 47534 (keeping 200 days of data) [2025-10-09T17:43:36.694101] [DEBUG] [LOCAL ] BNL: Primary data saved (47534 records). [2025-10-09T17:43:36.694267] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-09T17:43:36.695196] [INFO ] [MAIN ] Update Progress: 319/2373 symbols completed. BNL took 39.9s. Estimated remaining: 4h 40m 26s. Rate: 7.3 symbols/min [2025-10-09T17:43:36.871991] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T17:43:36.883307] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-09T17:43:38.338106] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T17:43:38.342435] [INFO ] [REMOTE ] BNS: Full fetch complete (74350 records). [2025-10-09T17:43:38.342544] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-09T17:43:38.740055] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-09T17:43:38.740148] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-09T17:43:38.741185] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-09T17:43:38.741257] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-09T17:43:38.743001] [DEBUG] [LOCAL ] BNS: Trimmed 74350 records to 51843 (keeping 200 days of data) [2025-10-09T17:43:39.068687] [DEBUG] [LOCAL ] BNS: Primary data saved (51843 records). [2025-10-09T17:43:39.068855] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-09T17:43:39.068956] [INFO ] [MAIN ] Update Progress: 320/2373 symbols completed. BNS took 41.0s. Estimated remaining: 4h 39m 40s. Rate: 7.3 symbols/min [2025-10-09T17:43:39.738541] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:39.786400] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:39.763152] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:39.783485] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:43:39.828444] [DEBUG] [LOCAL ] BOE: Loaded 18088 existing records from primary storage. [2025-10-09T17:43:39.853476] [DEBUG] [LOCAL ] BOC: Loaded 18353 existing records from primary storage. [2025-10-09T17:43:39.853677] [INFO ] [MAIN ] BOE: Loaded 18088 existing records. [2025-10-09T17:43:39.852242] [DEBUG] [LOCAL ] BOH: Loaded 30374 existing records from primary storage. [2025-10-09T17:43:39.854318] [DEBUG] [LOCAL ] BOND: Loaded 32252 existing records from primary storage. [2025-10-09T17:43:39.859737] [INFO ] [MAIN ] BOC: Loaded 18353 existing records. [2025-10-09T17:43:39.866173] [INFO ] [MAIN ] BOH: Loaded 30374 existing records. [2025-10-09T17:43:39.887492] [INFO ] [MAIN ] BOND: Loaded 32252 existing records. [2025-10-09T17:43:40.533697] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:40.546050] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:40.598922] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-09T17:43:40.599208] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-09T17:43:40.603437] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:40.603737] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-09T17:43:40.598715] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:43:40.599143] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-09T17:43:40.604346] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-09T17:43:40.604156] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-09T17:43:40.604656] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-09T17:43:40.604597] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-09T17:43:40.604972] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-09T17:43:40.605134] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-09T17:43:40.605245] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-09T17:43:40.605205] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-09T17:43:40.610898] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-09T17:43:40.635225] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-09T17:43:40.656125] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-09T17:43:40.670492] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-09T17:43:41.985851] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:41.981959] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:42.001687] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-09T17:43:42.012254] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-09T17:43:42.083942] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:42.106906] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-09T17:43:42.111098] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:43:42.111393] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-09T17:43:43.141138] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T17:43:43.145402] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-09T17:43:43.203590] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T17:43:43.209480] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-09T17:43:43.276466] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T17:43:43.281568] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-09T17:43:43.595907] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T17:43:43.602612] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-09T17:43:43.848421] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T17:43:43.852468] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-09T17:43:44.337529] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T17:43:44.342212] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-09T17:43:44.536032] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:43:44.794817] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:43:44.798589] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-09T17:43:44.891930] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T17:43:45.294505] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T17:43:45.596720] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-09T17:43:45.815752] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T17:43:46.396688] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-09T17:43:46.599568] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T17:43:47.196716] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-09T17:43:47.472675] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T17:43:47.996684] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-09T17:43:48.207864] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T17:43:48.796684] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-09T17:43:49.130184] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T17:43:49.596706] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-09T17:43:50.209760] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T17:43:50.312429] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T17:43:50.396727] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-09T17:43:51.196726] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-09T17:43:51.772976] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:43:51.996846] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-09T17:43:51.997952] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T17:43:52.796675] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-09T17:43:53.261706] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T17:43:53.596740] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-09T17:43:53.952905] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T17:43:54.396715] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-09T17:43:55.031850] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T17:43:55.196686] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-09T17:43:55.336741] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T17:43:55.996700] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-09T17:43:56.280709] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T17:43:56.796713] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-09T17:43:57.371580] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T17:43:57.446379] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T17:43:57.596702] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-09T17:43:58.396751] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-09T17:43:58.469434] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T17:43:59.196741] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-09T17:43:59.393561] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T17:43:59.887703] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T17:43:59.996786] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-09T17:44:00.796727] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-09T17:44:01.344974] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T17:44:01.596771] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-09T17:44:01.854188] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T17:44:01.856094] [INFO ] [REMOTE ] BOC: Full fetch complete (25720 records). [2025-10-09T17:44:01.856170] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-09T17:44:02.223536] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-09T17:44:02.223624] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-09T17:44:02.224045] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-09T17:44:02.224097] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-09T17:44:02.224885] [DEBUG] [LOCAL ] BOC: Trimmed 25720 records to 18567 (keeping 200 days of data) [2025-10-09T17:44:02.335237] [DEBUG] [LOCAL ] BOC: Primary data saved (18567 records). [2025-10-09T17:44:02.335394] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-09T17:44:02.335479] [INFO ] [MAIN ] Update Progress: 321/2373 symbols completed. BOC took 23.3s. Estimated remaining: 4h 41m 8s. Rate: 7.3 symbols/min [2025-10-09T17:44:02.401815] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-09T17:44:02.507331] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:02.546175] [DEBUG] [LOCAL ] BOOT: Loaded 40139 existing records from primary storage. [2025-10-09T17:44:02.546465] [INFO ] [MAIN ] BOOT: Loaded 40139 existing records. [2025-10-09T17:44:02.727619] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:02.727892] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-09T17:44:02.728015] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-09T17:44:02.728249] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-09T17:44:02.728308] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-09T17:44:03.107473] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:03.130421] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:44:03.196710] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-09T17:44:03.879518] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T17:44:03.996721] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-09T17:44:04.535115] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T17:44:04.796781] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-09T17:44:05.324110] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T17:44:05.327684] [INFO ] [REMOTE ] BOND: Full fetch complete (46445 records). [2025-10-09T17:44:05.327859] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-09T17:44:05.601965] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-09T17:44:05.814557] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-09T17:44:05.814688] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-09T17:44:05.815371] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-09T17:44:05.815418] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-09T17:44:05.816596] [DEBUG] [LOCAL ] BOND: Trimmed 46445 records to 32491 (keeping 200 days of data) [2025-10-09T17:44:05.951755] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T17:44:06.054005] [DEBUG] [LOCAL ] BOND: Primary data saved (32491 records). [2025-10-09T17:44:06.054141] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-09T17:44:06.054225] [INFO ] [MAIN ] Update Progress: 322/2373 symbols completed. BOND took 27.0s. Estimated remaining: 4h 40m 32s. Rate: 7.3 symbols/min [2025-10-09T17:44:06.219811] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:06.266072] [DEBUG] [LOCAL ] BORR: Loaded 51092 existing records from primary storage. [2025-10-09T17:44:06.266376] [INFO ] [MAIN ] BORR: Loaded 51092 existing records. [2025-10-09T17:44:06.404901] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-09T17:44:06.445914] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:06.446222] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-09T17:44:06.446271] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-09T17:44:06.446761] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-09T17:44:06.446819] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-09T17:44:06.820379] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T17:44:06.819849] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:07.196764] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-09T17:44:07.829182] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T17:44:07.996776] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-09T17:44:08.613905] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T17:44:08.630852] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T17:44:08.796741] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-09T17:44:09.596712] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-09T17:44:10.396689] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-09T17:44:10.411360] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T17:44:10.768359] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-09T17:44:11.196774] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-09T17:44:11.440727] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T17:44:11.996774] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-09T17:44:12.801897] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-09T17:44:12.820051] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T17:44:13.555979] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T17:44:13.596680] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-09T17:44:13.671492] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T17:44:14.396742] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-09T17:44:15.196708] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-09T17:44:15.265721] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T17:44:15.422663] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T17:44:15.426214] [INFO ] [REMOTE ] BOE: Full fetch complete (26724 records). [2025-10-09T17:44:15.426338] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-09T17:44:15.806991] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-09T17:44:15.807069] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-09T17:44:15.807438] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-09T17:44:15.807477] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-09T17:44:15.808156] [DEBUG] [LOCAL ] BOE: Trimmed 26724 records to 18227 (keeping 200 days of data) [2025-10-09T17:44:15.916926] [DEBUG] [LOCAL ] BOE: Primary data saved (18227 records). [2025-10-09T17:44:15.917059] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-09T17:44:15.917139] [INFO ] [MAIN ] Update Progress: 323/2373 symbols completed. BOE took 36.8s. Estimated remaining: 4h 40m 34s. Rate: 7.3 symbols/min [2025-10-09T17:44:16.004691] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-09T17:44:16.087762] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:16.109824] [DEBUG] [LOCAL ] BOW: Loaded 23766 existing records from primary storage. [2025-10-09T17:44:16.110072] [INFO ] [MAIN ] BOW: Loaded 23766 existing records. [2025-10-09T17:44:16.294681] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:16.295959] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T17:44:16.296252] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-09T17:44:16.298639] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-09T17:44:16.299496] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-09T17:44:16.299451] [INFO ] [REMOTE ] BOH: Full fetch complete (44742 records). [2025-10-09T17:44:16.299775] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-09T17:44:16.299692] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-09T17:44:16.798363] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-09T17:44:16.961578] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:17.046347] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-09T17:44:17.046443] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-09T17:44:17.047145] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-09T17:44:17.047218] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-09T17:44:17.048427] [DEBUG] [LOCAL ] BOH: Trimmed 44742 records to 30612 (keeping 200 days of data) [2025-10-09T17:44:17.300161] [DEBUG] [LOCAL ] BOH: Primary data saved (30612 records). [2025-10-09T17:44:17.300371] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-09T17:44:17.300472] [INFO ] [MAIN ] Update Progress: 324/2373 symbols completed. BOH took 38.2s. Estimated remaining: 4h 39m 43s. Rate: 7.3 symbols/min [2025-10-09T17:44:17.471913] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:17.519242] [DEBUG] [LOCAL ] BOX: Loaded 50230 existing records from primary storage. [2025-10-09T17:44:17.519609] [INFO ] [MAIN ] BOX: Loaded 50230 existing records. [2025-10-09T17:44:17.599011] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-09T17:44:17.698726] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:17.699008] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-09T17:44:17.699132] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-09T17:44:17.699844] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-09T17:44:17.699910] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-09T17:44:17.898097] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T17:44:18.095490] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:18.396722] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-09T17:44:18.760264] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-09T17:44:18.824402] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T17:44:19.196766] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-09T17:44:19.835624] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T17:44:20.002091] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-09T17:44:20.015460] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:44:20.796777] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-09T17:44:21.596717] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-09T17:44:21.878181] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T17:44:22.396697] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-09T17:44:22.407024] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T17:44:22.494539] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T17:44:23.196725] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-09T17:44:23.996710] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-09T17:44:24.052842] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T17:44:24.558155] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T17:44:24.796752] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-09T17:44:25.596708] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-09T17:44:25.745629] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T17:44:26.312206] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T17:44:26.396735] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-09T17:44:26.608035] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T17:44:27.196730] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-09T17:44:27.690313] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T17:44:27.996737] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-09T17:44:28.774888] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T17:44:28.796667] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-09T17:44:29.598475] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-09T17:44:29.601563] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T17:44:30.396772] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-09T17:44:30.566848] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T17:44:30.902848] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T17:44:31.196780] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-09T17:44:31.996736] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-09T17:44:32.057377] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T17:44:32.098887] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T17:44:32.796725] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-09T17:44:33.596763] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-09T17:44:33.881413] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T17:44:33.905521] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T17:44:34.396716] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-09T17:44:35.185608] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:44:35.196666] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-09T17:44:35.488154] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T17:44:35.996722] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-09T17:44:36.796709] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-09T17:44:37.107533] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T17:44:37.296153] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T17:44:37.452133] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T17:44:37.596737] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-09T17:44:38.396726] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-09T17:44:39.196748] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-09T17:44:39.270933] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T17:44:39.899398] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T17:44:39.996694] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-09T17:44:40.506593] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T17:44:40.509943] [INFO ] [REMOTE ] BOW: Full fetch complete (32106 records). [2025-10-09T17:44:40.510027] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-09T17:44:40.801850] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-09T17:44:40.903413] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-09T17:44:40.903512] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-09T17:44:40.903965] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-09T17:44:40.904027] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-09T17:44:40.904783] [DEBUG] [LOCAL ] BOW: Trimmed 32106 records to 23981 (keeping 200 days of data) [2025-10-09T17:44:41.046002] [DEBUG] [LOCAL ] BOW: Primary data saved (23981 records). [2025-10-09T17:44:41.046148] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-09T17:44:41.046233] [INFO ] [MAIN ] Update Progress: 325/2373 symbols completed. BOW took 25.1s. Estimated remaining: 4h 41m 12s. Rate: 7.3 symbols/min [2025-10-09T17:44:41.214212] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:41.264481] [DEBUG] [LOCAL ] BP: Loaded 53709 existing records from primary storage. [2025-10-09T17:44:41.272760] [INFO ] [MAIN ] BP: Loaded 53709 existing records. [2025-10-09T17:44:41.273022] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T17:44:41.339263] [INFO ] [REMOTE ] BOOT: Full fetch complete (60013 records). [2025-10-09T17:44:41.355789] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-09T17:44:41.571227] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:41.586808] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-09T17:44:41.592013] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-09T17:44:41.597253] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-09T17:44:41.612633] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-09T17:44:41.625327] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-09T17:44:42.169273] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-09T17:44:42.172913] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-09T17:44:42.179360] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-09T17:44:42.184761] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-09T17:44:42.256096] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:42.257097] [DEBUG] [LOCAL ] BOOT: Trimmed 60013 records to 40347 (keeping 200 days of data) [2025-10-09T17:44:42.381511] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T17:44:42.396627] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-09T17:44:42.570159] [DEBUG] [LOCAL ] BOOT: Primary data saved (40347 records). [2025-10-09T17:44:42.570315] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-09T17:44:42.571089] [INFO ] [MAIN ] Update Progress: 326/2373 symbols completed. BOOT took 40.2s. Estimated remaining: 4h 40m 22s. Rate: 7.3 symbols/min [2025-10-09T17:44:42.760125] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:42.794725] [DEBUG] [LOCAL ] BR: Loaded 34795 existing records from primary storage. [2025-10-09T17:44:42.795019] [INFO ] [MAIN ] BR: Loaded 34795 existing records. [2025-10-09T17:44:42.973746] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:42.973947] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-09T17:44:42.973992] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-09T17:44:42.974186] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-09T17:44:42.974242] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-09T17:44:43.202379] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-09T17:44:43.362058] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:43.380772] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T17:44:43.384944] [INFO ] [REMOTE ] BORR: Full fetch complete (74570 records). [2025-10-09T17:44:43.385046] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-09T17:44:43.771541] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-09T17:44:43.771770] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-09T17:44:43.772617] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-09T17:44:43.772710] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-09T17:44:43.774204] [DEBUG] [LOCAL ] BORR: Trimmed 74570 records to 51475 (keeping 200 days of data) [2025-10-09T17:44:43.997046] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-09T17:44:44.071316] [DEBUG] [LOCAL ] BORR: Primary data saved (51475 records). [2025-10-09T17:44:44.071579] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-09T17:44:44.071818] [INFO ] [MAIN ] Update Progress: 327/2373 symbols completed. BORR took 38.0s. Estimated remaining: 4h 39m 32s. Rate: 7.3 symbols/min [2025-10-09T17:44:44.209511] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T17:44:44.282113] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:44:44.330346] [DEBUG] [LOCAL ] BRBR: Loaded 51454 existing records from primary storage. [2025-10-09T17:44:44.330677] [INFO ] [MAIN ] BRBR: Loaded 51454 existing records. [2025-10-09T17:44:44.508860] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:44:44.509110] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-09T17:44:44.509172] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-09T17:44:44.509445] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-09T17:44:44.509517] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-09T17:44:44.804336] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-09T17:44:44.884807] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:44:45.116777] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T17:44:45.173871] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T17:44:45.596754] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-09T17:44:46.369394] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:44:46.396680] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-09T17:44:47.196695] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-09T17:44:47.672002] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T17:44:47.996684] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-09T17:44:48.079181] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T17:44:48.783020] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T17:44:48.796665] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-09T17:44:49.596685] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-09T17:44:49.692215] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T17:44:50.370246] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T17:44:50.396679] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-09T17:44:50.596923] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T17:44:51.196744] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-09T17:44:51.937980] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T17:44:51.996691] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-09T17:44:52.796722] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-09T17:44:53.092435] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T17:44:53.596700] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-09T17:44:53.657182] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T17:44:54.396728] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-09T17:44:54.626959] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T17:44:54.851357] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T17:44:55.196734] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-09T17:44:55.996713] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-09T17:44:56.561877] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-09T17:44:56.796805] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-09T17:44:56.940514] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T17:44:57.176162] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T17:44:57.596792] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-09T17:44:58.405530] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-09T17:44:58.429268] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T17:44:58.917347] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T17:44:59.196735] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-09T17:44:59.700563] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T17:44:59.704955] [INFO ] [REMOTE ] BOX: Full fetch complete (72092 records). [2025-10-09T17:44:59.705087] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-09T17:45:00.001818] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-09T17:45:00.111325] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-09T17:45:00.111405] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-09T17:45:00.112219] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-09T17:45:00.112286] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-09T17:45:00.113822] [DEBUG] [LOCAL ] BOX: Trimmed 72092 records to 50568 (keeping 200 days of data) [2025-10-09T17:45:00.416670] [DEBUG] [LOCAL ] BOX: Primary data saved (50568 records). [2025-10-09T17:45:00.416979] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-09T17:45:00.425586] [INFO ] [MAIN ] Update Progress: 328/2373 symbols completed. BOX took 43.1s. Estimated remaining: 4h 40m 14s. Rate: 7.3 symbols/min [2025-10-09T17:45:00.517879] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T17:45:00.620213] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:00.641090] [DEBUG] [LOCAL ] BRC: Loaded 18784 existing records from primary storage. [2025-10-09T17:45:00.641347] [INFO ] [MAIN ] BRC: Loaded 18784 existing records. [2025-10-09T17:45:00.801376] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-09T17:45:00.823206] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:00.824424] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-09T17:45:00.824523] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-09T17:45:00.824805] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-09T17:45:00.824875] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-09T17:45:01.178792] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:01.596766] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-09T17:45:02.149972] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-09T17:45:02.210292] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T17:45:02.396750] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-09T17:45:02.879149] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T17:45:03.196765] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-09T17:45:03.977025] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T17:45:03.996677] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-09T17:45:04.796727] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-09T17:45:05.475476] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-09T17:45:05.603984] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-09T17:45:05.608949] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T17:45:05.891955] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T17:45:06.396732] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-09T17:45:07.196785] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-09T17:45:07.460742] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T17:45:07.873437] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T17:45:07.996770] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-09T17:45:08.796728] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-09T17:45:09.190917] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-09T17:45:09.284255] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T17:45:09.287198] [INFO ] [REMOTE ] BR: Full fetch complete (49248 records). [2025-10-09T17:45:09.287289] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-09T17:45:09.287958] [FATAL] [VALIDATOR ] BR: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:45:09.288048] [FATAL] [MAIN ] BR: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:45:09.288091] [WARN ] [MAIN ] BR: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:45:09.288208] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-09T17:45:09.288271] [DEBUG] [LOCAL ] BR: No primary data file found to delete. [2025-10-09T17:45:09.288330] [INFO ] [LOCAL ] BR: Starting deletion of derivative data. [2025-10-09T17:45:09.288573] [DEBUG] [LOCAL ] BR: Deleted derivative data file. [2025-10-09T17:45:09.289317] [INFO ] [MAIN ] Update Progress: 329/2373 symbols completed. BR took 26.7s. Estimated remaining: 4h 40m 10s. Rate: 7.3 symbols/min [2025-10-09T17:45:09.468232] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:09.512420] [DEBUG] [LOCAL ] BRCC: Loaded 40168 existing records from primary storage. [2025-10-09T17:45:09.512811] [INFO ] [MAIN ] BRCC: Loaded 40168 existing records. [2025-10-09T17:45:09.607232] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-09T17:45:09.705726] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:09.713940] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T17:45:09.713482] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-09T17:45:09.718786] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-09T17:45:09.719106] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-09T17:45:09.719179] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-09T17:45:10.067487] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:10.396764] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-09T17:45:10.951780] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T17:45:11.196714] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-09T17:45:11.996686] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-09T17:45:12.088252] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T17:45:12.796764] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-09T17:45:13.421004] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-09T17:45:13.576549] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T17:45:13.596666] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-09T17:45:14.041755] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:45:14.396745] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-09T17:45:15.196723] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-09T17:45:15.949598] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T17:45:15.996680] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-09T17:45:16.065320] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-09T17:45:16.796736] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-09T17:45:17.160917] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T17:45:17.588762] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-09T17:45:17.599552] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-09T17:45:18.396752] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-09T17:45:18.642458] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-09T17:45:19.028184] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T17:45:19.196713] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-09T17:45:19.740491] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T17:45:19.996744] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-09T17:45:20.796748] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-09T17:45:20.984011] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-09T17:45:20.988515] [INFO ] [REMOTE ] BRBR: Full fetch complete (72343 records). [2025-10-09T17:45:20.988668] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-09T17:45:21.402614] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-09T17:45:21.402868] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-09T17:45:21.403800] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-09T17:45:21.403972] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-09T17:45:21.405374] [DEBUG] [LOCAL ] BRBR: Trimmed 72343 records to 51836 (keeping 200 days of data) [2025-10-09T17:45:21.531413] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T17:45:21.608998] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-09T17:45:21.748142] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T17:45:21.770209] [DEBUG] [LOCAL ] BRBR: Primary data saved (51836 records). [2025-10-09T17:45:21.770334] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-09T17:45:21.770450] [INFO ] [MAIN ] Update Progress: 330/2373 symbols completed. BRBR took 37.7s. Estimated remaining: 4h 40m 28s. Rate: 7.3 symbols/min [2025-10-09T17:45:21.940911] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:21.941099] [DEBUG] [LOCAL ] BRO: No existing data file found in primary storage. [2025-10-09T17:45:21.941155] [WARN ] [MAIN ] BRO: No existing data found, performing full refresh instead. [2025-10-09T17:45:21.941285] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-09T17:45:21.941340] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-09T17:45:21.941397] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-09T17:45:21.941434] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-09T17:45:22.297201] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:22.396691] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-09T17:45:23.203734] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-09T17:45:23.208756] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:45:23.996725] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-09T17:45:24.110402] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T17:45:24.796733] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-09T17:45:25.361115] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-09T17:45:25.366813] [INFO ] [REMOTE ] BP: Full fetch complete (77761 records). [2025-10-09T17:45:25.366997] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-09T17:45:25.601840] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-09T17:45:25.707572] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:45:25.829522] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-09T17:45:25.829612] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-09T17:45:25.830586] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-09T17:45:25.830698] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-09T17:45:25.832272] [DEBUG] [LOCAL ] BP: Trimmed 77761 records to 54099 (keeping 200 days of data) [2025-10-09T17:45:26.180851] [DEBUG] [LOCAL ] BP: Primary data saved (54099 records). [2025-10-09T17:45:26.181017] [INFO ] [MAIN ] BP: Full history saved. [2025-10-09T17:45:26.181883] [INFO ] [MAIN ] Update Progress: 331/2373 symbols completed. BP took 45.1s. Estimated remaining: 4h 39m 56s. Rate: 7.3 symbols/min [2025-10-09T17:45:26.362132] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:26.396686] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-09T17:45:26.415934] [DEBUG] [LOCAL ] BROS: Loaded 53299 existing records from primary storage. [2025-10-09T17:45:26.416301] [INFO ] [MAIN ] BROS: Loaded 53299 existing records. [2025-10-09T17:45:26.599680] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:26.600088] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-09T17:45:26.600250] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-09T17:45:26.600814] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-09T17:45:26.611926] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-09T17:45:26.612828] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T17:45:26.796714] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-09T17:45:27.037434] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:27.196723] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-09T17:45:27.661531] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T17:45:27.996744] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-09T17:45:28.097694] [DEBUG] [REMOTE ] BRC: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-09T17:45:28.098031] [WARN ] [REMOTE ] BRC: No data returned for month 2025-06 [2025-10-09T17:45:28.098145] [FATAL] [REMOTE ] BRC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:45:28.098255] [FATAL] [MAIN ] BRC: Failed to fetch primary data. [2025-10-09T17:45:28.098323] [WARN ] [MAIN ] BRC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:45:28.098394] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-09T17:45:28.098497] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-10-09T17:45:28.098559] [INFO ] [LOCAL ] BRC: Starting deletion of derivative data. [2025-10-09T17:45:28.098774] [DEBUG] [LOCAL ] BRC: Deleted derivative data file. [2025-10-09T17:45:28.098861] [INFO ] [MAIN ] Update Progress: 332/2373 symbols completed. BRC took 27.7s. Estimated remaining: 4h 39m 9s. Rate: 7.3 symbols/min [2025-10-09T17:45:28.267795] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:28.268002] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-09T17:45:28.268051] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-09T17:45:28.268163] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-09T17:45:28.268206] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-09T17:45:28.268248] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-09T17:45:28.268280] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-09T17:45:28.642281] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:28.796725] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-09T17:45:29.119475] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T17:45:29.596735] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-09T17:45:30.396711] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-09T17:45:30.480348] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T17:45:30.638178] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:45:30.638606] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-09T17:45:30.638728] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:45:30.638781] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-09T17:45:30.638843] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:45:30.638919] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-09T17:45:30.639022] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-09T17:45:30.639078] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-09T17:45:30.639120] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-09T17:45:30.639169] [INFO ] [MAIN ] Update Progress: 333/2373 symbols completed. BRSL took 2.5s. Estimated remaining: 4h 38m 26s. Rate: 7.3 symbols/min [2025-10-09T17:45:30.813350] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:30.840843] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T17:45:30.880825] [DEBUG] [LOCAL ] BRSP: Loaded 36626 existing records from primary storage. [2025-10-09T17:45:30.881107] [INFO ] [MAIN ] BRSP: Loaded 36626 existing records. [2025-10-09T17:45:31.062235] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:31.062467] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-09T17:45:31.062514] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-09T17:45:31.062769] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-09T17:45:31.062825] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-09T17:45:31.201917] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-09T17:45:31.415672] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:31.996751] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-09T17:45:32.796784] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-09T17:45:33.004756] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T17:45:33.259214] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T17:45:33.262312] [INFO ] [REMOTE ] BRCC: Full fetch complete (57181 records). [2025-10-09T17:45:33.262421] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-09T17:45:33.263107] [FATAL] [VALIDATOR ] BRCC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:45:33.263197] [FATAL] [MAIN ] BRCC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:45:33.263241] [WARN ] [MAIN ] BRCC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:45:33.263279] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-09T17:45:33.263334] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-09T17:45:33.263369] [INFO ] [LOCAL ] BRCC: Starting deletion of derivative data. [2025-10-09T17:45:33.263554] [DEBUG] [LOCAL ] BRCC: Deleted derivative data file. [2025-10-09T17:45:33.264098] [INFO ] [MAIN ] Update Progress: 334/2373 symbols completed. BRCC took 24.0s. Estimated remaining: 4h 37m 44s. Rate: 7.3 symbols/min [2025-10-09T17:45:33.437930] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:33.447145] [DEBUG] [LOCAL ] BRT: Loaded 4995 existing records from primary storage. [2025-10-09T17:45:33.447372] [INFO ] [MAIN ] BRT: Loaded 4995 existing records. [2025-10-09T17:45:33.606897] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-09T17:45:33.627202] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:33.627409] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-09T17:45:33.627456] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-09T17:45:33.627588] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-09T17:45:33.627662] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-09T17:45:33.980919] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:34.063337] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T17:45:34.396726] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-09T17:45:35.092191] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T17:45:35.196707] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-09T17:45:35.228899] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T17:45:35.996757] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-09T17:45:36.497958] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T17:45:36.796727] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-09T17:45:37.596718] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-09T17:45:37.924549] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-09T17:45:38.216378] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T17:45:38.396783] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-09T17:45:38.474318] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T17:45:38.774916] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-09T17:45:39.196724] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-09T17:45:39.996719] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-09T17:45:40.629402] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T17:45:40.796704] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-09T17:45:41.596688] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-09T17:45:42.099568] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-09T17:45:42.192372] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T17:45:42.249710] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-09T17:45:42.396709] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-09T17:45:43.196784] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-09T17:45:43.916804] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T17:45:43.996682] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-09T17:45:44.796682] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-09T17:45:45.142717] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T17:45:45.300536] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T17:45:45.596692] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-09T17:45:45.610886] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T17:45:46.396722] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-09T17:45:46.951937] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T17:45:47.196702] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-09T17:45:47.592784] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T17:45:47.996715] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-09T17:45:48.796716] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-09T17:45:48.930699] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T17:45:49.132247] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T17:45:49.596714] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-09T17:45:49.658847] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:45:50.396719] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-09T17:45:51.179232] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T17:45:51.196675] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-09T17:45:51.996735] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-09T17:45:52.456878] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-09T17:45:52.492698] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:45:52.534276] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-09T17:45:52.796713] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-09T17:45:53.446493] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T17:45:53.596695] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-09T17:45:54.396726] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-09T17:45:55.196692] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-09T17:45:55.592379] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T17:45:55.758222] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T17:45:55.996754] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-09T17:45:56.338539] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-09T17:45:56.342586] [INFO ] [REMOTE ] BRO: Full fetch complete (74036 records). [2025-10-09T17:45:56.342735] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-09T17:45:56.343620] [FATAL] [VALIDATOR ] BRO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:45:56.343739] [FATAL] [MAIN ] BRO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:45:56.343785] [WARN ] [MAIN ] BRO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:45:56.343854] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-09T17:45:56.343946] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-10-09T17:45:56.344006] [INFO ] [LOCAL ] BRO: Starting deletion of derivative data. [2025-10-09T17:45:56.344052] [DEBUG] [LOCAL ] BRO: No derivative data file found to delete. [2025-10-09T17:45:56.344126] [INFO ] [MAIN ] Update Progress: 335/2373 symbols completed. BRO took 34.6s. Estimated remaining: 4h 39m 7s. Rate: 7.3 symbols/min [2025-10-09T17:45:56.536471] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:56.557935] [DEBUG] [LOCAL ] BRW: Loaded 20738 existing records from primary storage. [2025-10-09T17:45:56.558216] [INFO ] [MAIN ] BRW: Loaded 20738 existing records. [2025-10-09T17:45:56.755731] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:56.755918] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-09T17:45:56.755966] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-09T17:45:56.756183] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-09T17:45:56.756243] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-09T17:45:56.803754] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-09T17:45:57.141771] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:57.596727] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-09T17:45:58.025420] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-09T17:45:58.249171] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T17:45:58.250312] [INFO ] [REMOTE ] BRT: Full fetch complete (6885 records). [2025-10-09T17:45:58.250381] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-09T17:45:58.383053] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T17:45:58.405678] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-09T17:45:58.639154] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-09T17:45:58.639255] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-09T17:45:58.639441] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-09T17:45:58.639483] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-09T17:45:58.639942] [DEBUG] [LOCAL ] BRT: Trimmed 6885 records to 5083 (keeping 200 days of data) [2025-10-09T17:45:58.672291] [DEBUG] [LOCAL ] BRT: Primary data saved (5083 records). [2025-10-09T17:45:58.672429] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-09T17:45:58.672529] [INFO ] [MAIN ] Update Progress: 336/2373 symbols completed. BRT took 25.4s. Estimated remaining: 4h 38m 23s. Rate: 7.3 symbols/min [2025-10-09T17:45:58.838756] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:45:58.888363] [DEBUG] [LOCAL ] BRX: Loaded 51779 existing records from primary storage. [2025-10-09T17:45:58.888748] [INFO ] [MAIN ] BRX: Loaded 51779 existing records. [2025-10-09T17:45:59.067012] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:45:59.067241] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-09T17:45:59.067291] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-09T17:45:59.067564] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-09T17:45:59.067625] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-09T17:45:59.205117] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-09T17:45:59.427728] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:45:59.728331] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T17:45:59.996792] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-09T17:46:00.243630] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T17:46:00.796776] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-09T17:46:01.596738] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-09T17:46:01.817554] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T17:46:02.396683] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-09T17:46:02.575784] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T17:46:03.122293] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T17:46:03.196725] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-09T17:46:03.962551] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T17:46:03.996701] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-09T17:46:04.750556] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-09T17:46:04.757122] [INFO ] [REMOTE ] BROS: Full fetch complete (77076 records). [2025-10-09T17:46:04.757305] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-09T17:46:04.801853] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-09T17:46:05.097581] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T17:46:05.186075] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-09T17:46:05.186157] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-09T17:46:05.186970] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-09T17:46:05.187036] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-09T17:46:05.188518] [DEBUG] [LOCAL ] BROS: Trimmed 77076 records to 53689 (keeping 200 days of data) [2025-10-09T17:46:05.511270] [DEBUG] [LOCAL ] BROS: Primary data saved (53689 records). [2025-10-09T17:46:05.511416] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-09T17:46:05.512242] [INFO ] [MAIN ] Update Progress: 337/2373 symbols completed. BROS took 39.3s. Estimated remaining: 4h 38m 7s. Rate: 7.3 symbols/min [2025-10-09T17:46:05.601798] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-09T17:46:05.681699] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:05.714344] [DEBUG] [LOCAL ] BSAC: Loaded 32782 existing records from primary storage. [2025-10-09T17:46:05.714621] [INFO ] [MAIN ] BSAC: Loaded 32782 existing records. [2025-10-09T17:46:05.896682] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:05.896998] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-09T17:46:05.897226] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-09T17:46:05.897581] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-09T17:46:05.906024] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-09T17:46:06.017114] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T17:46:06.356928] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:06.396796] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-09T17:46:07.196774] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-09T17:46:07.401279] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T17:46:07.589549] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T17:46:07.996741] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-09T17:46:08.495553] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:46:08.796755] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-09T17:46:08.933619] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T17:46:09.596788] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-09T17:46:09.791185] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-09T17:46:10.396766] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-09T17:46:11.011958] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T17:46:11.196685] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-09T17:46:11.619197] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T17:46:11.622535] [INFO ] [REMOTE ] BRSP: Full fetch complete (54258 records). [2025-10-09T17:46:11.622624] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-09T17:46:12.001264] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-09T17:46:12.037510] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-09T17:46:12.037612] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-09T17:46:12.038307] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-09T17:46:12.038370] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-09T17:46:12.039796] [DEBUG] [LOCAL ] BRSP: Trimmed 54258 records to 36934 (keeping 200 days of data) [2025-10-09T17:46:12.261623] [DEBUG] [LOCAL ] BRSP: Primary data saved (36934 records). [2025-10-09T17:46:12.261810] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-09T17:46:12.262735] [INFO ] [MAIN ] Update Progress: 338/2373 symbols completed. BRSP took 41.6s. Estimated remaining: 4h 37m 50s. Rate: 7.3 symbols/min [2025-10-09T17:46:12.482197] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:12.519624] [DEBUG] [LOCAL ] BSBR: Loaded 35362 existing records from primary storage. [2025-10-09T17:46:12.519974] [INFO ] [MAIN ] BSBR: Loaded 35362 existing records. [2025-10-09T17:46:12.745972] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:12.746315] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-09T17:46:12.746512] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-09T17:46:12.757720] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-09T17:46:12.779135] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-09T17:46:12.809929] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-09T17:46:12.838175] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T17:46:13.170856] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:13.266097] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T17:46:13.596725] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-09T17:46:14.079507] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T17:46:14.396761] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-09T17:46:15.009745] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T17:46:15.196730] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-09T17:46:15.762676] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-09T17:46:15.996708] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-09T17:46:16.148694] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T17:46:16.796725] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-09T17:46:16.983078] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T17:46:17.596808] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-09T17:46:18.233362] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T17:46:18.396687] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-09T17:46:18.488742] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-09T17:46:19.196711] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-09T17:46:19.956541] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T17:46:19.996673] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-09T17:46:20.589970] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T17:46:20.796725] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-09T17:46:21.331078] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T17:46:21.576996] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T17:46:21.596681] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-09T17:46:22.396690] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-09T17:46:22.773975] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T17:46:23.196733] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-09T17:46:23.774749] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:46:23.996726] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-09T17:46:24.433223] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:46:24.796758] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-09T17:46:25.317822] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T17:46:25.596709] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-09T17:46:25.751556] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T17:46:26.396730] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-09T17:46:26.811150] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T17:46:26.813977] [INFO ] [REMOTE ] BRW: Full fetch complete (30313 records). [2025-10-09T17:46:26.814068] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-09T17:46:26.814597] [FATAL] [VALIDATOR ] BRW: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:46:26.814712] [FATAL] [MAIN ] BRW: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:46:26.814761] [WARN ] [MAIN ] BRW: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:46:26.814831] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-09T17:46:26.814919] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-09T17:46:26.814979] [INFO ] [LOCAL ] BRW: Starting deletion of derivative data. [2025-10-09T17:46:26.815224] [DEBUG] [LOCAL ] BRW: Deleted derivative data file. [2025-10-09T17:46:26.815324] [INFO ] [MAIN ] Update Progress: 339/2373 symbols completed. BRW took 30.5s. Estimated remaining: 4h 38m 20s. Rate: 7.3 symbols/min [2025-10-09T17:46:26.991039] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:27.001449] [DEBUG] [LOCAL ] BSL: Loaded 8181 existing records from primary storage. [2025-10-09T17:46:27.001680] [INFO ] [MAIN ] BSL: Loaded 8181 existing records. [2025-10-09T17:46:27.175619] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:27.175841] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-09T17:46:27.175889] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-09T17:46:27.176083] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-09T17:46:27.176141] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-09T17:46:27.207251] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-09T17:46:27.537255] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:27.996694] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-09T17:46:28.105779] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T17:46:28.515845] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T17:46:28.796728] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-09T17:46:29.000570] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T17:46:29.596783] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-09T17:46:30.298834] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T17:46:30.396689] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-09T17:46:30.936228] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T17:46:31.196749] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-09T17:46:31.996708] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-09T17:46:32.052983] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T17:46:32.554160] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T17:46:32.796751] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-09T17:46:32.932105] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T17:46:32.934822] [INFO ] [REMOTE ] BSAC: Full fetch complete (43947 records). [2025-10-09T17:46:32.934906] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-09T17:46:32.935614] [FATAL] [VALIDATOR ] BSAC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:46:32.935733] [FATAL] [MAIN ] BSAC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:46:32.935806] [WARN ] [MAIN ] BSAC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:46:32.935889] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-09T17:46:32.935972] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-09T17:46:32.936031] [INFO ] [LOCAL ] BSAC: Starting deletion of derivative data. [2025-10-09T17:46:32.936196] [DEBUG] [LOCAL ] BSAC: Deleted derivative data file. [2025-10-09T17:46:32.936867] [INFO ] [MAIN ] Update Progress: 340/2373 symbols completed. BSAC took 27.4s. Estimated remaining: 4h 37m 59s. Rate: 7.3 symbols/min [2025-10-09T17:46:33.159914] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:33.199338] [DEBUG] [LOCAL ] BSM: Loaded 32179 existing records from primary storage. [2025-10-09T17:46:33.199631] [INFO ] [MAIN ] BSM: Loaded 32179 existing records. [2025-10-09T17:46:33.383799] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:33.384071] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-09T17:46:33.384130] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-09T17:46:33.384379] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-09T17:46:33.384442] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-09T17:46:33.607617] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-09T17:46:33.834887] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:34.185082] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T17:46:34.389689] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-09T17:46:34.396676] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-09T17:46:35.133368] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T17:46:35.196671] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-09T17:46:35.996732] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-09T17:46:36.058370] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T17:46:36.796744] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-09T17:46:37.281484] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T17:46:37.518412] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T17:46:37.596722] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-09T17:46:38.396784] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-09T17:46:38.659625] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T17:46:39.196719] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-09T17:46:39.996688] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-09T17:46:40.071469] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T17:46:40.395589] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T17:46:40.757302] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T17:46:40.796675] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-09T17:46:41.404145] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T17:46:41.596705] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-09T17:46:42.396771] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-09T17:46:42.617152] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T17:46:43.196708] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-09T17:46:43.283492] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T17:46:43.996734] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-09T17:46:44.760179] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T17:46:44.764599] [INFO ] [REMOTE ] BRX: Full fetch complete (74951 records). [2025-10-09T17:46:44.764759] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-09T17:46:44.801836] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-09T17:46:45.178615] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-09T17:46:45.178788] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-09T17:46:45.179578] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-09T17:46:45.179626] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-09T17:46:45.181082] [DEBUG] [LOCAL ] BRX: Trimmed 74951 records to 52155 (keeping 200 days of data) [2025-10-09T17:46:45.429818] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:46:45.561597] [DEBUG] [LOCAL ] BRX: Primary data saved (52155 records). [2025-10-09T17:46:45.561781] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-09T17:46:45.562676] [INFO ] [MAIN ] Update Progress: 341/2373 symbols completed. BRX took 46.9s. Estimated remaining: 4h 38m 17s. Rate: 7.3 symbols/min [2025-10-09T17:46:45.601777] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-09T17:46:45.775481] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:45.798502] [DEBUG] [LOCAL ] BST: Loaded 18984 existing records from primary storage. [2025-10-09T17:46:45.798806] [INFO ] [MAIN ] BST: Loaded 18984 existing records. [2025-10-09T17:46:46.016612] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:46.016875] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-09T17:46:46.016958] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-09T17:46:46.017213] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-09T17:46:46.017271] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-09T17:46:46.371124] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:46.396664] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-09T17:46:46.461936] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T17:46:47.011586] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T17:46:47.196683] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-09T17:46:47.528946] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T17:46:47.967877] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T17:46:47.996671] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-09T17:46:48.598436] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T17:46:48.796715] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-09T17:46:49.596685] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-09T17:46:49.838610] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T17:46:50.396728] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-09T17:46:50.823080] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T17:46:51.196700] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-09T17:46:51.501298] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T17:46:51.944151] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T17:46:51.996672] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-09T17:46:52.796724] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-09T17:46:52.841745] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T17:46:53.596758] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-09T17:46:54.198769] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T17:46:54.396730] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-09T17:46:54.486225] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T17:46:54.487558] [INFO ] [REMOTE ] BSL: Full fetch complete (12725 records). [2025-10-09T17:46:54.487630] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-09T17:46:54.859183] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-09T17:46:54.859273] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-09T17:46:54.859577] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-09T17:46:54.859618] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-09T17:46:54.860154] [DEBUG] [LOCAL ] BSL: Trimmed 12725 records to 8276 (keeping 200 days of data) [2025-10-09T17:46:54.911347] [DEBUG] [LOCAL ] BSL: Primary data saved (8276 records). [2025-10-09T17:46:54.911496] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-09T17:46:54.911588] [INFO ] [MAIN ] Update Progress: 342/2373 symbols completed. BSL took 28.1s. Estimated remaining: 4h 38m 16s. Rate: 7.3 symbols/min [2025-10-09T17:46:55.077530] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:46:55.100877] [DEBUG] [LOCAL ] BSTZ: Loaded 24965 existing records from primary storage. [2025-10-09T17:46:55.101125] [INFO ] [MAIN ] BSTZ: Loaded 24965 existing records. [2025-10-09T17:46:55.198202] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-09T17:46:55.280766] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:46:55.281137] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-09T17:46:55.281198] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-09T17:46:55.281441] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-09T17:46:55.281502] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-09T17:46:55.467594] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T17:46:55.655873] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:46:55.996768] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-09T17:46:56.317139] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T17:46:56.796791] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-09T17:46:57.213715] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T17:46:57.596748] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-09T17:46:57.803872] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:46:58.396780] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-09T17:46:58.834386] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:46:59.196809] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-09T17:46:59.362269] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T17:46:59.996687] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-09T17:47:00.320834] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T17:47:00.796730] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-09T17:47:01.355890] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T17:47:01.359032] [INFO ] [REMOTE ] BSBR: Full fetch complete (50573 records). [2025-10-09T17:47:01.359122] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-09T17:47:01.603203] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-09T17:47:01.743036] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-09T17:47:01.743116] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-09T17:47:01.743713] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-09T17:47:01.743775] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-09T17:47:01.744865] [DEBUG] [LOCAL ] BSBR: Trimmed 50573 records to 35593 (keeping 200 days of data) [2025-10-09T17:47:01.950389] [DEBUG] [LOCAL ] BSBR: Primary data saved (35593 records). [2025-10-09T17:47:01.950529] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-09T17:47:01.951577] [INFO ] [MAIN ] Update Progress: 343/2373 symbols completed. BSBR took 49.7s. Estimated remaining: 4h 38m 0s. Rate: 7.3 symbols/min [2025-10-09T17:47:02.133487] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:02.139306] [DEBUG] [LOCAL ] BSX: No existing data file found in primary storage. [2025-10-09T17:47:02.139417] [WARN ] [MAIN ] BSX: No existing data found, performing full refresh instead. [2025-10-09T17:47:02.140556] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T17:47:02.140002] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-09T17:47:02.146561] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-09T17:47:02.146926] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-09T17:47:02.146971] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-09T17:47:02.401987] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-09T17:47:02.501117] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:03.035039] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:47:03.037558] [INFO ] [REMOTE ] BSM: Full fetch complete (46845 records). [2025-10-09T17:47:03.037676] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-09T17:47:03.038502] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:47:03.038605] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:47:03.038715] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:47:03.038814] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-09T17:47:03.038895] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-09T17:47:03.038935] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-09T17:47:03.039233] [DEBUG] [LOCAL ] BSM: Deleted derivative data file. [2025-10-09T17:47:03.039534] [INFO ] [MAIN ] Update Progress: 344/2373 symbols completed. BSM took 30.1s. Estimated remaining: 4h 37m 10s. Rate: 7.3 symbols/min [2025-10-09T17:47:03.204224] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-09T17:47:03.206820] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:03.218402] [DEBUG] [LOCAL ] BTA: Loaded 5488 existing records from primary storage. [2025-10-09T17:47:03.218738] [INFO ] [MAIN ] BTA: Loaded 5488 existing records. [2025-10-09T17:47:03.401463] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:47:03.401772] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-09T17:47:03.401827] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-09T17:47:03.402007] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-09T17:47:03.402064] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-09T17:47:03.775149] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:03.785292] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:47:03.996689] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-09T17:47:04.535186] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T17:47:04.768899] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T17:47:04.796678] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-09T17:47:05.534746] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T17:47:05.596697] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-09T17:47:06.396717] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-09T17:47:07.196729] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-09T17:47:07.491629] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T17:47:07.528571] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T17:47:07.627955] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T17:47:07.996768] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-09T17:47:08.796745] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-09T17:47:08.862306] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:47:09.386145] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-09T17:47:09.596700] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-09T17:47:10.396764] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-09T17:47:10.881005] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T17:47:11.027786] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T17:47:11.196728] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-09T17:47:11.996737] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-09T17:47:12.451132] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T17:47:12.796716] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-09T17:47:13.596698] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-09T17:47:13.758318] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T17:47:13.779918] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T17:47:14.396761] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-09T17:47:14.613828] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T17:47:15.114626] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T17:47:15.196759] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-09T17:47:15.682036] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-09T17:47:15.996745] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-09T17:47:16.796772] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-09T17:47:17.176947] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T17:47:17.596745] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-09T17:47:17.847027] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T17:47:18.168073] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T17:47:18.396731] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-09T17:47:19.086501] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T17:47:19.196742] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-09T17:47:19.799100] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T17:47:19.996733] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-09T17:47:20.628534] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T17:47:20.796701] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-09T17:47:21.596693] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-09T17:47:21.620765] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T17:47:21.622582] [INFO ] [REMOTE ] BST: Full fetch complete (28668 records). [2025-10-09T17:47:21.622674] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-09T17:47:21.988460] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-09T17:47:21.988543] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-09T17:47:21.989012] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-09T17:47:21.989126] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-09T17:47:21.990141] [DEBUG] [LOCAL ] BST: Trimmed 28668 records to 19081 (keeping 200 days of data) [2025-10-09T17:47:22.108321] [DEBUG] [LOCAL ] BST: Primary data saved (19081 records). [2025-10-09T17:47:22.108480] [INFO ] [MAIN ] BST: Full history saved. [2025-10-09T17:47:22.108568] [INFO ] [MAIN ] Update Progress: 345/2373 symbols completed. BST took 36.5s. Estimated remaining: 4h 38m 6s. Rate: 7.3 symbols/min [2025-10-09T17:47:22.278357] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:22.295906] [DEBUG] [LOCAL ] BTCM: Loaded 16133 existing records from primary storage. [2025-10-09T17:47:22.296156] [INFO ] [MAIN ] BTCM: Loaded 16133 existing records. [2025-10-09T17:47:22.401913] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-09T17:47:22.477380] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:47:22.477735] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-09T17:47:22.477790] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-09T17:47:22.478002] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-09T17:47:22.478059] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-09T17:47:22.832775] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:22.897404] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T17:47:23.196723] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-09T17:47:23.996773] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-09T17:47:24.190275] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T17:47:24.441818] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T17:47:24.796687] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-09T17:47:24.895837] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T17:47:25.545520] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T17:47:25.546556] [INFO ] [REMOTE ] BTA: Full fetch complete (9513 records). [2025-10-09T17:47:25.546624] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-09T17:47:25.607033] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-09T17:47:25.904357] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-09T17:47:25.904435] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-09T17:47:25.904677] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-09T17:47:25.904738] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-09T17:47:25.905138] [DEBUG] [LOCAL ] BTA: Trimmed 9513 records to 5536 (keeping 200 days of data) [2025-10-09T17:47:25.937842] [DEBUG] [LOCAL ] BTA: Primary data saved (5536 records). [2025-10-09T17:47:25.937959] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-09T17:47:25.938051] [INFO ] [MAIN ] Update Progress: 346/2373 symbols completed. BTA took 22.9s. Estimated remaining: 4h 37m 32s. Rate: 7.3 symbols/min [2025-10-09T17:47:26.104148] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:26.157727] [DEBUG] [LOCAL ] BTE: Loaded 52713 existing records from primary storage. [2025-10-09T17:47:26.158061] [INFO ] [MAIN ] BTE: Loaded 52713 existing records. [2025-10-09T17:47:26.357792] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:47:26.358789] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T17:47:26.358900] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-09T17:47:26.361668] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-09T17:47:26.361900] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-09T17:47:26.361956] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-09T17:47:26.401955] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-09T17:47:26.722665] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:27.196723] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-09T17:47:27.655481] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T17:47:27.657975] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36637 records). [2025-10-09T17:47:27.658055] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-09T17:47:27.658621] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:47:27.658735] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:47:27.658804] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:47:27.658901] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-09T17:47:27.658972] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-09T17:47:27.659009] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-10-09T17:47:27.659200] [DEBUG] [LOCAL ] BSTZ: Deleted derivative data file. [2025-10-09T17:47:27.659335] [INFO ] [MAIN ] Update Progress: 347/2373 symbols completed. BSTZ took 32.7s. Estimated remaining: 4h 36m 46s. Rate: 7.3 symbols/min [2025-10-09T17:47:27.832106] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:27.887339] [DEBUG] [LOCAL ] BTI: Loaded 53576 existing records from primary storage. [2025-10-09T17:47:27.887680] [INFO ] [MAIN ] BTI: Loaded 53576 existing records. [2025-10-09T17:47:28.001870] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-09T17:47:28.067312] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:47:28.067599] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-09T17:47:28.067710] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-09T17:47:28.067986] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-09T17:47:28.068043] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-09T17:47:28.419517] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:28.796704] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-09T17:47:29.130443] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T17:47:29.596709] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-09T17:47:30.075552] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-09T17:47:30.325741] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T17:47:30.396690] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-09T17:47:30.674563] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-09T17:47:31.196733] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-09T17:47:31.996711] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-09T17:47:32.144424] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T17:47:32.328789] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T17:47:32.608806] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T17:47:32.796781] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-09T17:47:33.490178] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T17:47:33.596697] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-09T17:47:34.396714] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-09T17:47:35.196699] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-09T17:47:35.467191] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T17:47:35.506014] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T17:47:35.912559] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T17:47:35.996687] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-09T17:47:36.683136] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-09T17:47:36.796723] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-09T17:47:37.596720] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-09T17:47:38.396687] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-09T17:47:38.613212] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T17:47:39.196713] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-09T17:47:39.492907] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T17:47:39.862517] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T17:47:39.996728] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-09T17:47:40.796721] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-09T17:47:41.102281] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-09T17:47:41.596707] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-09T17:47:41.840734] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T17:47:42.362528] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T17:47:42.396677] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-09T17:47:42.829242] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:47:43.196755] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-09T17:47:43.735744] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T17:47:43.996717] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-09T17:47:44.518401] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:47:44.796736] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-09T17:47:45.596736] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-09T17:47:45.712980] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T17:47:45.926798] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T17:47:45.929087] [INFO ] [REMOTE ] BTCM: Full fetch complete (19641 records). [2025-10-09T17:47:45.929166] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-09T17:47:46.315694] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-09T17:47:46.315792] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-09T17:47:46.316160] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-09T17:47:46.316202] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-09T17:47:46.316826] [DEBUG] [LOCAL ] BTCM: Trimmed 19641 records to 16265 (keeping 200 days of data) [2025-10-09T17:47:46.397217] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-09T17:47:46.408706] [DEBUG] [LOCAL ] BTCM: Primary data saved (16265 records). [2025-10-09T17:47:46.408807] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-09T17:47:46.408887] [INFO ] [MAIN ] Update Progress: 348/2373 symbols completed. BTCM took 24.3s. Estimated remaining: 4h 37m 39s. Rate: 7.3 symbols/min [2025-10-09T17:47:46.574081] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:46.584521] [DEBUG] [LOCAL ] BTO: Loaded 8691 existing records from primary storage. [2025-10-09T17:47:46.584920] [INFO ] [MAIN ] BTO: Loaded 8691 existing records. [2025-10-09T17:47:46.757058] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:47:46.757271] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-09T17:47:46.757318] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-09T17:47:46.757524] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-09T17:47:46.757581] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-09T17:47:47.168081] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:47.198366] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-09T17:47:47.201527] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T17:47:47.876287] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T17:47:47.903367] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T17:47:47.996720] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-09T17:47:48.794608] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T17:47:48.797092] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-09T17:47:49.596696] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-09T17:47:50.396700] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-09T17:47:50.554886] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T17:47:51.166585] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T17:47:51.196812] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-09T17:47:51.450414] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T17:47:51.996737] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-09T17:47:52.796686] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-09T17:47:52.810097] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T17:47:53.573513] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T17:47:53.596670] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-09T17:47:54.127218] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-09T17:47:54.380437] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T17:47:54.396679] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-09T17:47:55.147764] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T17:47:55.196761] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-09T17:47:55.996747] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-09T17:47:56.715071] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:47:56.719764] [INFO ] [REMOTE ] BSX: Full fetch complete (77699 records). [2025-10-09T17:47:56.719911] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-09T17:47:56.800801] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-09T17:47:57.149598] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-09T17:47:57.149888] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-09T17:47:57.150884] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-09T17:47:57.150969] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-09T17:47:57.181864] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-09T17:47:57.182024] [DEBUG] [LOCAL ] BSX: Trimmed 77699 records to 54078 (keeping 200 days of data) [2025-10-09T17:47:57.540150] [DEBUG] [LOCAL ] BSX: Primary data saved (54078 records). [2025-10-09T17:47:57.540305] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-09T17:47:57.540382] [INFO ] [MAIN ] Update Progress: 349/2373 symbols completed. BSX took 55.6s. Estimated remaining: 4h 37m 47s. Rate: 7.3 symbols/min [2025-10-09T17:47:57.601852] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-09T17:47:57.714596] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T17:47:57.737950] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:47:57.738468] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-10-09T17:47:57.738526] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-10-09T17:47:57.738677] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-09T17:47:57.738733] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-09T17:47:57.738779] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-09T17:47:57.738813] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-09T17:47:58.121698] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:47:58.396770] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-09T17:47:58.896897] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T17:47:58.914393] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-09T17:47:59.196750] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-09T17:47:59.996722] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-09T17:48:00.796737] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-09T17:48:01.100708] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T17:48:01.493930] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T17:48:01.596718] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-09T17:48:01.670832] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T17:48:02.396723] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-09T17:48:03.208940] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-09T17:48:03.214637] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T17:48:03.772061] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T17:48:03.996730] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-09T17:48:04.796787] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-09T17:48:04.838685] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T17:48:04.842675] [INFO ] [REMOTE ] BTE: Full fetch complete (75746 records). [2025-10-09T17:48:04.842782] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-09T17:48:04.843539] [FATAL] [VALIDATOR ] BTE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:48:04.843628] [FATAL] [MAIN ] BTE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:48:04.843716] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:48:04.843790] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-09T17:48:04.843853] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-09T17:48:04.843890] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-10-09T17:48:04.844073] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-10-09T17:48:04.844430] [INFO ] [MAIN ] Update Progress: 350/2373 symbols completed. BTE took 38.9s. Estimated remaining: 4h 37m 34s. Rate: 7.3 symbols/min [2025-10-09T17:48:04.958065] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T17:48:05.028058] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:05.028276] [DEBUG] [LOCAL ] BTU: No existing data file found in primary storage. [2025-10-09T17:48:05.028331] [WARN ] [MAIN ] BTU: No existing data found, performing full refresh instead. [2025-10-09T17:48:05.028452] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-09T17:48:05.028496] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-09T17:48:05.028538] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-09T17:48:05.028572] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-09T17:48:05.385108] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:05.596733] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-09T17:48:06.338285] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T17:48:06.339513] [INFO ] [REMOTE ] BTO: Full fetch complete (13121 records). [2025-10-09T17:48:06.339581] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-09T17:48:06.403429] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-09T17:48:06.718661] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-09T17:48:06.718844] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-09T17:48:06.719338] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-09T17:48:06.719449] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-09T17:48:06.732142] [DEBUG] [LOCAL ] BTO: Trimmed 13121 records to 8777 (keeping 200 days of data) [2025-10-09T17:48:06.778414] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-09T17:48:06.815488] [DEBUG] [LOCAL ] BTO: Primary data saved (8777 records). [2025-10-09T17:48:06.815603] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-09T17:48:06.815747] [INFO ] [MAIN ] Update Progress: 351/2373 symbols completed. BTO took 20.4s. Estimated remaining: 4h 36m 50s. Rate: 7.3 symbols/min [2025-10-09T17:48:06.987777] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:06.987976] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-09T17:48:06.988026] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-09T17:48:06.988161] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-09T17:48:06.988213] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-09T17:48:06.988286] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-09T17:48:06.988333] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-09T17:48:07.205181] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-09T17:48:07.362513] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:07.996684] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-09T17:48:08.200921] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:48:08.202791] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T17:48:08.214782] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-09T17:48:08.214973] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:48:08.215132] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-09T17:48:08.215200] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:48:08.215271] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-09T17:48:08.215349] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-09T17:48:08.215406] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-09T17:48:08.215451] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-09T17:48:08.215495] [INFO ] [MAIN ] Update Progress: 352/2373 symbols completed. BTX took 1.4s. Estimated remaining: 4h 36m 2s. Rate: 7.3 symbols/min [2025-10-09T17:48:08.378443] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:08.400447] [DEBUG] [LOCAL ] BTZ: Loaded 22689 existing records from primary storage. [2025-10-09T17:48:08.400717] [INFO ] [MAIN ] BTZ: Loaded 22689 existing records. [2025-10-09T17:48:08.572230] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:48:08.572461] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-09T17:48:08.572509] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-09T17:48:08.572743] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-09T17:48:08.572800] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-09T17:48:08.806449] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-09T17:48:08.943518] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:09.161372] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-09T17:48:09.596709] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-09T17:48:10.386862] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T17:48:10.397892] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-09T17:48:11.196694] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-09T17:48:11.403553] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T17:48:11.460882] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-09T17:48:11.465461] [INFO ] [REMOTE ] BTI: Full fetch complete (77467 records). [2025-10-09T17:48:11.465621] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-09T17:48:11.901415] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-09T17:48:11.901508] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-09T17:48:11.902321] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-09T17:48:11.902386] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-09T17:48:11.903974] [DEBUG] [LOCAL ] BTI: Trimmed 77467 records to 53966 (keeping 200 days of data) [2025-10-09T17:48:11.998202] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-09T17:48:12.245430] [DEBUG] [LOCAL ] BTI: Primary data saved (53966 records). [2025-10-09T17:48:12.245576] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-09T17:48:12.245713] [INFO ] [MAIN ] Update Progress: 353/2373 symbols completed. BTI took 44.6s. Estimated remaining: 4h 35m 30s. Rate: 7.3 symbols/min [2025-10-09T17:48:12.418008] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:12.466550] [DEBUG] [LOCAL ] BUD: Loaded 52698 existing records from primary storage. [2025-10-09T17:48:12.466919] [INFO ] [MAIN ] BUD: Loaded 52698 existing records. [2025-10-09T17:48:12.642158] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:48:12.642573] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-09T17:48:12.642665] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-09T17:48:12.643005] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-09T17:48:12.643062] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-09T17:48:12.813560] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-09T17:48:13.021264] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:13.052473] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T17:48:13.073016] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:48:13.596690] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-09T17:48:13.913537] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T17:48:14.396727] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-09T17:48:15.196759] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-09T17:48:15.344812] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T17:48:15.985602] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-09T17:48:15.998048] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-09T17:48:16.391864] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T17:48:16.796750] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-09T17:48:17.596805] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-09T17:48:17.632388] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T17:48:17.933811] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T17:48:18.396735] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-09T17:48:19.196743] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-09T17:48:19.550480] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-09T17:48:19.590050] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T17:48:19.996692] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-09T17:48:20.155968] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:48:20.796748] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-09T17:48:21.068379] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T17:48:21.596691] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-09T17:48:21.894933] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T17:48:22.396731] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-09T17:48:23.196758] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-09T17:48:23.521075] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T17:48:23.651814] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-09T17:48:23.996737] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-09T17:48:24.753083] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T17:48:24.796680] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-09T17:48:25.022679] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T17:48:25.596694] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-09T17:48:25.663956] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:48:26.396730] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-09T17:48:27.184777] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T17:48:27.196673] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-09T17:48:27.583428] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-09T17:48:27.996682] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-09T17:48:28.157181] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T17:48:28.796705] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-09T17:48:29.596744] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-09T17:48:29.799941] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T17:48:30.396691] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-09T17:48:30.644204] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T17:48:30.680287] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T17:48:31.196766] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-09T17:48:31.996682] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-09T17:48:32.238022] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T17:48:32.257105] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T17:48:32.796778] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-09T17:48:33.505128] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T17:48:33.596680] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-09T17:48:33.791970] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T17:48:33.794606] [INFO ] [REMOTE ] BTZ: Full fetch complete (33584 records). [2025-10-09T17:48:33.794713] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-09T17:48:34.166170] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-09T17:48:34.166261] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-09T17:48:34.166736] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-09T17:48:34.166799] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-09T17:48:34.167509] [DEBUG] [LOCAL ] BTZ: Trimmed 33584 records to 22883 (keeping 200 days of data) [2025-10-09T17:48:34.303725] [DEBUG] [LOCAL ] BTZ: Primary data saved (22883 records). [2025-10-09T17:48:34.303856] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-09T17:48:34.303947] [INFO ] [MAIN ] Update Progress: 354/2373 symbols completed. BTZ took 26.1s. Estimated remaining: 4h 36m 41s. Rate: 7.3 symbols/min [2025-10-09T17:48:34.402717] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-09T17:48:34.471811] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:34.485084] [DEBUG] [LOCAL ] BUI: Loaded 11839 existing records from primary storage. [2025-10-09T17:48:34.485284] [INFO ] [MAIN ] BUI: Loaded 11839 existing records. [2025-10-09T17:48:34.665378] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:48:34.665602] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-09T17:48:34.665678] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-09T17:48:34.665915] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-09T17:48:34.665976] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-09T17:48:35.015168] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:35.196696] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-09T17:48:35.496201] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T17:48:35.996688] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-09T17:48:36.133870] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T17:48:36.155378] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T17:48:36.796727] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-09T17:48:37.596748] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-09T17:48:37.967187] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T17:48:38.402831] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-09T17:48:38.406418] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T17:48:38.764297] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T17:48:39.042844] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T17:48:39.196714] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-09T17:48:39.996753] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-09T17:48:40.060150] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T17:48:40.796715] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-09T17:48:41.596722] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-09T17:48:41.653382] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T17:48:41.655183] [INFO ] [REMOTE ] BTT: Full fetch complete (23482 records). [2025-10-09T17:48:41.655338] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-09T17:48:42.059926] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-09T17:48:42.060226] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-09T17:48:42.060718] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-09T17:48:42.060829] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-09T17:48:42.071982] [DEBUG] [LOCAL ] BTT: Trimmed 23482 records to 15974 (keeping 200 days of data) [2025-10-09T17:48:42.093157] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T17:48:42.202411] [DEBUG] [LOCAL ] BTT: Primary data saved (15974 records). [2025-10-09T17:48:42.202589] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-09T17:48:42.202706] [INFO ] [MAIN ] Update Progress: 355/2373 symbols completed. BTT took 44.7s. Estimated remaining: 4h 36m 31s. Rate: 7.3 symbols/min [2025-10-09T17:48:42.380488] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:42.381209] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T17:48:42.404750] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-09T17:48:42.425468] [DEBUG] [LOCAL ] BUR: Loaded 45195 existing records from primary storage. [2025-10-09T17:48:42.425799] [INFO ] [MAIN ] BUR: Loaded 45195 existing records. [2025-10-09T17:48:42.611554] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:48:42.611814] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-09T17:48:42.611866] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-09T17:48:42.612111] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-09T17:48:42.612173] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-09T17:48:42.991728] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:43.196805] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-09T17:48:43.980094] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T17:48:43.996691] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-09T17:48:44.710112] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:48:44.796716] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-09T17:48:45.596700] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-09T17:48:45.877136] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T17:48:46.262888] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T17:48:46.298573] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-09T17:48:46.396711] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-09T17:48:47.196712] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-09T17:48:47.996685] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-09T17:48:48.068008] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T17:48:48.156893] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T17:48:48.160962] [INFO ] [REMOTE ] BTU: Full fetch complete (76652 records). [2025-10-09T17:48:48.161069] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-09T17:48:48.162079] [FATAL] [VALIDATOR ] BTU: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:48:48.162172] [FATAL] [MAIN ] BTU: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:48:48.162216] [WARN ] [MAIN ] BTU: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:48:48.162282] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-09T17:48:48.162347] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-09T17:48:48.162382] [INFO ] [LOCAL ] BTU: Starting deletion of derivative data. [2025-10-09T17:48:48.162421] [DEBUG] [LOCAL ] BTU: No derivative data file found to delete. [2025-10-09T17:48:48.162479] [INFO ] [MAIN ] Update Progress: 356/2373 symbols completed. BTU took 43.3s. Estimated remaining: 4h 36m 10s. Rate: 7.3 symbols/min [2025-10-09T17:48:48.330318] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:48:48.371457] [DEBUG] [LOCAL ] BURL: Loaded 45738 existing records from primary storage. [2025-10-09T17:48:48.371780] [INFO ] [MAIN ] BURL: Loaded 45738 existing records. [2025-10-09T17:48:48.573117] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:48:48.573323] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-09T17:48:48.573370] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-09T17:48:48.573608] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-09T17:48:48.573700] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-09T17:48:48.801931] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-09T17:48:48.950213] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:48:49.596738] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-09T17:48:49.797043] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T17:48:49.801578] [INFO ] [REMOTE ] BUD: Full fetch complete (76456 records). [2025-10-09T17:48:49.801712] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-09T17:48:50.195855] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-09T17:48:50.196108] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-09T17:48:50.197051] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-09T17:48:50.197164] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-09T17:48:50.198694] [DEBUG] [LOCAL ] BUD: Trimmed 76456 records to 53080 (keeping 200 days of data) [2025-10-09T17:48:50.312605] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T17:48:50.399452] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-09T17:48:50.550622] [DEBUG] [LOCAL ] BUD: Primary data saved (53080 records). [2025-10-09T17:48:50.550788] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-09T17:48:50.550893] [INFO ] [MAIN ] Update Progress: 357/2373 symbols completed. BUD took 38.3s. Estimated remaining: 4h 35m 29s. Rate: 7.3 symbols/min [2025-10-09T17:48:51.145990] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T17:48:51.196686] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-09T17:48:51.853022] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T17:48:51.996771] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-09T17:48:52.414003] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T17:48:52.802619] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-09T17:48:52.806546] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T17:48:53.596776] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-09T17:48:54.406424] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-09T17:48:54.409564] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T17:48:55.079859] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T17:48:55.196725] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-09T17:48:55.279725] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T17:48:55.996736] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-09T17:48:56.158814] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T17:48:56.796763] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-09T17:48:57.547894] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T17:48:57.596678] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-09T17:48:58.396836] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-09T17:48:58.487978] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T17:48:58.770625] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:48:59.048518] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T17:48:59.196762] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-09T17:48:59.996748] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-09T17:49:00.722213] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T17:49:00.796684] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-09T17:49:00.902341] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:49:01.596778] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-09T17:49:01.741782] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T17:49:01.744120] [INFO ] [REMOTE ] BUI: Full fetch complete (16484 records). [2025-10-09T17:49:01.744212] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-09T17:49:02.129234] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-09T17:49:02.129342] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-09T17:49:02.129689] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-09T17:49:02.129751] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-09T17:49:02.130271] [DEBUG] [LOCAL ] BUI: Trimmed 16484 records to 11912 (keeping 200 days of data) [2025-10-09T17:49:02.200424] [DEBUG] [LOCAL ] BUI: Primary data saved (11912 records). [2025-10-09T17:49:02.200556] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-09T17:49:02.200635] [INFO ] [MAIN ] Update Progress: 358/2373 symbols completed. BUI took 27.9s. Estimated remaining: 4h 35m 40s. Rate: 7.3 symbols/min [2025-10-09T17:49:02.396745] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-09T17:49:03.205415] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T17:49:03.215639] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-09T17:49:04.341344] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T17:49:04.351988] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-09T17:49:04.805924] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T17:49:04.815812] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-09T17:49:05.865952] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:49:05.875986] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-09T17:49:06.384956] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T17:49:06.388839] [INFO ] [REMOTE ] BUR: Full fetch complete (63655 records). [2025-10-09T17:49:06.388980] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-09T17:49:06.774853] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-09T17:49:06.774948] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-09T17:49:06.775750] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-09T17:49:06.775822] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-09T17:49:06.777244] [DEBUG] [LOCAL ] BUR: Trimmed 63655 records to 45527 (keeping 200 days of data) [2025-10-09T17:49:07.059765] [DEBUG] [LOCAL ] BUR: Primary data saved (45527 records). [2025-10-09T17:49:07.059903] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-09T17:49:07.060882] [INFO ] [MAIN ] Update Progress: 359/2373 symbols completed. BUR took 24.9s. Estimated remaining: 4h 35m 13s. Rate: 7.3 symbols/min [2025-10-09T17:49:07.449278] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:49:07.458862] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-09T17:49:09.067796] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T17:49:09.077867] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-09T17:49:10.673887] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:49:10.683506] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-09T17:49:12.259452] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T17:49:12.269275] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-09T17:49:13.959382] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T17:49:13.963176] [INFO ] [REMOTE ] BURL: Full fetch complete (65644 records). [2025-10-09T17:49:13.963311] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-09T17:49:14.353591] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-09T17:49:14.353766] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-09T17:49:14.354480] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-09T17:49:14.354525] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-09T17:49:14.355873] [DEBUG] [LOCAL ] BURL: Trimmed 65644 records to 46039 (keeping 200 days of data) [2025-10-09T17:49:14.634881] [DEBUG] [LOCAL ] BURL: Primary data saved (46039 records). [2025-10-09T17:49:14.635025] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-09T17:49:14.635545] [INFO ] [MAIN ] Update Progress: 360/2373 symbols completed. BURL took 26.5s. Estimated remaining: 4h 35m 1s. Rate: 7.3 symbols/min [2025-10-09T17:49:15.194132] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:15.337413] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:15.302590] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:15.340225] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:15.356105] [DEBUG] [LOCAL ] BUXX: Loaded 15250 existing records from primary storage. [2025-10-09T17:49:15.356678] [INFO ] [MAIN ] BUXX: Loaded 15250 existing records. [2025-10-09T17:49:15.591011] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:15.603155] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-09T17:49:15.603809] [DEBUG] [LOCAL ] BVN: Loaded 44059 existing records from primary storage. [2025-10-09T17:49:15.613909] [INFO ] [MAIN ] BVN: Loaded 44059 existing records. [2025-10-09T17:49:15.614051] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-09T17:49:15.621561] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-09T17:49:15.621514] [DEBUG] [LOCAL ] BV: Loaded 38524 existing records from primary storage. [2025-10-09T17:49:15.645230] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-09T17:49:15.666095] [INFO ] [MAIN ] BV: Loaded 38524 existing records. [2025-10-09T17:49:15.694875] [DEBUG] [LOCAL ] BW: Loaded 40183 existing records from primary storage. [2025-10-09T17:49:15.853322] [INFO ] [MAIN ] BW: Loaded 40183 existing records. [2025-10-09T17:49:16.205880] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:16.267249] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-09T17:49:16.328060] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-09T17:49:16.399676] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:16.430515] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-09T17:49:16.452883] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-09T17:49:16.463330] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-09T17:49:16.474316] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:16.552905] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-09T17:49:16.514557] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-09T17:49:16.577295] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-09T17:49:16.604260] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-09T17:49:16.634292] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:16.640078] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-09T17:49:16.640360] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-09T17:49:16.644092] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-09T17:49:16.672230] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-09T17:49:17.550199] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:17.577560] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-09T17:49:17.621821] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:17.694232] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T17:49:17.668164] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-09T17:49:17.699773] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:17.703332] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-09T17:49:17.703817] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-09T17:49:18.490873] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T17:49:18.493809] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-09T17:49:18.776264] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T17:49:18.783601] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-09T17:49:18.914244] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:49:18.923785] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-09T17:49:19.052489] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T17:49:19.055336] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-09T17:49:19.352832] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T17:49:19.362106] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-09T17:49:19.901255] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T17:49:19.904607] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-09T17:49:19.935353] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T17:49:19.941936] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-09T17:49:20.125269] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T17:49:20.133945] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-09T17:49:20.548831] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T17:49:20.557115] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-09T17:49:20.959063] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T17:49:20.963994] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-09T17:49:21.132413] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:49:21.406587] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T17:49:21.596776] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-09T17:49:21.978801] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T17:49:22.005288] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T17:49:22.396821] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-09T17:49:23.105607] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T17:49:23.196732] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-09T17:49:24.000524] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-09T17:49:24.005412] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T17:49:24.626005] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:49:24.708796] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T17:49:24.796689] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-09T17:49:25.596744] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-09T17:49:25.695534] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T17:49:26.396736] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-09T17:49:26.952705] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T17:49:27.196733] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-09T17:49:27.904260] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T17:49:27.996686] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-09T17:49:28.045086] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T17:49:28.796694] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-09T17:49:28.835374] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T17:49:29.596734] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-09T17:49:30.260339] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T17:49:30.396717] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-09T17:49:30.789521] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T17:49:31.196736] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-09T17:49:31.212824] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T17:49:31.214445] [INFO ] [REMOTE ] BUXX: Full fetch complete (20430 records). [2025-10-09T17:49:31.214521] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-09T17:49:31.573977] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-09T17:49:31.574058] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-09T17:49:31.574408] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-09T17:49:31.574447] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-09T17:49:31.575021] [DEBUG] [LOCAL ] BUXX: Trimmed 20430 records to 15346 (keeping 200 days of data) [2025-10-09T17:49:31.674039] [DEBUG] [LOCAL ] BUXX: Primary data saved (15346 records). [2025-10-09T17:49:31.674185] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-09T17:49:31.674294] [INFO ] [MAIN ] Update Progress: 361/2373 symbols completed. BUXX took 17.0s. Estimated remaining: 4h 35m 43s. Rate: 7.3 symbols/min [2025-10-09T17:49:31.845283] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:31.894667] [DEBUG] [LOCAL ] BWA: Loaded 52154 existing records from primary storage. [2025-10-09T17:49:31.894998] [INFO ] [MAIN ] BWA: Loaded 52154 existing records. [2025-10-09T17:49:32.001804] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-09T17:49:32.082131] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:32.082336] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-09T17:49:32.082409] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-09T17:49:32.082766] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-09T17:49:32.082827] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-09T17:49:32.448505] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:32.471590] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T17:49:32.796768] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-09T17:49:33.562756] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T17:49:33.596673] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-09T17:49:34.247891] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T17:49:34.396766] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-09T17:49:34.749893] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T17:49:35.196705] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-09T17:49:35.859845] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:49:35.996720] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-09T17:49:36.414197] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T17:49:36.796752] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-09T17:49:37.476486] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T17:49:37.596679] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-09T17:49:38.396687] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-09T17:49:38.538174] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T17:49:38.606674] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-09T17:49:39.196716] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-09T17:49:40.006995] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-09T17:49:40.012256] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T17:49:40.329892] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T17:49:40.333366] [INFO ] [REMOTE ] BV: Full fetch complete (54458 records). [2025-10-09T17:49:40.333471] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-09T17:49:40.704314] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-09T17:49:40.704396] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-09T17:49:40.705032] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-09T17:49:40.705096] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-09T17:49:40.706221] [DEBUG] [LOCAL ] BV: Trimmed 54458 records to 38789 (keeping 200 days of data) [2025-10-09T17:49:40.800300] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-09T17:49:40.939007] [DEBUG] [LOCAL ] BV: Primary data saved (38789 records). [2025-10-09T17:49:40.939164] [INFO ] [MAIN ] BV: Full history saved. [2025-10-09T17:49:40.940017] [INFO ] [MAIN ] Update Progress: 362/2373 symbols completed. BV took 26.3s. Estimated remaining: 4h 35m 40s. Rate: 7.3 symbols/min [2025-10-09T17:49:41.106414] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:41.122421] [DEBUG] [LOCAL ] BWG: Loaded 12634 existing records from primary storage. [2025-10-09T17:49:41.122677] [INFO ] [MAIN ] BWG: Loaded 12634 existing records. [2025-10-09T17:49:41.299944] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:41.300149] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-09T17:49:41.300198] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-09T17:49:41.300442] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-09T17:49:41.300503] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-09T17:49:41.598735] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-09T17:49:41.684095] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:41.714321] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T17:49:42.396676] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-09T17:49:42.783132] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-09T17:49:42.787282] [INFO ] [REMOTE ] BVN: Full fetch complete (62866 records). [2025-10-09T17:49:42.787411] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-09T17:49:43.179345] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-09T17:49:43.179582] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-09T17:49:43.180405] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-09T17:49:43.180481] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-09T17:49:43.181867] [DEBUG] [LOCAL ] BVN: Trimmed 62866 records to 44431 (keeping 200 days of data) [2025-10-09T17:49:43.234720] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-09T17:49:43.278280] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:49:43.304697] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T17:49:43.483097] [DEBUG] [LOCAL ] BVN: Primary data saved (44431 records). [2025-10-09T17:49:43.483233] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-09T17:49:43.484148] [INFO ] [MAIN ] Update Progress: 363/2373 symbols completed. BVN took 28.8s. Estimated remaining: 4h 35m 0s. Rate: 7.3 symbols/min [2025-10-09T17:49:43.649225] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:43.683092] [DEBUG] [LOCAL ] BWLP: Loaded 32306 existing records from primary storage. [2025-10-09T17:49:43.683353] [INFO ] [MAIN ] BWLP: Loaded 32306 existing records. [2025-10-09T17:49:43.857055] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:43.857257] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-09T17:49:43.857304] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-09T17:49:43.857561] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-09T17:49:43.857619] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-09T17:49:44.001867] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-09T17:49:44.215812] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:44.796680] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-09T17:49:44.848284] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T17:49:45.263929] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T17:49:45.596737] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-09T17:49:46.389964] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T17:49:46.398521] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-09T17:49:47.196699] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-09T17:49:47.327816] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T17:49:47.874436] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T17:49:47.996744] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-09T17:49:48.041018] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T17:49:48.796731] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-09T17:49:49.068197] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:49:49.596736] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-09T17:49:50.217433] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T17:49:50.396712] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-09T17:49:50.932579] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T17:49:51.196719] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-09T17:49:51.996729] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-09T17:49:52.034359] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T17:49:52.477357] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T17:49:52.560884] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T17:49:52.796789] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-09T17:49:53.596808] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-09T17:49:54.272010] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:49:54.396736] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-09T17:49:55.196773] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-09T17:49:55.259301] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T17:49:55.760350] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T17:49:55.996714] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-09T17:49:56.120469] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T17:49:56.796726] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-09T17:49:57.596772] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-09T17:49:57.653948] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T17:49:58.396733] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-09T17:49:58.565700] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T17:49:58.569751] [INFO ] [REMOTE ] BW: Full fetch complete (58906 records). [2025-10-09T17:49:58.569843] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-09T17:49:58.961456] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-09T17:49:58.961550] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-09T17:49:58.962283] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-09T17:49:58.962346] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-09T17:49:58.963773] [DEBUG] [LOCAL ] BW: Trimmed 58906 records to 40536 (keeping 200 days of data) [2025-10-09T17:49:59.197790] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-09T17:49:59.196605] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T17:49:59.239498] [DEBUG] [LOCAL ] BW: Primary data saved (40536 records). [2025-10-09T17:49:59.239621] [INFO ] [MAIN ] BW: Full history saved. [2025-10-09T17:49:59.239746] [INFO ] [MAIN ] Update Progress: 364/2373 symbols completed. BW took 44.6s. Estimated remaining: 4h 35m 34s. Rate: 7.3 symbols/min [2025-10-09T17:49:59.406463] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:49:59.415558] [DEBUG] [LOCAL ] BWMX: Loaded 7690 existing records from primary storage. [2025-10-09T17:49:59.415750] [INFO ] [MAIN ] BWMX: Loaded 7690 existing records. [2025-10-09T17:49:59.599007] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:49:59.599203] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-09T17:49:59.599249] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-09T17:49:59.599425] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-09T17:49:59.599482] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-09T17:49:59.972480] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:49:59.999875] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-09T17:50:00.005020] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T17:50:00.024298] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T17:50:00.796716] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-09T17:50:00.833268] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T17:50:01.596725] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-09T17:50:01.991294] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T17:50:02.396690] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-09T17:50:03.074406] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T17:50:03.196783] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-09T17:50:03.208086] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T17:50:03.996732] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-09T17:50:04.796713] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-09T17:50:04.943796] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T17:50:05.062327] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T17:50:05.423729] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T17:50:05.596702] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-09T17:50:06.396732] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-09T17:50:07.188900] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T17:50:07.199464] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-09T17:50:07.860672] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T17:50:07.996742] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-09T17:50:08.206473] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T17:50:08.796726] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-09T17:50:09.456974] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T17:50:09.461463] [INFO ] [REMOTE ] BWA: Full fetch complete (75698 records). [2025-10-09T17:50:09.461571] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-09T17:50:09.590537] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T17:50:09.600975] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-09T17:50:09.870008] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-09T17:50:09.870092] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-09T17:50:09.870895] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-09T17:50:09.870960] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-09T17:50:09.872357] [DEBUG] [LOCAL ] BWA: Trimmed 75698 records to 52541 (keeping 200 days of data) [2025-10-09T17:50:10.200050] [DEBUG] [LOCAL ] BWA: Primary data saved (52541 records). [2025-10-09T17:50:10.200223] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-09T17:50:10.200336] [INFO ] [MAIN ] Update Progress: 365/2373 symbols completed. BWA took 38.5s. Estimated remaining: 4h 35m 41s. Rate: 7.3 symbols/min [2025-10-09T17:50:10.309030] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T17:50:10.379828] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:10.386512] [DEBUG] [LOCAL ] BWNB: Loaded 4255 existing records from primary storage. [2025-10-09T17:50:10.386748] [INFO ] [MAIN ] BWNB: Loaded 4255 existing records. [2025-10-09T17:50:10.406481] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-09T17:50:10.563847] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:10.564031] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-09T17:50:10.564083] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-09T17:50:10.564258] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-09T17:50:10.564315] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-09T17:50:10.913394] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:11.196726] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-09T17:50:11.860350] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T17:50:11.998912] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-09T17:50:12.002934] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T17:50:12.664086] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T17:50:12.796734] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-09T17:50:13.253063] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T17:50:13.596713] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-09T17:50:14.366352] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T17:50:14.396760] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-09T17:50:15.196687] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-09T17:50:15.664539] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T17:50:15.692342] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T17:50:15.996758] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-09T17:50:16.796723] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-09T17:50:16.802497] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T17:50:16.803959] [INFO ] [REMOTE ] BWG: Full fetch complete (17767 records). [2025-10-09T17:50:16.804030] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-09T17:50:16.804498] [FATAL] [VALIDATOR ] BWG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:50:16.804580] [FATAL] [MAIN ] BWG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:50:16.804673] [WARN ] [MAIN ] BWG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:50:16.804748] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-09T17:50:16.804811] [DEBUG] [LOCAL ] BWG: No primary data file found to delete. [2025-10-09T17:50:16.804858] [INFO ] [LOCAL ] BWG: Starting deletion of derivative data. [2025-10-09T17:50:16.805116] [DEBUG] [LOCAL ] BWG: Deleted derivative data file. [2025-10-09T17:50:16.805221] [INFO ] [MAIN ] Update Progress: 366/2373 symbols completed. BWG took 35.9s. Estimated remaining: 4h 35m 23s. Rate: 7.3 symbols/min [2025-10-09T17:50:16.983778] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:16.991588] [DEBUG] [LOCAL ] BWSN: Loaded 5147 existing records from primary storage. [2025-10-09T17:50:16.991818] [INFO ] [MAIN ] BWSN: Loaded 5147 existing records. [2025-10-09T17:50:17.168718] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:17.168934] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-09T17:50:17.168990] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-09T17:50:17.169160] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-09T17:50:17.169216] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-09T17:50:17.563501] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:17.570726] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T17:50:17.596712] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-09T17:50:18.103808] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-09T17:50:18.396735] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-09T17:50:18.967681] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T17:50:19.196733] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-09T17:50:19.996684] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-09T17:50:20.219731] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T17:50:20.796779] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-09T17:50:21.319739] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-09T17:50:21.333141] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T17:50:21.336377] [INFO ] [REMOTE ] BWLP: Full fetch complete (48058 records). [2025-10-09T17:50:21.336461] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-09T17:50:21.601924] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-09T17:50:21.734543] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-09T17:50:21.734626] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-09T17:50:21.735399] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-09T17:50:21.735466] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-09T17:50:21.736488] [DEBUG] [LOCAL ] BWLP: Trimmed 48058 records to 32641 (keeping 200 days of data) [2025-10-09T17:50:21.935509] [DEBUG] [LOCAL ] BWLP: Primary data saved (32641 records). [2025-10-09T17:50:21.935692] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-09T17:50:21.936733] [INFO ] [MAIN ] Update Progress: 367/2373 symbols completed. BWLP took 38.5s. Estimated remaining: 4h 34m 58s. Rate: 7.3 symbols/min [2025-10-09T17:50:22.109227] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:22.162488] [DEBUG] [LOCAL ] BWXT: Loaded 46822 existing records from primary storage. [2025-10-09T17:50:22.162806] [INFO ] [MAIN ] BWXT: Loaded 46822 existing records. [2025-10-09T17:50:22.343367] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:22.343595] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-09T17:50:22.343677] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-09T17:50:22.344930] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-09T17:50:22.344991] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-09T17:50:22.401852] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-09T17:50:22.512825] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T17:50:22.730090] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:23.196683] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-09T17:50:23.321042] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-09T17:50:23.996745] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-09T17:50:24.049502] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T17:50:24.796765] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-09T17:50:25.214076] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T17:50:25.596735] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-09T17:50:25.738980] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T17:50:25.991582] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-09T17:50:26.396716] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-09T17:50:27.196771] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-09T17:50:27.636760] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T17:50:27.996689] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-09T17:50:28.109176] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T17:50:28.393365] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T17:50:28.796719] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-09T17:50:29.412543] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T17:50:29.413839] [INFO ] [REMOTE ] BWMX: Full fetch complete (10099 records). [2025-10-09T17:50:29.413912] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-09T17:50:29.601923] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-09T17:50:29.777412] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-09T17:50:29.777491] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-09T17:50:29.777751] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-09T17:50:29.777812] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-09T17:50:29.778277] [DEBUG] [LOCAL ] BWMX: Trimmed 10099 records to 7763 (keeping 200 days of data) [2025-10-09T17:50:29.825381] [DEBUG] [LOCAL ] BWMX: Primary data saved (7763 records). [2025-10-09T17:50:29.825509] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-09T17:50:29.825591] [INFO ] [MAIN ] Update Progress: 368/2373 symbols completed. BWMX took 30.6s. Estimated remaining: 4h 34m 48s. Rate: 7.3 symbols/min [2025-10-09T17:50:29.990204] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:30.041878] [DEBUG] [LOCAL ] BX: Loaded 53479 existing records from primary storage. [2025-10-09T17:50:30.042217] [INFO ] [MAIN ] BX: Loaded 53479 existing records. [2025-10-09T17:50:30.212927] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:30.213155] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-09T17:50:30.213201] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-09T17:50:30.214022] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-09T17:50:30.214081] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-09T17:50:30.404534] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-09T17:50:30.567518] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:31.032040] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T17:50:31.093366] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T17:50:31.196706] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-09T17:50:31.650005] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T17:50:31.996732] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-09T17:50:32.400083] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-09T17:50:32.796745] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-09T17:50:33.529787] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T17:50:33.596712] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-09T17:50:34.268352] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T17:50:34.396725] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-09T17:50:35.175217] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T17:50:35.196672] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-09T17:50:35.840093] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T17:50:35.996753] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-09T17:50:36.796805] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-09T17:50:37.596700] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-09T17:50:37.950681] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T17:50:38.037771] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T17:50:38.396706] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-09T17:50:38.470795] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T17:50:39.196757] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-09T17:50:39.996679] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-09T17:50:40.091122] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T17:50:40.524491] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T17:50:40.525511] [INFO ] [REMOTE ] BWNB: Full fetch complete (5664 records). [2025-10-09T17:50:40.525704] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-09T17:50:40.798242] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-09T17:50:40.923344] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-09T17:50:40.917095] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T17:50:40.923497] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-09T17:50:40.932544] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-09T17:50:40.932727] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-09T17:50:40.933515] [DEBUG] [LOCAL ] BWNB: Trimmed 5664 records to 4267 (keeping 200 days of data) [2025-10-09T17:50:40.960309] [DEBUG] [LOCAL ] BWNB: Primary data saved (4267 records). [2025-10-09T17:50:40.960412] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-09T17:50:40.960494] [INFO ] [MAIN ] Update Progress: 369/2373 symbols completed. BWNB took 30.8s. Estimated remaining: 4h 34m 56s. Rate: 7.3 symbols/min [2025-10-09T17:50:41.125240] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:41.139479] [DEBUG] [LOCAL ] BXC: Loaded 13686 existing records from primary storage. [2025-10-09T17:50:41.139735] [INFO ] [MAIN ] BXC: Loaded 13686 existing records. [2025-10-09T17:50:41.295443] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T17:50:41.333958] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:41.334191] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-09T17:50:41.334262] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-09T17:50:41.334832] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-09T17:50:41.334892] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-09T17:50:41.603114] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-09T17:50:41.685624] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:42.396721] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-09T17:50:42.861589] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T17:50:43.196694] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-09T17:50:43.271557] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T17:50:43.775536] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T17:50:43.776532] [INFO ] [REMOTE ] BWSN: Full fetch complete (6242 records). [2025-10-09T17:50:43.776600] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-09T17:50:44.001855] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-09T17:50:44.138674] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-09T17:50:44.138764] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-09T17:50:44.138941] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-09T17:50:44.138979] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-09T17:50:44.139349] [DEBUG] [LOCAL ] BWSN: Trimmed 6242 records to 5154 (keeping 200 days of data) [2025-10-09T17:50:44.170854] [DEBUG] [LOCAL ] BWSN: Primary data saved (5154 records). [2025-10-09T17:50:44.170964] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-09T17:50:44.171081] [INFO ] [MAIN ] Update Progress: 370/2373 symbols completed. BWSN took 27.4s. Estimated remaining: 4h 34m 20s. Rate: 7.3 symbols/min [2025-10-09T17:50:44.337684] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:50:44.383427] [DEBUG] [LOCAL ] BXMT: Loaded 47172 existing records from primary storage. [2025-10-09T17:50:44.383767] [INFO ] [MAIN ] BXMT: Loaded 47172 existing records. [2025-10-09T17:50:44.582058] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:50:44.582343] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-09T17:50:44.582398] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-09T17:50:44.583793] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-09T17:50:44.583857] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-09T17:50:44.801838] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-09T17:50:44.946336] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:50:45.596797] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-09T17:50:45.817933] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T17:50:46.396759] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-09T17:50:46.427148] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T17:50:46.677748] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T17:50:47.196778] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-09T17:50:47.949683] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T17:50:47.996744] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-09T17:50:48.202578] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T17:50:48.450405] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-09T17:50:48.796716] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-09T17:50:49.596715] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-09T17:50:50.396774] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-09T17:50:50.509412] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T17:50:50.919630] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-09T17:50:51.196747] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-09T17:50:51.996741] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-09T17:50:52.144226] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T17:50:52.796698] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-09T17:50:52.978834] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T17:50:53.521603] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T17:50:53.596736] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-09T17:50:54.396727] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-09T17:50:54.773534] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-09T17:50:55.101202] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T17:50:55.196738] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-09T17:50:55.867663] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T17:50:55.996711] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-09T17:50:56.422495] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T17:50:56.796744] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-09T17:50:57.596730] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-09T17:50:57.992975] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T17:50:58.176400] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-09T17:50:58.396837] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-09T17:50:59.023418] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:50:59.196750] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-09T17:50:59.996692] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-09T17:51:00.112502] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-09T17:51:00.399857] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T17:51:00.796733] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-09T17:51:01.515389] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T17:51:01.596702] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-09T17:51:02.396719] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-09T17:51:02.796717] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-09T17:51:03.197695] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-09T17:51:03.210614] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T17:51:03.296397] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T17:51:03.996777] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-09T17:51:04.796741] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-09T17:51:05.233669] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-09T17:51:05.238151] [INFO ] [REMOTE ] BWXT: Full fetch complete (67605 records). [2025-10-09T17:51:05.238274] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-09T17:51:05.598825] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-09T17:51:05.705097] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-09T17:51:05.705188] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-09T17:51:05.706006] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-09T17:51:05.706071] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-09T17:51:05.707423] [DEBUG] [LOCAL ] BWXT: Trimmed 67605 records to 47178 (keeping 200 days of data) [2025-10-09T17:51:05.845892] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T17:51:05.852293] [INFO ] [REMOTE ] BX: Full fetch complete (77406 records). [2025-10-09T17:51:05.852987] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-09T17:51:06.381858] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-09T17:51:06.383777] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-09T17:51:06.385094] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-09T17:51:06.385467] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-09T17:51:06.390130] [DEBUG] [LOCAL ] BX: Trimmed 77406 records to 53869 (keeping 200 days of data) [2025-10-09T17:51:06.514156] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:51:06.528801] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-09T17:51:06.596787] [DEBUG] [LOCAL ] BWXT: Primary data saved (47178 records). [2025-10-09T17:51:06.597397] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-09T17:51:06.598790] [INFO ] [MAIN ] Update Progress: 371/2373 symbols completed. BWXT took 44.7s. Estimated remaining: 4h 35m 29s. Rate: 7.3 symbols/min [2025-10-09T17:51:06.760117] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T17:51:06.801918] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:06.931174] [DEBUG] [LOCAL ] BXMX: Loaded 19532 existing records from primary storage. [2025-10-09T17:51:06.933710] [INFO ] [MAIN ] BXMX: Loaded 19532 existing records. [2025-10-09T17:51:07.198262] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-09T17:51:07.198169] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:07.200826] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-09T17:51:07.201428] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-09T17:51:07.203266] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-09T17:51:07.204373] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-09T17:51:07.559260] [DEBUG] [LOCAL ] BX: Primary data saved (53869 records). [2025-10-09T17:51:07.567850] [INFO ] [MAIN ] BX: Full history saved. [2025-10-09T17:51:07.589554] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:07.585972] [INFO ] [MAIN ] Update Progress: 372/2373 symbols completed. BX took 37.8s. Estimated remaining: 4h 34m 42s. Rate: 7.3 symbols/min [2025-10-09T17:51:07.777838] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:07.830004] [DEBUG] [LOCAL ] BXP: Loaded 49803 existing records from primary storage. [2025-10-09T17:51:07.830375] [INFO ] [MAIN ] BXP: Loaded 49803 existing records. [2025-10-09T17:51:07.998559] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-09T17:51:08.022356] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:08.022960] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-09T17:51:08.023019] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-09T17:51:08.024515] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-09T17:51:08.024579] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-09T17:51:08.339921] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T17:51:08.468187] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T17:51:08.501913] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:08.796675] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-09T17:51:08.876082] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:51:09.596705] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-09T17:51:10.263819] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T17:51:10.396749] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-09T17:51:10.490932] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T17:51:11.196761] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-09T17:51:11.453769] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T17:51:11.996737] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-09T17:51:12.629683] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T17:51:12.796704] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-09T17:51:12.817024] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T17:51:12.819003] [INFO ] [REMOTE ] BXC: Full fetch complete (18132 records). [2025-10-09T17:51:12.819087] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-09T17:51:13.205619] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-09T17:51:13.205728] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-09T17:51:13.206105] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-09T17:51:13.206145] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-09T17:51:13.206722] [DEBUG] [LOCAL ] BXC: Trimmed 18132 records to 13770 (keeping 200 days of data) [2025-10-09T17:51:13.287381] [DEBUG] [LOCAL ] BXC: Primary data saved (13770 records). [2025-10-09T17:51:13.287524] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-09T17:51:13.287609] [INFO ] [MAIN ] Update Progress: 373/2373 symbols completed. BXC took 32.3s. Estimated remaining: 4h 34m 20s. Rate: 7.3 symbols/min [2025-10-09T17:51:13.456151] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:13.504160] [DEBUG] [LOCAL ] BXSL: Loaded 47831 existing records from primary storage. [2025-10-09T17:51:13.504535] [INFO ] [MAIN ] BXSL: Loaded 47831 existing records. [2025-10-09T17:51:13.604231] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-09T17:51:13.647565] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T17:51:13.710581] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:13.710799] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-09T17:51:13.710869] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-09T17:51:13.711637] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-09T17:51:13.711731] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-09T17:51:14.055261] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:14.396715] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-09T17:51:15.196703] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-09T17:51:15.272086] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:51:15.996724] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-09T17:51:16.324990] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T17:51:16.764392] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-09T17:51:16.796714] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-09T17:51:16.949824] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T17:51:17.561702] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T17:51:17.596678] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-09T17:51:18.396717] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-09T17:51:18.771745] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T17:51:19.196719] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-09T17:51:19.636536] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T17:51:19.996739] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-09T17:51:20.730983] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T17:51:20.796716] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-09T17:51:21.596685] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-09T17:51:21.664813] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T17:51:22.199264] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T17:51:22.396692] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-09T17:51:22.469870] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T17:51:23.196746] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-09T17:51:23.591161] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T17:51:23.996734] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-09T17:51:24.597425] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:51:24.796718] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-09T17:51:25.463348] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:51:25.467486] [INFO ] [REMOTE ] BXMT: Full fetch complete (69717 records). [2025-10-09T17:51:25.467576] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-09T17:51:25.605749] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-09T17:51:25.861419] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-09T17:51:25.861553] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-09T17:51:25.862384] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-09T17:51:25.862450] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-09T17:51:25.863916] [DEBUG] [LOCAL ] BXMT: Trimmed 69717 records to 47558 (keeping 200 days of data) [2025-10-09T17:51:26.170208] [DEBUG] [LOCAL ] BXMT: Primary data saved (47558 records). [2025-10-09T17:51:26.170474] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-09T17:51:26.171253] [INFO ] [MAIN ] Update Progress: 374/2373 symbols completed. BXMT took 42.0s. Estimated remaining: 4h 34m 36s. Rate: 7.3 symbols/min [2025-10-09T17:51:26.371412] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:26.374802] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T17:51:26.397961] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-09T17:51:26.400170] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T17:51:26.421130] [DEBUG] [LOCAL ] BY: Loaded 21660 existing records from primary storage. [2025-10-09T17:51:26.421382] [INFO ] [MAIN ] BY: Loaded 21660 existing records. [2025-10-09T17:51:26.593897] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:26.594154] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-09T17:51:26.594201] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-09T17:51:26.594451] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-09T17:51:26.594508] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-09T17:51:26.945422] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:27.196719] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-09T17:51:27.900272] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T17:51:27.922619] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T17:51:27.996667] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-09T17:51:28.796759] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-09T17:51:28.906129] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T17:51:29.464886] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T17:51:29.596704] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-09T17:51:30.396738] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-09T17:51:30.524600] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T17:51:31.196764] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-09T17:51:31.996751] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-09T17:51:32.081863] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T17:51:32.084342] [INFO ] [REMOTE ] BXMX: Full fetch complete (28775 records). [2025-10-09T17:51:32.084445] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-09T17:51:32.220054] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:51:32.500722] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-09T17:51:32.500808] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-09T17:51:32.501237] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-09T17:51:32.501277] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-09T17:51:32.502803] [DEBUG] [LOCAL ] BXMX: Trimmed 28775 records to 19639 (keeping 200 days of data) [2025-10-09T17:51:32.626373] [DEBUG] [LOCAL ] BXMX: Primary data saved (19639 records). [2025-10-09T17:51:32.626519] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-09T17:51:32.626601] [INFO ] [MAIN ] Update Progress: 375/2373 symbols completed. BXMX took 26.0s. Estimated remaining: 4h 34m 19s. Rate: 7.3 symbols/min [2025-10-09T17:51:32.793255] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:32.793418] [DEBUG] [LOCAL ] BYD: No existing data file found in primary storage. [2025-10-09T17:51:32.793500] [WARN ] [MAIN ] BYD: No existing data found, performing full refresh instead. [2025-10-09T17:51:32.793628] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-09T17:51:32.793706] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-09T17:51:32.793759] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-09T17:51:32.793792] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-09T17:51:32.804716] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-09T17:51:33.167236] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:33.181271] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T17:51:33.596701] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-09T17:51:34.184846] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:51:34.396786] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-09T17:51:35.201783] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-09T17:51:35.207165] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T17:51:35.619101] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T17:51:35.996728] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-09T17:51:36.546448] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T17:51:36.796793] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-09T17:51:37.068392] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T17:51:37.596777] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-09T17:51:37.796639] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T17:51:38.396725] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-09T17:51:39.196728] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-09T17:51:39.602227] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-09T17:51:39.996691] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-09T17:51:40.132120] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T17:51:40.299971] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T17:51:40.796718] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-09T17:51:41.399501] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T17:51:41.596716] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-09T17:51:42.251163] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T17:51:42.396695] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-09T17:51:43.169691] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T17:51:43.196681] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-09T17:51:43.696849] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:51:43.996730] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-09T17:51:44.796688] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-09T17:51:44.988593] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T17:51:45.596705] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-09T17:51:45.821582] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T17:51:45.860004] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T17:51:46.396798] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-09T17:51:47.136503] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T17:51:47.140435] [INFO ] [REMOTE ] BXP: Full fetch complete (71408 records). [2025-10-09T17:51:47.140571] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-09T17:51:47.141451] [FATAL] [VALIDATOR ] BXP: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:51:47.141558] [FATAL] [MAIN ] BXP: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:51:47.141604] [WARN ] [MAIN ] BXP: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:51:47.141707] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-09T17:51:47.141804] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-09T17:51:47.141877] [INFO ] [LOCAL ] BXP: Starting deletion of derivative data. [2025-10-09T17:51:47.142395] [DEBUG] [LOCAL ] BXP: Deleted derivative data file. [2025-10-09T17:51:47.142810] [INFO ] [MAIN ] Update Progress: 376/2373 symbols completed. BXP took 39.6s. Estimated remaining: 4h 34m 44s. Rate: 7.3 symbols/min [2025-10-09T17:51:47.199694] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-09T17:51:47.322560] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:47.336904] [DEBUG] [LOCAL ] BYM: Loaded 11961 existing records from primary storage. [2025-10-09T17:51:47.337144] [INFO ] [MAIN ] BYM: Loaded 11961 existing records. [2025-10-09T17:51:47.519616] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:47.519903] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-09T17:51:47.520084] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-09T17:51:47.525877] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-09T17:51:47.534241] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-09T17:51:47.567719] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:51:47.891811] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:47.996669] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-09T17:51:48.796684] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-09T17:51:48.835404] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T17:51:49.077072] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T17:51:49.596693] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-09T17:51:49.655605] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T17:51:50.396718] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-09T17:51:50.512504] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T17:51:51.196715] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-09T17:51:51.921839] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T17:51:51.996702] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-09T17:51:52.274599] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T17:51:52.279026] [INFO ] [REMOTE ] BXSL: Full fetch complete (69621 records). [2025-10-09T17:51:52.279134] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-09T17:51:52.663491] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-09T17:51:52.663586] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-09T17:51:52.664394] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-09T17:51:52.664454] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-09T17:51:52.665810] [DEBUG] [LOCAL ] BXSL: Trimmed 69621 records to 48220 (keeping 200 days of data) [2025-10-09T17:51:52.843144] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-09T17:51:52.968773] [DEBUG] [LOCAL ] BXSL: Primary data saved (48220 records). [2025-10-09T17:51:52.968924] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-09T17:51:52.969035] [INFO ] [MAIN ] Update Progress: 377/2373 symbols completed. BXSL took 39.7s. Estimated remaining: 4h 34m 23s. Rate: 7.3 symbols/min [2025-10-09T17:51:53.139328] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:51:53.173376] [DEBUG] [LOCAL ] BZH: Loaded 32393 existing records from primary storage. [2025-10-09T17:51:53.173686] [INFO ] [MAIN ] BZH: Loaded 32393 existing records. [2025-10-09T17:51:53.363548] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:51:53.363823] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-09T17:51:53.363871] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-09T17:51:53.364835] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-09T17:51:53.364894] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-09T17:51:53.609452] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-09T17:51:53.727696] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:51:53.751980] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T17:51:53.870990] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T17:51:54.396726] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-09T17:51:54.688172] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T17:51:55.196727] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-09T17:51:55.325465] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T17:51:55.996771] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-09T17:51:56.438280] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T17:51:56.796733] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-09T17:51:57.286465] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T17:51:57.596711] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-09T17:51:57.898937] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T17:51:58.219430] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T17:51:58.396771] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-09T17:51:59.196695] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-09T17:51:59.267037] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T17:51:59.269329] [INFO ] [REMOTE ] BY: Full fetch complete (29577 records). [2025-10-09T17:51:59.269426] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-09T17:51:59.712355] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-09T17:51:59.712467] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-09T17:51:59.713011] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-09T17:51:59.713093] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-09T17:51:59.714081] [DEBUG] [LOCAL ] BY: Trimmed 29577 records to 21764 (keeping 200 days of data) [2025-10-09T17:51:59.869276] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T17:51:59.873512] [DEBUG] [LOCAL ] BY: Primary data saved (21764 records). [2025-10-09T17:51:59.873964] [INFO ] [MAIN ] BY: Full history saved. [2025-10-09T17:51:59.874392] [INFO ] [MAIN ] Update Progress: 378/2373 symbols completed. BY took 33.7s. Estimated remaining: 4h 34m 7s. Rate: 7.3 symbols/min [2025-10-09T17:52:00.001987] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-09T17:52:00.046386] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:00.095527] [DEBUG] [LOCAL ] C: Loaded 53740 existing records from primary storage. [2025-10-09T17:52:00.095872] [INFO ] [MAIN ] C: Loaded 53740 existing records. [2025-10-09T17:52:00.268318] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:00.268556] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-09T17:52:00.268606] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-09T17:52:00.270262] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-09T17:52:00.270367] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-09T17:52:00.632320] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:00.796735] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-09T17:52:01.523052] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T17:52:01.596738] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-09T17:52:02.396772] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-09T17:52:02.790424] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-09T17:52:03.069277] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T17:52:03.196702] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-09T17:52:03.693320] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T17:52:03.996708] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-09T17:52:04.661713] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T17:52:04.796691] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-09T17:52:05.416136] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T17:52:05.596695] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-09T17:52:06.142474] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T17:52:06.375103] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T17:52:06.396672] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-09T17:52:07.196718] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-09T17:52:07.996699] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-09T17:52:08.127169] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T17:52:08.699938] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T17:52:08.796741] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-09T17:52:09.503549] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T17:52:09.596774] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-09T17:52:10.396686] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-09T17:52:10.484422] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T17:52:10.672624] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T17:52:11.196719] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-09T17:52:11.982924] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T17:52:11.996670] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-09T17:52:12.796725] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-09T17:52:13.108504] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T17:52:13.600228] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-09T17:52:13.601849] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T17:52:13.633538] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T17:52:13.637354] [INFO ] [REMOTE ] BYD: Full fetch complete (65126 records). [2025-10-09T17:52:13.637453] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-09T17:52:14.053946] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-09T17:52:14.054042] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-09T17:52:14.054771] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-09T17:52:14.054834] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-09T17:52:14.056090] [DEBUG] [LOCAL ] BYD: Trimmed 65126 records to 45181 (keeping 200 days of data) [2025-10-09T17:52:14.345875] [DEBUG] [LOCAL ] BYD: Primary data saved (45181 records). [2025-10-09T17:52:14.346008] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-09T17:52:14.346080] [INFO ] [MAIN ] Update Progress: 379/2373 symbols completed. BYD took 41.7s. Estimated remaining: 4h 34m 32s. Rate: 7.3 symbols/min [2025-10-09T17:52:14.402710] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-09T17:52:14.521383] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:14.540183] [DEBUG] [LOCAL ] CAAP: Loaded 19804 existing records from primary storage. [2025-10-09T17:52:14.540420] [INFO ] [MAIN ] CAAP: Loaded 19804 existing records. [2025-10-09T17:52:14.721090] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:14.721294] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-09T17:52:14.721341] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-09T17:52:14.722212] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-09T17:52:14.722270] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-09T17:52:15.076367] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:15.196732] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-09T17:52:15.315395] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T17:52:15.332037] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T17:52:15.333554] [INFO ] [REMOTE ] BYM: Full fetch complete (17915 records). [2025-10-09T17:52:15.333629] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-09T17:52:15.708529] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-09T17:52:15.708612] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-09T17:52:15.708973] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-09T17:52:15.709037] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-09T17:52:15.709623] [DEBUG] [LOCAL ] BYM: Trimmed 17915 records to 12051 (keeping 200 days of data) [2025-10-09T17:52:15.784923] [DEBUG] [LOCAL ] BYM: Primary data saved (12051 records). [2025-10-09T17:52:15.785092] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-09T17:52:15.785184] [INFO ] [MAIN ] Update Progress: 380/2373 symbols completed. BYM took 28.6s. Estimated remaining: 4h 33m 48s. Rate: 7.3 symbols/min [2025-10-09T17:52:15.967697] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:15.985481] [DEBUG] [LOCAL ] CABO: Loaded 16872 existing records from primary storage. [2025-10-09T17:52:15.985761] [INFO ] [MAIN ] CABO: Loaded 16872 existing records. [2025-10-09T17:52:16.007298] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-09T17:52:16.173092] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:16.173322] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-09T17:52:16.173378] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-09T17:52:16.174140] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-09T17:52:16.174200] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-09T17:52:16.535018] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:16.551357] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T17:52:16.796733] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-09T17:52:17.597351] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T17:52:17.597078] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-09T17:52:18.088613] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-09T17:52:18.396750] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-09T17:52:18.802903] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:52:19.196753] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-09T17:52:19.915121] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T17:52:19.996678] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-09T17:52:20.785493] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-09T17:52:20.796895] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-09T17:52:20.807223] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T17:52:21.596698] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-09T17:52:22.273258] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T17:52:22.396674] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-09T17:52:22.581863] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T17:52:23.196699] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-09T17:52:23.672223] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T17:52:23.996712] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-09T17:52:24.651549] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T17:52:24.677190] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T17:52:24.796710] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-09T17:52:25.596690] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-09T17:52:25.700453] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T17:52:26.396696] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-09T17:52:26.605702] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T17:52:27.196690] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-09T17:52:27.356029] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:52:27.996721] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-09T17:52:28.554953] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T17:52:28.796681] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-09T17:52:28.830934] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T17:52:29.596705] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-09T17:52:30.396779] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-09T17:52:30.552845] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T17:52:31.079592] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-09T17:52:31.196715] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-09T17:52:31.533134] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T17:52:31.536080] [INFO ] [REMOTE ] BZH: Full fetch complete (47007 records). [2025-10-09T17:52:31.536179] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-09T17:52:31.917229] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-09T17:52:31.917329] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-09T17:52:31.917987] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-09T17:52:31.918050] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-09T17:52:31.919116] [DEBUG] [LOCAL ] BZH: Trimmed 47007 records to 32653 (keeping 200 days of data) [2025-10-09T17:52:32.001704] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-09T17:52:32.108506] [DEBUG] [LOCAL ] BZH: Primary data saved (32653 records). [2025-10-09T17:52:32.108663] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-09T17:52:32.108763] [INFO ] [MAIN ] Update Progress: 381/2373 symbols completed. BZH took 39.1s. Estimated remaining: 4h 34m 22s. Rate: 7.3 symbols/min [2025-10-09T17:52:32.278635] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:32.301238] [DEBUG] [LOCAL ] CACI: Loaded 23827 existing records from primary storage. [2025-10-09T17:52:32.301489] [INFO ] [MAIN ] CACI: Loaded 23827 existing records. [2025-10-09T17:52:32.479501] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:32.479775] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-09T17:52:32.479825] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-09T17:52:32.480634] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-09T17:52:32.480726] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-09T17:52:32.802361] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-09T17:52:32.840499] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:33.002769] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T17:52:33.193757] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-09T17:52:33.198583] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-09T17:52:33.198782] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-09T17:52:33.590238] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-09T17:52:33.590333] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-09T17:52:33.591185] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-09T17:52:33.591257] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-09T17:52:33.592869] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 54130 (keeping 200 days of data) [2025-10-09T17:52:33.651096] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-09T17:52:33.941317] [DEBUG] [LOCAL ] C: Primary data saved (54130 records). [2025-10-09T17:52:33.941528] [INFO ] [MAIN ] C: Full history saved. [2025-10-09T17:52:33.942324] [INFO ] [MAIN ] Update Progress: 382/2373 symbols completed. C took 34.1s. Estimated remaining: 4h 33m 40s. Rate: 7.3 symbols/min [2025-10-09T17:52:34.113173] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T17:52:34.135680] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:34.183171] [DEBUG] [LOCAL ] CADE: Loaded 49166 existing records from primary storage. [2025-10-09T17:52:34.183487] [INFO ] [MAIN ] CADE: Loaded 49166 existing records. [2025-10-09T17:52:34.358997] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:34.359191] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-09T17:52:34.359237] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-09T17:52:34.360790] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-09T17:52:34.360849] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-09T17:52:34.402115] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-09T17:52:34.768769] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:34.769951] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T17:52:35.196721] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-09T17:52:35.238542] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T17:52:35.819860] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T17:52:35.996708] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-09T17:52:36.796720] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-09T17:52:37.079041] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:52:37.596710] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-09T17:52:38.070168] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T17:52:38.396821] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-09T17:52:38.400457] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T17:52:39.196746] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-09T17:52:40.001247] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-09T17:52:40.003556] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T17:52:40.529249] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T17:52:40.796792] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-09T17:52:41.248774] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T17:52:41.596766] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-09T17:52:42.129512] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T17:52:42.352320] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T17:52:42.396667] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-09T17:52:43.171963] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T17:52:43.173386] [INFO ] [REMOTE ] CABO: Full fetch complete (23124 records). [2025-10-09T17:52:43.173458] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-09T17:52:43.202306] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-09T17:52:43.536801] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-09T17:52:43.536882] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-09T17:52:43.537317] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-09T17:52:43.537382] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-09T17:52:43.538039] [DEBUG] [LOCAL ] CABO: Trimmed 23124 records to 16965 (keeping 200 days of data) [2025-10-09T17:52:43.662391] [DEBUG] [LOCAL ] CABO: Primary data saved (16965 records). [2025-10-09T17:52:43.662612] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-09T17:52:43.662738] [INFO ] [MAIN ] Update Progress: 383/2373 symbols completed. CABO took 27.9s. Estimated remaining: 4h 33m 39s. Rate: 7.3 symbols/min [2025-10-09T17:52:43.829882] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:43.868438] [DEBUG] [LOCAL ] CAE: Loaded 39208 existing records from primary storage. [2025-10-09T17:52:43.868741] [INFO ] [MAIN ] CAE: Loaded 39208 existing records. [2025-10-09T17:52:44.001789] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-09T17:52:44.057462] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:44.057669] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-09T17:52:44.057748] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-09T17:52:44.058986] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-09T17:52:44.059048] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-09T17:52:44.430471] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:44.435878] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T17:52:44.438050] [INFO ] [REMOTE ] CAAP: Full fetch complete (27788 records). [2025-10-09T17:52:44.438121] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-09T17:52:44.805579] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-09T17:52:44.819781] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-09T17:52:44.819865] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-09T17:52:44.820360] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-09T17:52:44.820415] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-09T17:52:44.821161] [DEBUG] [LOCAL ] CAAP: Trimmed 27788 records to 19969 (keeping 200 days of data) [2025-10-09T17:52:44.941028] [DEBUG] [LOCAL ] CAAP: Primary data saved (19969 records). [2025-10-09T17:52:44.941175] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-09T17:52:44.941257] [INFO ] [MAIN ] Update Progress: 384/2373 symbols completed. CAAP took 30.6s. Estimated remaining: 4h 32m 55s. Rate: 7.3 symbols/min [2025-10-09T17:52:45.120987] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:52:45.126215] [DEBUG] [LOCAL ] CAF: Loaded 3399 existing records from primary storage. [2025-10-09T17:52:45.126408] [INFO ] [MAIN ] CAF: Loaded 3399 existing records. [2025-10-09T17:52:45.315747] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:52:45.315982] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-09T17:52:45.316034] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-09T17:52:45.316333] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-09T17:52:45.316394] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-09T17:52:45.599896] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-09T17:52:45.679704] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:52:45.700792] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T17:52:46.396686] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-09T17:52:46.823272] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-09T17:52:47.109500] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T17:52:47.196717] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-09T17:52:47.931844] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T17:52:47.996681] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-09T17:52:48.042961] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T17:52:48.796754] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-09T17:52:49.252449] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T17:52:49.596766] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-09T17:52:50.169942] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T17:52:50.195191] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T17:52:50.396754] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-09T17:52:51.196764] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-09T17:52:51.766529] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T17:52:51.996789] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-09T17:52:52.630469] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T17:52:52.796758] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-09T17:52:53.321498] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T17:52:53.596722] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-09T17:52:54.175887] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:52:54.396677] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-09T17:52:54.587231] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T17:52:54.747922] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T17:52:55.196753] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-09T17:52:55.732419] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T17:52:55.996752] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-09T17:52:56.796777] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-09T17:52:57.185763] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T17:52:57.596810] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-09T17:52:57.877187] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T17:52:58.357774] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T17:52:58.396721] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-09T17:52:59.045487] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T17:52:59.196723] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-09T17:52:59.666322] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T17:52:59.996727] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-09T17:53:00.796738] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-09T17:53:01.596705] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-09T17:53:01.707681] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T17:53:02.328864] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:53:02.396746] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-09T17:53:02.999246] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T17:53:03.196770] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-09T17:53:03.557585] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:53:03.996716] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-09T17:53:04.796718] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-09T17:53:04.850029] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T17:53:05.354976] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T17:53:05.381038] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T17:53:05.596714] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-09T17:53:06.396733] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-09T17:53:06.837816] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T17:53:07.196722] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-09T17:53:07.579001] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T17:53:07.996778] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-09T17:53:08.796723] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-09T17:53:08.949380] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T17:53:08.951179] [INFO ] [REMOTE ] CACI: Full fetch complete (38487 records). [2025-10-09T17:53:08.951249] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-09T17:53:09.167285] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T17:53:09.381827] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-09T17:53:09.381744] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T17:53:09.383079] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-09T17:53:09.383860] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-09T17:53:09.383921] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-09T17:53:09.384637] [DEBUG] [LOCAL ] CACI: Trimmed 38487 records to 23891 (keeping 200 days of data) [2025-10-09T17:53:09.528449] [DEBUG] [LOCAL ] CACI: Primary data saved (23891 records). [2025-10-09T17:53:09.528588] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-09T17:53:09.528700] [INFO ] [MAIN ] Update Progress: 385/2373 symbols completed. CACI took 37.4s. Estimated remaining: 4h 34m 11s. Rate: 7.3 symbols/min [2025-10-09T17:53:09.601950] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-09T17:53:09.698196] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:09.751402] [DEBUG] [LOCAL ] CAG: Loaded 53664 existing records from primary storage. [2025-10-09T17:53:09.751714] [INFO ] [MAIN ] CAG: Loaded 53664 existing records. [2025-10-09T17:53:09.926329] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:09.926595] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-09T17:53:09.926665] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-09T17:53:09.926957] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-09T17:53:09.927016] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-09T17:53:10.276724] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:10.280603] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T17:53:10.396671] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-09T17:53:11.196727] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-09T17:53:11.996841] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-09T17:53:12.321137] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T17:53:12.801818] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-09T17:53:12.816464] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T17:53:13.299679] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T17:53:13.300508] [INFO ] [REMOTE ] CAF: Full fetch complete (5536 records). [2025-10-09T17:53:13.300574] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-09T17:53:13.300955] [FATAL] [VALIDATOR ] CAF: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:53:13.301037] [FATAL] [MAIN ] CAF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:53:13.301124] [WARN ] [MAIN ] CAF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:53:13.301208] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-09T17:53:13.301286] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-10-09T17:53:13.301337] [INFO ] [LOCAL ] CAF: Starting deletion of derivative data. [2025-10-09T17:53:13.301593] [DEBUG] [LOCAL ] CAF: Deleted derivative data file. [2025-10-09T17:53:13.301744] [INFO ] [MAIN ] Update Progress: 386/2373 symbols completed. CAF took 28.4s. Estimated remaining: 4h 33m 40s. Rate: 7.3 symbols/min [2025-10-09T17:53:13.473024] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:13.503080] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T17:53:13.558613] [DEBUG] [LOCAL ] CAH: Loaded 51469 existing records from primary storage. [2025-10-09T17:53:13.558935] [INFO ] [MAIN ] CAH: Loaded 51469 existing records. [2025-10-09T17:53:13.601884] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-09T17:53:13.735113] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:13.735300] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-09T17:53:13.735346] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-09T17:53:13.735815] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-09T17:53:13.735873] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-09T17:53:14.088001] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:14.396721] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-09T17:53:15.196720] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-09T17:53:15.257467] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T17:53:15.996739] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-09T17:53:16.245359] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T17:53:16.796749] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-09T17:53:16.880956] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:53:17.596686] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-09T17:53:17.661356] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T17:53:17.665871] [INFO ] [REMOTE ] CADE: Full fetch complete (70145 records). [2025-10-09T17:53:17.666018] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-09T17:53:18.054315] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-09T17:53:18.054521] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-09T17:53:18.055377] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-09T17:53:18.055551] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-09T17:53:18.057134] [DEBUG] [LOCAL ] CADE: Trimmed 70145 records to 49553 (keeping 200 days of data) [2025-10-09T17:53:18.313240] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T17:53:18.398523] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-09T17:53:18.410080] [DEBUG] [LOCAL ] CADE: Primary data saved (49553 records). [2025-10-09T17:53:18.410212] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-09T17:53:18.411352] [INFO ] [MAIN ] Update Progress: 387/2373 symbols completed. CADE took 44.5s. Estimated remaining: 4h 33m 15s. Rate: 7.3 symbols/min [2025-10-09T17:53:18.580509] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:18.623076] [DEBUG] [LOCAL ] CAL: Loaded 43047 existing records from primary storage. [2025-10-09T17:53:18.623369] [INFO ] [MAIN ] CAL: Loaded 43047 existing records. [2025-10-09T17:53:18.801401] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:18.801629] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-09T17:53:18.801717] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-09T17:53:18.801974] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-09T17:53:18.802035] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-09T17:53:19.160174] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:19.196671] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-09T17:53:19.350291] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T17:53:19.996691] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-09T17:53:20.250612] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T17:53:20.796730] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-09T17:53:20.830625] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T17:53:21.596699] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-09T17:53:21.857719] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T17:53:22.149857] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T17:53:22.396735] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-09T17:53:22.867492] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T17:53:23.196744] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-09T17:53:23.455341] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T17:53:23.996741] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-09T17:53:24.782210] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T17:53:24.796677] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-09T17:53:24.988728] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T17:53:25.596729] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-09T17:53:26.396748] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-09T17:53:26.686139] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T17:53:27.026565] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:53:27.030131] [INFO ] [REMOTE ] CAE: Full fetch complete (56175 records). [2025-10-09T17:53:27.030225] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-09T17:53:27.215379] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-09T17:53:27.407397] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-09T17:53:27.407489] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-09T17:53:27.408185] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-09T17:53:27.408253] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-09T17:53:27.409476] [DEBUG] [LOCAL ] CAE: Trimmed 56175 records to 39472 (keeping 200 days of data) [2025-10-09T17:53:27.635819] [DEBUG] [LOCAL ] CAE: Primary data saved (39472 records). [2025-10-09T17:53:27.635964] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-09T17:53:27.636049] [INFO ] [MAIN ] Update Progress: 388/2373 symbols completed. CAE took 44.0s. Estimated remaining: 4h 33m 12s. Rate: 7.3 symbols/min [2025-10-09T17:53:27.802550] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:27.836698] [DEBUG] [LOCAL ] CALX: Loaded 37736 existing records from primary storage. [2025-10-09T17:53:27.836980] [INFO ] [MAIN ] CALX: Loaded 37736 existing records. [2025-10-09T17:53:28.012799] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-09T17:53:28.016602] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:28.017926] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-09T17:53:28.018043] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-09T17:53:28.019327] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-09T17:53:28.019392] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-09T17:53:28.190478] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T17:53:28.420160] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:28.796676] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-09T17:53:29.261533] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T17:53:29.596688] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-09T17:53:29.721807] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T17:53:30.030179] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T17:53:30.396799] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-09T17:53:31.088224] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T17:53:31.196677] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-09T17:53:31.996686] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-09T17:53:32.491128] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T17:53:32.796684] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-09T17:53:32.939302] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T17:53:33.014600] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T17:53:33.596710] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-09T17:53:34.208743] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T17:53:34.396672] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-09T17:53:34.981579] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T17:53:35.196713] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-09T17:53:35.996758] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-09T17:53:36.391715] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T17:53:36.712638] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:53:36.796714] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-09T17:53:37.465409] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T17:53:37.596750] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-09T17:53:38.396824] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-09T17:53:38.648539] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T17:53:39.196690] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-09T17:53:39.505781] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T17:53:39.841694] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T17:53:39.996687] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-09T17:53:40.796685] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-09T17:53:41.150199] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T17:53:41.201491] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T17:53:41.596739] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-09T17:53:42.179569] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:53:42.396760] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-09T17:53:43.196689] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-09T17:53:43.405538] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-09T17:53:43.410445] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-09T17:53:43.410582] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-09T17:53:43.819393] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T17:53:43.851039] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-09T17:53:43.851421] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-09T17:53:43.852303] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-09T17:53:43.852491] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-09T17:53:43.853938] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 54054 (keeping 200 days of data) [2025-10-09T17:53:44.036750] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-09T17:53:44.196929] [DEBUG] [LOCAL ] CAG: Primary data saved (54054 records). [2025-10-09T17:53:44.197117] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-09T17:53:44.197255] [INFO ] [MAIN ] Update Progress: 389/2373 symbols completed. CAG took 34.7s. Estimated remaining: 4h 33m 46s. Rate: 7.2 symbols/min [2025-10-09T17:53:44.385589] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:44.408899] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T17:53:44.437304] [DEBUG] [LOCAL ] CANG: Loaded 26953 existing records from primary storage. [2025-10-09T17:53:44.437584] [INFO ] [MAIN ] CANG: Loaded 26953 existing records. [2025-10-09T17:53:44.625369] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:44.625625] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-09T17:53:44.625738] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-09T17:53:44.626573] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-09T17:53:44.626633] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-09T17:53:44.811143] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-09T17:53:45.011729] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:45.403172] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T17:53:45.596713] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-09T17:53:45.977832] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T17:53:46.396723] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-09T17:53:46.898781] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:53:47.196773] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-09T17:53:47.825174] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T17:53:47.828846] [INFO ] [REMOTE ] CAL: Full fetch complete (61773 records). [2025-10-09T17:53:47.828958] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-09T17:53:48.003217] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-09T17:53:48.243189] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-09T17:53:48.243268] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-09T17:53:48.243976] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-09T17:53:48.244040] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-09T17:53:48.245207] [DEBUG] [LOCAL ] CAL: Trimmed 61773 records to 43336 (keeping 200 days of data) [2025-10-09T17:53:48.513352] [DEBUG] [LOCAL ] CAL: Primary data saved (43336 records). [2025-10-09T17:53:48.513509] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-09T17:53:48.514093] [INFO ] [MAIN ] Update Progress: 390/2373 symbols completed. CAL took 30.1s. Estimated remaining: 4h 33m 18s. Rate: 7.3 symbols/min [2025-10-09T17:53:48.687827] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:48.696613] [DEBUG] [LOCAL ] CAPL: Loaded 5700 existing records from primary storage. [2025-10-09T17:53:48.696862] [INFO ] [MAIN ] CAPL: Loaded 5700 existing records. [2025-10-09T17:53:48.796776] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-09T17:53:48.901739] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:48.903783] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T17:53:48.903888] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-09T17:53:48.912840] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-09T17:53:48.913691] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-09T17:53:48.913753] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-09T17:53:49.281223] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:49.396839] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T17:53:49.401251] [INFO ] [REMOTE ] CAH: Full fetch complete (74587 records). [2025-10-09T17:53:49.401367] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-09T17:53:49.607531] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-09T17:53:49.823433] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-09T17:53:49.823552] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-09T17:53:49.824448] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-09T17:53:49.824513] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-09T17:53:49.826072] [DEBUG] [LOCAL ] CAH: Trimmed 74587 records to 51836 (keeping 200 days of data) [2025-10-09T17:53:50.164000] [DEBUG] [LOCAL ] CAH: Primary data saved (51836 records). [2025-10-09T17:53:50.164149] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-09T17:53:50.165321] [INFO ] [MAIN ] Update Progress: 391/2373 symbols completed. CAH took 36.9s. Estimated remaining: 4h 32m 36s. Rate: 7.3 symbols/min [2025-10-09T17:53:50.335937] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:53:50.390423] [DEBUG] [LOCAL ] CARR: Loaded 53597 existing records from primary storage. [2025-10-09T17:53:50.390878] [INFO ] [MAIN ] CARR: Loaded 53597 existing records. [2025-10-09T17:53:50.408034] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-09T17:53:50.421624] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T17:53:50.595048] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:53:50.595260] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-09T17:53:50.595306] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-09T17:53:50.596625] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-09T17:53:50.596717] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-09T17:53:50.957252] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:53:51.125740] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T17:53:51.196671] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-09T17:53:51.419408] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T17:53:51.996688] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-09T17:53:52.714918] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T17:53:52.796674] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-09T17:53:52.983252] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T17:53:53.596694] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-09T17:53:53.688980] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T17:53:54.396731] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-09T17:53:55.196704] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-09T17:53:55.549102] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T17:53:55.996722] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-09T17:53:56.119299] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-09T17:53:56.400321] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T17:53:56.796742] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-09T17:53:57.175852] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T17:53:57.596778] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-09T17:53:58.396757] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-09T17:53:58.493478] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T17:53:58.557288] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T17:53:59.196762] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-09T17:53:59.769324] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T17:53:59.772302] [INFO ] [REMOTE ] CALX: Full fetch complete (53980 records). [2025-10-09T17:53:59.772385] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-09T17:54:00.001735] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-09T17:54:00.124161] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T17:54:00.194467] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-09T17:54:00.194542] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-09T17:54:00.195188] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-09T17:54:00.195250] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-09T17:54:00.196325] [DEBUG] [LOCAL ] CALX: Trimmed 53980 records to 37960 (keeping 200 days of data) [2025-10-09T17:54:00.413999] [DEBUG] [LOCAL ] CALX: Primary data saved (37960 records). [2025-10-09T17:54:00.414135] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-09T17:54:00.414728] [INFO ] [MAIN ] Update Progress: 392/2373 symbols completed. CALX took 32.8s. Estimated remaining: 4h 32m 38s. Rate: 7.3 symbols/min [2025-10-09T17:54:00.582139] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:54:00.621616] [DEBUG] [LOCAL ] CARS: Loaded 39698 existing records from primary storage. [2025-10-09T17:54:00.621917] [INFO ] [MAIN ] CARS: Loaded 39698 existing records. [2025-10-09T17:54:00.727359] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T17:54:00.801978] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-09T17:54:00.806246] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:54:00.807286] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-09T17:54:00.807375] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-09T17:54:00.807722] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-09T17:54:00.807782] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-09T17:54:01.155421] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:54:01.596787] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-09T17:54:02.004695] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T17:54:02.396740] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-09T17:54:02.530884] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T17:54:03.196745] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-09T17:54:03.500392] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T17:54:03.996715] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-09T17:54:04.717038] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T17:54:04.732308] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T17:54:04.796734] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-09T17:54:05.596774] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-09T17:54:06.396710] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-09T17:54:06.653863] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T17:54:06.765084] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T17:54:07.196726] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-09T17:54:07.716112] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T17:54:07.851830] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T17:54:07.996764] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-09T17:54:08.578377] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T17:54:08.796725] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-09T17:54:09.596718] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-09T17:54:10.131098] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T17:54:10.396719] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-09T17:54:10.549344] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T17:54:11.050135] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T17:54:11.196728] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-09T17:54:11.996782] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-09T17:54:12.796696] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-09T17:54:13.133614] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T17:54:13.380352] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T17:54:13.551686] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T17:54:13.596671] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-09T17:54:14.396727] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-09T17:54:15.196778] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-09T17:54:15.390362] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T17:54:15.996690] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-09T17:54:16.051373] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T17:54:16.247372] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T17:54:16.250350] [INFO ] [REMOTE ] CANG: Full fetch complete (40014 records). [2025-10-09T17:54:16.250439] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-09T17:54:16.709531] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-09T17:54:16.709745] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-09T17:54:16.710347] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-09T17:54:16.710392] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-09T17:54:16.711434] [DEBUG] [LOCAL ] CANG: Trimmed 40014 records to 27185 (keeping 200 days of data) [2025-10-09T17:54:16.796753] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-09T17:54:16.867087] [DEBUG] [LOCAL ] CANG: Primary data saved (27185 records). [2025-10-09T17:54:16.867222] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-09T17:54:16.867306] [INFO ] [MAIN ] Update Progress: 393/2373 symbols completed. CANG took 32.7s. Estimated remaining: 4h 33m 11s. Rate: 7.2 symbols/min [2025-10-09T17:54:17.032141] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:54:17.082441] [DEBUG] [LOCAL ] CAT: Loaded 52918 existing records from primary storage. [2025-10-09T17:54:17.082849] [INFO ] [MAIN ] CAT: Loaded 52918 existing records. [2025-10-09T17:54:17.271058] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:54:17.271420] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-09T17:54:17.271564] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-09T17:54:17.272046] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-09T17:54:17.272247] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-09T17:54:17.481905] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T17:54:17.599027] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-09T17:54:17.678998] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:54:18.228310] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T17:54:18.271024] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T17:54:18.396710] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-09T17:54:19.196706] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-09T17:54:19.996703] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-09T17:54:20.287025] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T17:54:20.796722] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-09T17:54:21.237353] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T17:54:21.305124] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T17:54:21.506114] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T17:54:21.507228] [INFO ] [REMOTE ] CAPL: Full fetch complete (8722 records). [2025-10-09T17:54:21.507299] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-09T17:54:21.601903] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-09T17:54:21.885118] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-09T17:54:21.885201] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-09T17:54:21.885442] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-09T17:54:21.885482] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-09T17:54:21.885962] [DEBUG] [LOCAL ] CAPL: Trimmed 8722 records to 5748 (keeping 200 days of data) [2025-10-09T17:54:21.922808] [DEBUG] [LOCAL ] CAPL: Primary data saved (5748 records). [2025-10-09T17:54:21.922931] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-09T17:54:21.923015] [INFO ] [MAIN ] Update Progress: 394/2373 symbols completed. CAPL took 33.4s. Estimated remaining: 4h 32m 46s. Rate: 7.3 symbols/min [2025-10-09T17:54:22.095198] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:54:22.104684] [DEBUG] [LOCAL ] CATO: Loaded 6871 existing records from primary storage. [2025-10-09T17:54:22.104905] [INFO ] [MAIN ] CATO: Loaded 6871 existing records. [2025-10-09T17:54:22.279732] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:54:22.279953] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-09T17:54:22.280005] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-09T17:54:22.280192] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-09T17:54:22.280248] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-09T17:54:22.401912] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-09T17:54:22.652126] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:54:23.196726] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-09T17:54:23.762503] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-09T17:54:23.796883] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T17:54:23.996718] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-09T17:54:24.411152] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T17:54:24.796733] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-09T17:54:25.516323] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T17:54:25.567790] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T17:54:25.596669] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-09T17:54:26.396718] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-09T17:54:26.934082] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T17:54:26.961811] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T17:54:27.196724] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-09T17:54:27.996729] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-09T17:54:28.778466] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T17:54:28.796665] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-09T17:54:29.172395] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-09T17:54:29.251624] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T17:54:29.596722] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-09T17:54:30.396722] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-09T17:54:31.062375] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T17:54:31.071277] [INFO ] [REMOTE ] CARS: Full fetch complete (55764 records). [2025-10-09T17:54:31.071508] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-09T17:54:31.201901] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-09T17:54:31.598449] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-09T17:54:31.598792] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-09T17:54:31.599673] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-09T17:54:31.599740] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-09T17:54:31.601461] [DEBUG] [LOCAL ] CARS: Trimmed 55764 records to 40024 (keeping 200 days of data) [2025-10-09T17:54:31.875830] [DEBUG] [LOCAL ] CARS: Primary data saved (40024 records). [2025-10-09T17:54:31.875965] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-09T17:54:31.876507] [INFO ] [MAIN ] Update Progress: 395/2373 symbols completed. CARS took 31.5s. Estimated remaining: 4h 32m 46s. Rate: 7.3 symbols/min [2025-10-09T17:54:32.001824] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-09T17:54:32.049436] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:54:32.101767] [DEBUG] [LOCAL ] CAVA: Loaded 53555 existing records from primary storage. [2025-10-09T17:54:32.102139] [INFO ] [MAIN ] CAVA: Loaded 53555 existing records. [2025-10-09T17:54:32.283375] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:54:32.283851] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-09T17:54:32.283927] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-09T17:54:32.294917] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-09T17:54:32.312416] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-09T17:54:32.408715] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-09T17:54:32.550450] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-09T17:54:32.696678] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:54:32.796723] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-09T17:54:33.252980] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-09T17:54:33.596778] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-09T17:54:34.396729] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-09T17:54:34.564796] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T17:54:34.569430] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-09T17:54:34.569571] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-09T17:54:34.983252] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-09T17:54:34.983352] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-09T17:54:34.984314] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-09T17:54:34.984389] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-09T17:54:34.986116] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 53987 (keeping 200 days of data) [2025-10-09T17:54:35.216554] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T17:54:35.215273] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-09T17:54:35.371227] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T17:54:35.372952] [DEBUG] [LOCAL ] CARR: Primary data saved (53987 records). [2025-10-09T17:54:35.383985] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-09T17:54:35.385030] [INFO ] [MAIN ] Update Progress: 396/2373 symbols completed. CARR took 45.2s. Estimated remaining: 4h 32m 14s. Rate: 7.3 symbols/min [2025-10-09T17:54:35.569094] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:54:35.619442] [DEBUG] [LOCAL ] CB: Loaded 49934 existing records from primary storage. [2025-10-09T17:54:35.619812] [INFO ] [MAIN ] CB: Loaded 49934 existing records. [2025-10-09T17:54:35.795474] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:54:35.795774] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-09T17:54:35.795830] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-09T17:54:35.796045] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-09T17:54:35.796101] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-09T17:54:36.001988] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-09T17:54:36.154799] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:54:36.796787] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-09T17:54:37.139885] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T17:54:37.596701] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-09T17:54:37.809570] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T17:54:38.396724] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-09T17:54:38.443834] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T17:54:38.523787] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T17:54:39.196731] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-09T17:54:39.966475] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T17:54:39.996699] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-09T17:54:40.084487] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T17:54:40.715436] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T17:54:40.796726] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-09T17:54:41.596794] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-09T17:54:42.120720] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T17:54:42.396750] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-09T17:54:43.120713] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T17:54:43.122262] [INFO ] [REMOTE ] CATO: Full fetch complete (11006 records). [2025-10-09T17:54:43.122359] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-09T17:54:43.201865] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-09T17:54:43.503137] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-09T17:54:43.503255] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-09T17:54:43.503570] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-09T17:54:43.503614] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-09T17:54:43.504347] [DEBUG] [LOCAL ] CATO: Trimmed 11006 records to 6908 (keeping 200 days of data) [2025-10-09T17:54:43.546346] [DEBUG] [LOCAL ] CATO: Primary data saved (6908 records). [2025-10-09T17:54:43.546685] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-09T17:54:43.546830] [INFO ] [MAIN ] Update Progress: 397/2373 symbols completed. CATO took 21.6s. Estimated remaining: 4h 32m 6s. Rate: 7.3 symbols/min [2025-10-09T17:54:43.718293] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-09T17:54:43.996763] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-09T17:54:44.796771] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-09T17:54:45.242399] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-09T17:54:45.596690] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-09T17:54:45.935705] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T17:54:46.049472] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T17:54:46.396768] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-09T17:54:47.196815] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-09T17:54:47.716580] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-09T17:54:48.005527] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-09T17:54:48.024495] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T17:54:48.796793] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-09T17:54:49.003537] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T17:54:49.596692] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-09T17:54:49.771737] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T17:54:50.396736] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-09T17:54:50.829022] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-09T17:54:51.196779] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-09T17:54:51.587535] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T17:54:51.996738] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-09T17:54:52.263251] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T17:54:52.603618] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T17:54:52.796794] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-09T17:54:53.596730] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-09T17:54:54.313634] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-09T17:54:54.396680] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-09T17:54:54.479823] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T17:54:55.196749] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-09T17:54:55.752303] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-09T17:54:55.996715] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-09T17:54:56.357856] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T17:54:56.362429] [INFO ] [REMOTE ] CAT: Full fetch complete (76687 records). [2025-10-09T17:54:56.362552] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-09T17:54:56.761327] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-09T17:54:56.761463] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-09T17:54:56.762371] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-09T17:54:56.762494] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-09T17:54:56.764029] [DEBUG] [LOCAL ] CAT: Trimmed 76687 records to 53301 (keeping 200 days of data) [2025-10-09T17:54:57.113106] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T17:54:57.126889] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-09T17:54:57.144040] [DEBUG] [LOCAL ] CAT: Primary data saved (53301 records). [2025-10-09T17:54:57.144298] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-09T17:54:57.144399] [INFO ] [MAIN ] Update Progress: 398/2373 symbols completed. CAT took 40.3s. Estimated remaining: 4h 32m 24s. Rate: 7.3 symbols/min [2025-10-09T17:54:57.652628] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T17:54:57.664809] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-09T17:54:58.818150] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T17:54:58.828955] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-09T17:54:59.790873] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-09T17:54:59.802709] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-09T17:55:00.239754] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T17:55:00.250875] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-09T17:55:01.974873] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-09T17:55:01.987544] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-09T17:55:02.069622] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-09T17:55:02.073953] [INFO ] [REMOTE ] CB: Full fetch complete (72590 records). [2025-10-09T17:55:02.074095] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-09T17:55:02.476474] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-09T17:55:02.476571] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-09T17:55:02.477402] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-09T17:55:02.477469] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-09T17:55:02.479015] [DEBUG] [LOCAL ] CB: Trimmed 72590 records to 50296 (keeping 200 days of data) [2025-10-09T17:55:02.798612] [DEBUG] [LOCAL ] CB: Primary data saved (50296 records). [2025-10-09T17:55:02.798775] [INFO ] [MAIN ] CB: Full history saved. [2025-10-09T17:55:02.799710] [INFO ] [MAIN ] Update Progress: 399/2373 symbols completed. CB took 27.4s. Estimated remaining: 4h 32m 3s. Rate: 7.3 symbols/min [2025-10-09T17:55:03.681774] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T17:55:03.685909] [INFO ] [REMOTE ] CAVA: Full fetch complete (76932 records). [2025-10-09T17:55:03.686038] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-09T17:55:03.686813] [FATAL] [VALIDATOR ] CAVA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:55:03.686901] [FATAL] [MAIN ] CAVA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:55:03.686946] [WARN ] [MAIN ] CAVA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:55:03.686984] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-09T17:55:03.687057] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-10-09T17:55:03.687127] [INFO ] [LOCAL ] CAVA: Starting deletion of derivative data. [2025-10-09T17:55:03.687375] [DEBUG] [LOCAL ] CAVA: Deleted derivative data file. [2025-10-09T17:55:03.687685] [INFO ] [MAIN ] Update Progress: 400/2373 symbols completed. CAVA took 31.8s. Estimated remaining: 4h 31m 18s. Rate: 7.3 symbols/min [2025-10-09T17:55:04.191948] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:04.403442] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:04.414442] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:04.439040] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:04.439891] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-09T17:55:04.439965] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-09T17:55:04.440123] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-09T17:55:04.440181] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-09T17:55:04.440227] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-09T17:55:04.440263] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-09T17:55:04.514151] [DEBUG] [LOCAL ] CBL: Loaded 16262 existing records from primary storage. [2025-10-09T17:55:04.541945] [INFO ] [MAIN ] CBL: Loaded 16262 existing records. [2025-10-09T17:55:04.568628] [DEBUG] [LOCAL ] CBNA: Loaded 2896 existing records from primary storage. [2025-10-09T17:55:04.612302] [INFO ] [MAIN ] CBNA: Loaded 2896 existing records. [2025-10-09T17:55:04.592408] [DEBUG] [LOCAL ] CBAN: Loaded 10649 existing records from primary storage. [2025-10-09T17:55:04.665431] [INFO ] [MAIN ] CBAN: Loaded 10649 existing records. [2025-10-09T17:55:05.293956] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:05.302184] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:05.322164] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-09T17:55:05.350409] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:05.350553] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-09T17:55:05.384055] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-09T17:55:05.384226] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-09T17:55:05.384005] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-09T17:55:05.403389] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-09T17:55:05.407380] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-09T17:55:05.401192] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-09T17:55:05.407310] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:05.404217] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-09T17:55:05.428054] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-09T17:55:05.428152] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-09T17:55:05.433672] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-09T17:55:05.434424] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-09T17:55:05.794811] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:55:05.895798] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-09T17:55:06.042298] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:55:06.163300] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-09T17:55:06.278226] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:55:06.299748] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-09T17:55:06.321262] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-09T17:55:06.357613] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-09T17:55:06.357869] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-09T17:55:06.381278] [INFO ] [MAIN ] Update Progress: 401/2373 symbols completed. CBO took 2.7s. Estimated remaining: 4h 30m 42s. Rate: 7.3 symbols/min [2025-10-09T17:55:06.460384] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:06.535997] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:06.523302] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-09T17:55:06.586923] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:06.595573] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-09T17:55:06.550400] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-09T17:55:06.726292] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:06.726481] [DEBUG] [LOCAL ] CBRE: No existing data file found in primary storage. [2025-10-09T17:55:06.726537] [WARN ] [MAIN ] CBRE: No existing data found, performing full refresh instead. [2025-10-09T17:55:06.726675] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-09T17:55:06.726731] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-09T17:55:06.726775] [DEBUG] [LOCAL ] CBRE: No primary data file found to delete. [2025-10-09T17:55:06.726808] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-09T17:55:07.086463] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:07.086826] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-09T17:55:07.359625] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T17:55:07.361304] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-09T17:55:07.480194] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:55:07.482564] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-09T17:55:07.825059] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T17:55:07.830220] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-09T17:55:07.933770] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T17:55:07.996721] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-09T17:55:08.047827] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T17:55:08.316250] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T17:55:08.747795] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T17:55:08.796695] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-09T17:55:08.901134] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T17:55:09.596779] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-09T17:55:10.100845] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-09T17:55:10.157395] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T17:55:10.396728] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-09T17:55:10.975037] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-09T17:55:11.196766] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-09T17:55:11.996694] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-09T17:55:12.139595] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:55:12.536552] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T17:55:12.796762] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-09T17:55:13.596696] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-09T17:55:13.723869] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T17:55:13.941003] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T17:55:14.396769] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-09T17:55:14.849136] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T17:55:15.196744] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-09T17:55:15.996755] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-09T17:55:16.251671] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T17:55:16.796742] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-09T17:55:17.416681] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T17:55:17.596726] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-09T17:55:17.818722] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T17:55:18.396745] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-09T17:55:19.196704] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-09T17:55:19.313759] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T17:55:19.314147] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T17:55:19.823301] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T17:55:19.996689] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-09T17:55:20.796768] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-09T17:55:21.444801] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T17:55:21.596693] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-09T17:55:21.663511] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T17:55:22.355553] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T17:55:22.396678] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-09T17:55:23.197694] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-09T17:55:23.252585] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T17:55:23.996747] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-09T17:55:24.616844] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T17:55:24.798124] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-09T17:55:24.799258] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T17:55:25.596738] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-09T17:55:26.016539] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T17:55:26.397347] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-09T17:55:26.403002] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:55:27.196752] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-09T17:55:27.208429] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T17:55:27.672780] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T17:55:27.674129] [INFO ] [REMOTE ] CBNA: Full fetch complete (4470 records). [2025-10-09T17:55:27.674230] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-09T17:55:28.008137] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-09T17:55:28.050521] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-09T17:55:28.050611] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-09T17:55:28.050791] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-09T17:55:28.050850] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-09T17:55:28.051201] [DEBUG] [LOCAL ] CBNA: Trimmed 4470 records to 2910 (keeping 200 days of data) [2025-10-09T17:55:28.070706] [DEBUG] [LOCAL ] CBNA: Primary data saved (2910 records). [2025-10-09T17:55:28.070820] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-09T17:55:28.070941] [INFO ] [MAIN ] Update Progress: 402/2373 symbols completed. CBNA took 24.4s. Estimated remaining: 4h 31m 40s. Rate: 7.3 symbols/min [2025-10-09T17:55:28.236455] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:28.268859] [DEBUG] [LOCAL ] CBT: Loaded 30800 existing records from primary storage. [2025-10-09T17:55:28.269130] [INFO ] [MAIN ] CBT: Loaded 30800 existing records. [2025-10-09T17:55:28.446473] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:28.446792] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-09T17:55:28.446844] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-09T17:55:28.447116] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-09T17:55:28.447175] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-09T17:55:28.809732] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-09T17:55:28.815462] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:29.073322] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T17:55:29.074587] [INFO ] [REMOTE ] CBAN: Full fetch complete (16082 records). [2025-10-09T17:55:29.074686] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-09T17:55:29.432273] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-09T17:55:29.432357] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-09T17:55:29.432729] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-09T17:55:29.432790] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-09T17:55:29.433265] [DEBUG] [LOCAL ] CBAN: Trimmed 16082 records to 10711 (keeping 200 days of data) [2025-10-09T17:55:29.496737] [DEBUG] [LOCAL ] CBAN: Primary data saved (10711 records). [2025-10-09T17:55:29.496866] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-09T17:55:29.496945] [INFO ] [MAIN ] Update Progress: 403/2373 symbols completed. CBAN took 25.8s. Estimated remaining: 4h 30m 58s. Rate: 7.3 symbols/min [2025-10-09T17:55:29.601843] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-09T17:55:29.666903] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:29.688300] [DEBUG] [LOCAL ] CBU: Loaded 22520 existing records from primary storage. [2025-10-09T17:55:29.688537] [INFO ] [MAIN ] CBU: Loaded 22520 existing records. [2025-10-09T17:55:29.865678] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:29.865883] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-09T17:55:29.865931] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-09T17:55:29.866187] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-09T17:55:29.866246] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-09T17:55:30.294135] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:30.396797] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-09T17:55:30.670793] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T17:55:30.709132] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T17:55:31.196718] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-09T17:55:31.637632] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T17:55:31.996694] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-09T17:55:32.369301] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T17:55:32.796737] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-09T17:55:33.558636] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T17:55:33.596700] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-09T17:55:33.737105] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T17:55:34.391058] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T17:55:34.396665] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-09T17:55:35.196764] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-09T17:55:35.411997] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T17:55:35.996768] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-09T17:55:36.523328] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T17:55:36.796795] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-09T17:55:37.596735] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-09T17:55:37.630537] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T17:55:37.902715] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T17:55:38.396782] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-09T17:55:38.919058] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T17:55:39.196697] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-09T17:55:39.595554] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T17:55:39.996713] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-09T17:55:40.796708] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-09T17:55:41.066001] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T17:55:41.070305] [INFO ] [REMOTE ] CBRE: Full fetch complete (73756 records). [2025-10-09T17:55:41.070464] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-09T17:55:41.525790] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T17:55:41.529597] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-09T17:55:41.540548] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-09T17:55:41.541415] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-09T17:55:41.541671] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-09T17:55:41.543340] [DEBUG] [LOCAL ] CBRE: Trimmed 73756 records to 50764 (keeping 200 days of data) [2025-10-09T17:55:41.596957] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-09T17:55:41.852451] [DEBUG] [LOCAL ] CBRE: Primary data saved (50764 records). [2025-10-09T17:55:41.852579] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-09T17:55:41.852670] [INFO ] [MAIN ] Update Progress: 404/2373 symbols completed. CBRE took 35.4s. Estimated remaining: 4h 31m 10s. Rate: 7.3 symbols/min [2025-10-09T17:55:41.972915] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T17:55:42.046357] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:42.046558] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-09T17:55:42.046613] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-09T17:55:42.046776] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-09T17:55:42.046831] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-09T17:55:42.046877] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-09T17:55:42.046911] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-09T17:55:42.416186] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:42.412199] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-09T17:55:42.428940] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T17:55:43.196737] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-09T17:55:43.441921] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T17:55:43.996707] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-09T17:55:44.621827] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T17:55:44.796720] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-09T17:55:45.030736] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T17:55:45.596714] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-09T17:55:45.851757] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T17:55:46.261090] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-09T17:55:46.396693] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-09T17:55:46.585388] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:55:46.585743] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-09T17:55:46.585856] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:55:46.585924] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-09T17:55:46.585989] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:55:46.586062] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-09T17:55:46.586124] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-09T17:55:46.586161] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-09T17:55:46.586200] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-09T17:55:46.586247] [INFO ] [MAIN ] Update Progress: 405/2373 symbols completed. CBX took 4.7s. Estimated remaining: 4h 30m 45s. Rate: 7.3 symbols/min [2025-10-09T17:55:46.754162] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:46.785685] [DEBUG] [LOCAL ] CBZ: Loaded 34023 existing records from primary storage. [2025-10-09T17:55:46.785959] [INFO ] [MAIN ] CBZ: Loaded 34023 existing records. [2025-10-09T17:55:46.967475] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:46.967771] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-09T17:55:46.967827] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-09T17:55:46.968060] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-09T17:55:46.968120] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-09T17:55:47.201883] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-09T17:55:47.320680] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:47.996716] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-09T17:55:48.451811] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T17:55:48.796742] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-09T17:55:48.911954] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T17:55:49.596771] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-09T17:55:50.031783] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T17:55:50.252896] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T17:55:50.254748] [INFO ] [REMOTE ] CBL: Full fetch complete (25380 records). [2025-10-09T17:55:50.254835] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-09T17:55:50.401827] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-09T17:55:50.634556] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-09T17:55:50.634638] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-09T17:55:50.635137] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-09T17:55:50.635256] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-09T17:55:50.635956] [DEBUG] [LOCAL ] CBL: Trimmed 25380 records to 16385 (keeping 200 days of data) [2025-10-09T17:55:50.734342] [DEBUG] [LOCAL ] CBL: Primary data saved (16385 records). [2025-10-09T17:55:50.734479] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-09T17:55:50.734558] [INFO ] [MAIN ] Update Progress: 406/2373 symbols completed. CBL took 47.0s. Estimated remaining: 4h 30m 17s. Rate: 7.3 symbols/min [2025-10-09T17:55:50.901672] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:50.952151] [DEBUG] [LOCAL ] CC: Loaded 52993 existing records from primary storage. [2025-10-09T17:55:50.952461] [INFO ] [MAIN ] CC: Loaded 52993 existing records. [2025-10-09T17:55:51.133013] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:51.133222] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-09T17:55:51.133270] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-09T17:55:51.133540] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-09T17:55:51.133599] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-09T17:55:51.201825] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-09T17:55:51.507016] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:55:51.687864] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T17:55:51.996711] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-09T17:55:52.356571] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T17:55:52.796757] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-09T17:55:53.302918] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T17:55:53.596690] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-09T17:55:53.902712] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T17:55:54.396723] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-09T17:55:54.719101] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T17:55:55.196743] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-09T17:55:55.474388] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T17:55:55.996735] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-09T17:55:56.494904] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T17:55:56.796746] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-09T17:55:57.082342] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T17:55:57.596756] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-09T17:55:58.104016] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T17:55:58.396727] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-09T17:55:58.663409] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T17:55:58.665731] [INFO ] [REMOTE ] CBU: Full fetch complete (32296 records). [2025-10-09T17:55:58.665807] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-09T17:55:59.046998] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-09T17:55:59.047077] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-09T17:55:59.047579] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-09T17:55:59.047665] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-09T17:55:59.048509] [DEBUG] [LOCAL ] CBU: Trimmed 32296 records to 22667 (keeping 200 days of data) [2025-10-09T17:55:59.190022] [DEBUG] [LOCAL ] CBU: Primary data saved (22667 records). [2025-10-09T17:55:59.190152] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-09T17:55:59.190230] [INFO ] [MAIN ] Update Progress: 407/2373 symbols completed. CBU took 29.7s. Estimated remaining: 4h 30m 9s. Rate: 7.3 symbols/min [2025-10-09T17:55:59.203105] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-09T17:55:59.367095] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:55:59.420166] [DEBUG] [LOCAL ] CCI: Loaded 53132 existing records from primary storage. [2025-10-09T17:55:59.420485] [INFO ] [MAIN ] CCI: Loaded 53132 existing records. [2025-10-09T17:55:59.605814] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:55:59.606031] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-09T17:55:59.606082] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-09T17:55:59.606460] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-09T17:55:59.606518] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-09T17:55:59.725172] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T17:55:59.754448] [INFO ] [REMOTE ] CBT: Full fetch complete (45636 records). [2025-10-09T17:55:59.778664] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-09T17:55:59.998172] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-09T17:56:00.302466] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:00.420776] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-09T17:56:00.420859] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-09T17:56:00.421403] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-09T17:56:00.421443] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-09T17:56:00.422388] [DEBUG] [LOCAL ] CBT: Trimmed 45636 records to 31037 (keeping 200 days of data) [2025-10-09T17:56:00.617682] [DEBUG] [LOCAL ] CBT: Primary data saved (31037 records). [2025-10-09T17:56:00.617850] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-09T17:56:00.619053] [INFO ] [MAIN ] Update Progress: 408/2373 symbols completed. CBT took 32.5s. Estimated remaining: 4h 29m 28s. Rate: 7.3 symbols/min [2025-10-09T17:56:00.787094] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:00.787248] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-09T17:56:00.787290] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-09T17:56:00.787396] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-09T17:56:00.787437] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-09T17:56:00.787477] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-09T17:56:00.787510] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-09T17:56:00.818704] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-09T17:56:01.151291] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:01.398961] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-09T17:56:01.596697] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-09T17:56:01.622619] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T17:56:02.396721] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-09T17:56:02.973864] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-09T17:56:03.196691] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-09T17:56:03.267086] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T17:56:03.570146] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-09T17:56:03.631826] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T17:56:03.996711] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-09T17:56:04.796729] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-09T17:56:05.369952] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T17:56:05.596707] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-09T17:56:06.056363] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T17:56:06.396765] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-09T17:56:06.827115] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T17:56:06.888677] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T17:56:07.196749] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-09T17:56:07.996696] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-09T17:56:08.425865] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T17:56:08.796739] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-09T17:56:09.596769] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-09T17:56:09.802638] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T17:56:09.949639] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T17:56:10.338561] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T17:56:10.396720] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-09T17:56:11.196732] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-09T17:56:11.515448] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-09T17:56:11.990335] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:56:11.999913] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-09T17:56:12.463039] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-09T17:56:12.796774] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-09T17:56:13.096037] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-09T17:56:13.596716] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-09T17:56:14.396724] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-09T17:56:14.859492] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T17:56:14.923576] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T17:56:14.926561] [INFO ] [REMOTE ] CBZ: Full fetch complete (45474 records). [2025-10-09T17:56:14.926709] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-09T17:56:14.927398] [FATAL] [VALIDATOR ] CBZ: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T17:56:14.927503] [FATAL] [MAIN ] CBZ: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:56:14.927547] [WARN ] [MAIN ] CBZ: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:56:14.927611] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-09T17:56:14.927734] [DEBUG] [LOCAL ] CBZ: No primary data file found to delete. [2025-10-09T17:56:14.927793] [INFO ] [LOCAL ] CBZ: Starting deletion of derivative data. [2025-10-09T17:56:14.928102] [DEBUG] [LOCAL ] CBZ: Deleted derivative data file. [2025-10-09T17:56:14.928704] [INFO ] [MAIN ] Update Progress: 409/2373 symbols completed. CBZ took 28.3s. Estimated remaining: 4h 29m 49s. Rate: 7.3 symbols/min [2025-10-09T17:56:15.150360] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:15.171815] [DEBUG] [LOCAL ] CCIF: Loaded 15666 existing records from primary storage. [2025-10-09T17:56:15.172151] [INFO ] [MAIN ] CCIF: Loaded 15666 existing records. [2025-10-09T17:56:15.202199] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-09T17:56:15.433377] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:56:15.433794] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-09T17:56:15.433872] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-09T17:56:15.434258] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-09T17:56:15.434334] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-09T17:56:15.648213] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T17:56:16.002783] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-09T17:56:16.012853] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:16.796716] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-09T17:56:17.293794] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T17:56:17.596695] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-09T17:56:18.027234] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T17:56:18.396720] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-09T17:56:19.196703] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-09T17:56:19.279878] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T17:56:19.557940] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T17:56:19.592057] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T17:56:19.996725] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-09T17:56:20.497636] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T17:56:20.498478] [INFO ] [REMOTE ] CCIA: Full fetch complete (2150 records). [2025-10-09T17:56:20.498549] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-09T17:56:20.679414] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T17:56:20.679626] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T17:56:20.679735] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T17:56:20.679831] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-09T17:56:20.679912] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-09T17:56:20.679952] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-09T17:56:20.679993] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-09T17:56:20.680050] [INFO ] [MAIN ] Update Progress: 410/2373 symbols completed. CCIA took 20.1s. Estimated remaining: 4h 29m 29s. Rate: 7.3 symbols/min [2025-10-09T17:56:20.801904] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-09T17:56:20.858157] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:20.915297] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-10-09T17:56:20.915605] [INFO ] [MAIN ] CCJ: Loaded 53675 existing records. [2025-10-09T17:56:21.093240] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:56:21.093443] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-09T17:56:21.093539] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-09T17:56:21.093820] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-09T17:56:21.093880] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-09T17:56:21.452594] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:21.596722] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-09T17:56:21.782198] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T17:56:22.396732] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-09T17:56:23.206745] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-09T17:56:23.229443] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T17:56:23.996740] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-09T17:56:24.157189] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T17:56:24.489888] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T17:56:24.796715] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-09T17:56:25.547153] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T17:56:25.596719] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-09T17:56:26.396690] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-09T17:56:26.832672] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-09T17:56:27.196695] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-09T17:56:27.309499] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T17:56:27.528014] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T17:56:27.996717] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-09T17:56:28.648030] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T17:56:28.796776] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-09T17:56:29.597305] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-09T17:56:29.600413] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:56:30.396741] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-09T17:56:30.800110] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-09T17:56:30.922600] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T17:56:31.196773] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-09T17:56:31.996701] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-09T17:56:32.055564] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T17:56:32.796776] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-09T17:56:33.212248] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T17:56:33.596702] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-09T17:56:33.929399] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T17:56:34.396762] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-09T17:56:34.598285] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T17:56:35.184728] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T17:56:35.196718] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-09T17:56:35.470113] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T17:56:35.996760] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-09T17:56:36.796701] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-09T17:56:37.065151] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T17:56:37.413325] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T17:56:37.596715] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-09T17:56:37.817334] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T17:56:38.396772] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-09T17:56:39.196704] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-09T17:56:39.246531] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T17:56:39.251746] [INFO ] [REMOTE ] CC: Full fetch complete (75718 records). [2025-10-09T17:56:39.251888] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-09T17:56:39.688069] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-09T17:56:39.688154] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-09T17:56:39.689417] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-09T17:56:39.689530] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-09T17:56:39.691354] [DEBUG] [LOCAL ] CC: Trimmed 75718 records to 53381 (keeping 200 days of data) [2025-10-09T17:56:40.013407] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-09T17:56:40.063443] [DEBUG] [LOCAL ] CC: Primary data saved (53381 records). [2025-10-09T17:56:40.063563] [INFO ] [MAIN ] CC: Full history saved. [2025-10-09T17:56:40.063676] [INFO ] [MAIN ] Update Progress: 411/2373 symbols completed. CC took 49.3s. Estimated remaining: 4h 30m 14s. Rate: 7.3 symbols/min [2025-10-09T17:56:40.237023] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:40.281998] [DEBUG] [LOCAL ] CCK: Loaded 46300 existing records from primary storage. [2025-10-09T17:56:40.282429] [INFO ] [MAIN ] CCK: Loaded 46300 existing records. [2025-10-09T17:56:40.461335] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:56:40.461615] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-09T17:56:40.461739] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-09T17:56:40.462092] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-09T17:56:40.462164] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-09T17:56:40.594742] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-09T17:56:40.681783] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-09T17:56:40.796677] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-09T17:56:40.875210] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:41.028853] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T17:56:41.033811] [INFO ] [REMOTE ] CCI: Full fetch complete (76981 records). [2025-10-09T17:56:41.034006] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-09T17:56:41.432843] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-09T17:56:41.432936] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-09T17:56:41.433854] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-09T17:56:41.433924] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-09T17:56:41.435476] [DEBUG] [LOCAL ] CCI: Trimmed 76981 records to 53516 (keeping 200 days of data) [2025-10-09T17:56:41.619316] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-09T17:56:41.777443] [DEBUG] [LOCAL ] CCI: Primary data saved (53516 records). [2025-10-09T17:56:41.777584] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-09T17:56:41.778382] [INFO ] [MAIN ] Update Progress: 412/2373 symbols completed. CCI took 42.6s. Estimated remaining: 4h 29m 35s. Rate: 7.3 symbols/min [2025-10-09T17:56:41.946464] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:41.999089] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-09T17:56:41.999401] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-09T17:56:42.175409] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:56:42.175667] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-09T17:56:42.175730] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-09T17:56:42.175971] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-09T17:56:42.176031] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-09T17:56:42.413777] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-09T17:56:42.537166] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:43.196730] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-09T17:56:43.860036] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-09T17:56:43.895075] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T17:56:43.996666] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-09T17:56:44.796754] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-09T17:56:44.908454] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (4.11 seconds). [2025-10-09T17:56:45.506039] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T17:56:45.596679] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-09T17:56:45.717616] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-09T17:56:46.396735] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-09T17:56:46.869743] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T17:56:46.947590] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-09T17:56:47.196686] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-09T17:56:47.996731] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-09T17:56:48.733270] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-09T17:56:48.796695] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-09T17:56:48.827219] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T17:56:49.596742] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-09T17:56:49.848397] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T17:56:50.396811] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-09T17:56:50.572281] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T17:56:51.206775] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-09T17:56:51.212380] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T17:56:51.513166] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T17:56:51.996744] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-09T17:56:52.796721] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-09T17:56:52.980511] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T17:56:53.444132] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-09T17:56:53.596723] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-09T17:56:54.396712] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-09T17:56:54.641409] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T17:56:55.196762] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-09T17:56:55.996772] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-09T17:56:56.193870] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-09T17:56:56.327499] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T17:56:56.364940] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T17:56:56.796737] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-09T17:56:56.937994] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T17:56:56.939597] [INFO ] [REMOTE ] CCIF: Full fetch complete (21938 records). [2025-10-09T17:56:56.939696] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-09T17:56:57.303263] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-09T17:56:57.303340] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-09T17:56:57.303731] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-09T17:56:57.303792] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-09T17:56:57.304339] [DEBUG] [LOCAL ] CCIF: Trimmed 21938 records to 15738 (keeping 200 days of data) [2025-10-09T17:56:57.396236] [DEBUG] [LOCAL ] CCIF: Primary data saved (15738 records). [2025-10-09T17:56:57.396380] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-09T17:56:57.396469] [INFO ] [MAIN ] Update Progress: 413/2373 symbols completed. CCIF took 42.5s. Estimated remaining: 4h 30m 1s. Rate: 7.3 symbols/min [2025-10-09T17:56:57.570693] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:57.596758] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-09T17:56:57.613370] [DEBUG] [LOCAL ] CCO: Loaded 48014 existing records from primary storage. [2025-10-09T17:56:57.613700] [INFO ] [MAIN ] CCO: Loaded 48014 existing records. [2025-10-09T17:56:57.798532] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:56:57.798770] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-09T17:56:57.798854] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-09T17:56:57.799127] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-09T17:56:57.799194] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-09T17:56:58.167099] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:56:58.396726] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-09T17:56:58.901283] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-09T17:56:58.905812] [INFO ] [REMOTE ] CCJ: Full fetch complete (77683 records). [2025-10-09T17:56:58.905919] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-09T17:56:59.201990] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-09T17:56:59.327722] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-09T17:56:59.327840] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-09T17:56:59.328778] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-09T17:56:59.328886] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-09T17:56:59.353969] [DEBUG] [LOCAL ] CCJ: Trimmed 77683 records to 54065 (keeping 200 days of data) [2025-10-09T17:56:59.355795] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T17:56:59.681947] [DEBUG] [LOCAL ] CCJ: Primary data saved (54065 records). [2025-10-09T17:56:59.682082] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-09T17:56:59.682988] [INFO ] [MAIN ] Update Progress: 414/2373 symbols completed. CCJ took 39.0s. Estimated remaining: 4h 29m 25s. Rate: 7.3 symbols/min [2025-10-09T17:56:59.851475] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:56:59.863313] [DEBUG] [LOCAL ] CCRD: Loaded 9219 existing records from primary storage. [2025-10-09T17:56:59.863529] [INFO ] [MAIN ] CCRD: Loaded 9219 existing records. [2025-10-09T17:57:00.011457] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-09T17:57:00.052704] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:00.052930] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-09T17:57:00.052997] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-09T17:57:00.053246] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-09T17:57:00.053319] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-09T17:57:00.420681] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:00.793206] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-09T17:57:00.803869] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-09T17:57:00.942444] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T17:57:01.446290] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T17:57:01.596685] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-09T17:57:01.772018] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T17:57:02.234000] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T17:57:02.396722] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-09T17:57:03.196776] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-09T17:57:03.890797] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T17:57:03.996712] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-09T17:57:04.796748] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-09T17:57:04.973418] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T17:57:05.305677] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T17:57:05.596717] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-09T17:57:06.089412] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-09T17:57:06.396717] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-09T17:57:07.003830] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T17:57:07.007749] [INFO ] [REMOTE ] CCK: Full fetch complete (67589 records). [2025-10-09T17:57:07.007856] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-09T17:57:07.202302] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-09T17:57:07.403440] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-09T17:57:07.403527] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-09T17:57:07.404277] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-09T17:57:07.404341] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-09T17:57:07.405725] [DEBUG] [LOCAL ] CCK: Trimmed 67589 records to 46656 (keeping 200 days of data) [2025-10-09T17:57:07.535871] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T17:57:07.727170] [DEBUG] [LOCAL ] CCK: Primary data saved (46656 records). [2025-10-09T17:57:07.727320] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-09T17:57:07.727421] [INFO ] [MAIN ] Update Progress: 415/2373 symbols completed. CCK took 27.7s. Estimated remaining: 4h 29m 16s. Rate: 7.3 symbols/min [2025-10-09T17:57:07.895327] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:07.904300] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-09T17:57:07.929209] [DEBUG] [LOCAL ] CCS: Loaded 30228 existing records from primary storage. [2025-10-09T17:57:07.929489] [INFO ] [MAIN ] CCS: Loaded 30228 existing records. [2025-10-09T17:57:08.001874] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-09T17:57:08.115186] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:08.115414] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-09T17:57:08.115463] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-09T17:57:08.115749] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-09T17:57:08.115807] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-09T17:57:08.473257] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:08.796748] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-09T17:57:09.596784] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-09T17:57:09.924277] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T17:57:10.057541] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T17:57:10.212294] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T17:57:10.396739] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-09T17:57:11.196790] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-09T17:57:11.996702] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T17:57:11.996770] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-09T17:57:12.796832] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-09T17:57:12.804041] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-09T17:57:12.928800] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T17:57:13.596734] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-09T17:57:13.722957] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T17:57:14.396698] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-09T17:57:14.911635] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T17:57:15.196709] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-09T17:57:15.996721] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-09T17:57:16.503230] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T17:57:16.531173] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T17:57:16.771888] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-09T17:57:16.796691] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-09T17:57:17.596707] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-09T17:57:18.396685] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-09T17:57:18.489835] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T17:57:19.196717] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-09T17:57:19.355602] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T17:57:19.996677] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-09T17:57:20.000023] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-09T17:57:20.471246] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T17:57:20.796688] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-09T17:57:20.997996] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T17:57:21.596715] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-09T17:57:22.396731] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-09T17:57:22.955928] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T17:57:23.129797] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-09T17:57:23.134307] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-09T17:57:23.134425] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-09T17:57:23.201839] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-09T17:57:23.552284] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-09T17:57:23.552383] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-09T17:57:23.553607] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-09T17:57:23.553708] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-09T17:57:23.555709] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54190 (keeping 200 days of data) [2025-10-09T17:57:23.913490] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T17:57:24.009234] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-09T17:57:24.095274] [DEBUG] [LOCAL ] CCL: Primary data saved (54190 records). [2025-10-09T17:57:24.095482] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-09T17:57:24.096362] [INFO ] [MAIN ] Update Progress: 416/2373 symbols completed. CCL took 42.3s. Estimated remaining: 4h 29m 45s. Rate: 7.3 symbols/min [2025-10-09T17:57:24.329195] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:24.361834] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T17:57:24.392824] [DEBUG] [LOCAL ] CCU: Loaded 22832 existing records from primary storage. [2025-10-09T17:57:24.393251] [INFO ] [MAIN ] CCU: Loaded 22832 existing records. [2025-10-09T17:57:24.593490] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:24.593763] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-09T17:57:24.593820] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-09T17:57:24.594319] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-09T17:57:24.594378] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-09T17:57:24.801862] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-09T17:57:24.945945] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:25.596757] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-09T17:57:25.662693] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T17:57:25.714897] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T17:57:26.396793] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-09T17:57:26.719356] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T17:57:27.196752] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-09T17:57:27.736051] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T17:57:27.996748] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-09T17:57:28.229062] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T17:57:28.582131] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T17:57:28.796769] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-09T17:57:29.596806] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-09T17:57:30.083385] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T17:57:30.396727] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-09T17:57:30.891070] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T17:57:31.196733] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-09T17:57:31.422990] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T17:57:31.958251] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T17:57:31.959400] [INFO ] [REMOTE ] CCRD: Full fetch complete (11851 records). [2025-10-09T17:57:31.959471] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-09T17:57:32.001931] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-09T17:57:32.314358] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-09T17:57:32.314431] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-09T17:57:32.314682] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-09T17:57:32.314743] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-09T17:57:32.315176] [DEBUG] [LOCAL ] CCRD: Trimmed 11851 records to 9287 (keeping 200 days of data) [2025-10-09T17:57:32.368634] [DEBUG] [LOCAL ] CCRD: Primary data saved (9287 records). [2025-10-09T17:57:32.368778] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-09T17:57:32.368858] [INFO ] [MAIN ] Update Progress: 417/2373 symbols completed. CCRD took 32.7s. Estimated remaining: 4h 29m 37s. Rate: 7.3 symbols/min [2025-10-09T17:57:32.539618] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:32.539790] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-09T17:57:32.539889] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-09T17:57:32.539970] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-09T17:57:32.540008] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-09T17:57:32.540048] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-09T17:57:32.540080] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-09T17:57:32.806365] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-09T17:57:32.890397] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:32.995301] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T17:57:33.596754] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-09T17:57:34.229308] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T17:57:34.396752] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-09T17:57:34.793793] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-09T17:57:35.201783] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-09T17:57:35.214223] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T17:57:35.735301] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-09T17:57:35.996786] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-09T17:57:36.796809] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-09T17:57:37.596686] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-09T17:57:37.758149] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T17:57:37.764380] [INFO ] [REMOTE ] CCO: Full fetch complete (66838 records). [2025-10-09T17:57:37.764597] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-09T17:57:38.161412] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-09T17:57:38.161526] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-09T17:57:38.162426] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-09T17:57:38.162509] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-09T17:57:38.179600] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T17:57:38.185823] [DEBUG] [LOCAL ] CCO: Trimmed 66838 records to 48377 (keeping 200 days of data) [2025-10-09T17:57:38.396746] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-09T17:57:38.455045] [DEBUG] [LOCAL ] CCO: Primary data saved (48377 records). [2025-10-09T17:57:38.455163] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-09T17:57:38.455684] [INFO ] [MAIN ] Update Progress: 418/2373 symbols completed. CCO took 41.1s. Estimated remaining: 4h 29m 19s. Rate: 7.3 symbols/min [2025-10-09T17:57:38.639797] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T17:57:38.639455] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:38.643447] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-09T17:57:38.644828] [INFO ] [REMOTE ] CCS: Full fetch complete (44918 records). [2025-10-09T17:57:38.644906] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-09T17:57:39.015624] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-09T17:57:39.047179] [INFO ] [MAIN ] CDE: Loaded 53642 existing records. [2025-10-09T17:57:39.148246] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-09T17:57:39.159406] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-09T17:57:39.170579] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-09T17:57:39.178480] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-09T17:57:39.197250] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-09T17:57:39.231441] [DEBUG] [LOCAL ] CCS: Trimmed 44918 records to 30479 (keeping 200 days of data) [2025-10-09T17:57:39.323830] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:39.353708] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-09T17:57:39.357570] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-09T17:57:39.361954] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-09T17:57:39.362026] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-09T17:57:39.570179] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T17:57:39.745705] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:39.809281] [DEBUG] [LOCAL ] CCS: Primary data saved (30479 records). [2025-10-09T17:57:39.809419] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-09T17:57:39.809519] [INFO ] [MAIN ] Update Progress: 419/2373 symbols completed. CCS took 32.1s. Estimated remaining: 4h 28m 38s. Rate: 7.3 symbols/min [2025-10-09T17:57:39.983414] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:39.994302] [DEBUG] [LOCAL ] CDLR: Loaded 9863 existing records from primary storage. [2025-10-09T17:57:39.994496] [INFO ] [MAIN ] CDLR: Loaded 9863 existing records. [2025-10-09T17:57:40.005513] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-09T17:57:40.184229] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:40.184406] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-09T17:57:40.184453] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-09T17:57:40.184630] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-09T17:57:40.184721] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-09T17:57:40.553494] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:40.796746] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-09T17:57:41.262107] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T17:57:41.341173] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T17:57:41.596701] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-09T17:57:42.184629] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-09T17:57:42.396730] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-09T17:57:42.697232] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-09T17:57:43.196777] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-09T17:57:43.996788] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-09T17:57:44.796688] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-09T17:57:45.050528] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T17:57:45.169796] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-09T17:57:45.173697] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T17:57:45.596734] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-09T17:57:46.396688] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-09T17:57:46.710599] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T17:57:46.793495] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-09T17:57:47.196717] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-09T17:57:47.927382] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T17:57:47.996745] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-09T17:57:48.521462] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T17:57:48.796802] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-09T17:57:49.596732] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-09T17:57:49.823350] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:57:49.823696] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-09T17:57:49.823810] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:57:49.823906] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-09T17:57:49.823970] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:57:49.824043] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-09T17:57:49.824108] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-09T17:57:49.824151] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-09T17:57:49.824204] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-09T17:57:49.824291] [INFO ] [MAIN ] Update Progress: 420/2373 symbols completed. CCZ took 17.5s. Estimated remaining: 4h 28m 38s. Rate: 7.3 symbols/min [2025-10-09T17:57:50.003952] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:50.063977] [DEBUG] [LOCAL ] CDP: Loaded 42533 existing records from primary storage. [2025-10-09T17:57:50.064978] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T17:57:50.069991] [INFO ] [MAIN ] CDP: Loaded 42533 existing records. [2025-10-09T17:57:50.256901] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:50.257116] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-09T17:57:50.257163] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-09T17:57:50.257413] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-09T17:57:50.257469] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-09T17:57:50.401868] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-09T17:57:50.634351] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:51.011237] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T17:57:51.196787] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-09T17:57:51.996790] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-09T17:57:52.678924] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T17:57:52.779716] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T17:57:52.796678] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-09T17:57:53.596688] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-09T17:57:54.149855] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T17:57:54.396737] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-09T17:57:54.568563] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T17:57:55.196720] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-09T17:57:55.666705] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T17:57:55.992711] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T17:57:56.002623] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-09T17:57:56.735529] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T17:57:56.796704] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-09T17:57:57.558072] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T17:57:57.596679] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-09T17:57:58.396725] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-09T17:57:58.571086] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T17:57:58.572854] [INFO ] [REMOTE ] CDLR: Full fetch complete (13596 records). [2025-10-09T17:57:58.572928] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-09T17:57:59.002633] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-09T17:57:59.002748] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-09T17:57:59.003089] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-09T17:57:59.003132] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-09T17:57:59.003824] [DEBUG] [LOCAL ] CDLR: Trimmed 13596 records to 9990 (keeping 200 days of data) [2025-10-09T17:57:59.070951] [DEBUG] [LOCAL ] CDLR: Primary data saved (9990 records). [2025-10-09T17:57:59.071095] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-09T17:57:59.071182] [INFO ] [MAIN ] Update Progress: 421/2373 symbols completed. CDLR took 19.3s. Estimated remaining: 4h 28m 35s. Rate: 7.3 symbols/min [2025-10-09T17:57:59.201965] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-09T17:57:59.271150] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:57:59.295337] [DEBUG] [LOCAL ] CDRE: Loaded 24629 existing records from primary storage. [2025-10-09T17:57:59.295609] [INFO ] [MAIN ] CDRE: Loaded 24629 existing records. [2025-10-09T17:57:59.476689] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:57:59.476928] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-09T17:57:59.476983] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-09T17:57:59.477194] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-09T17:57:59.477251] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-09T17:57:59.835698] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:57:59.996738] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-09T17:58:00.295261] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-09T17:58:00.603324] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T17:58:00.605116] [INFO ] [REMOTE ] CCU: Full fetch complete (32381 records). [2025-10-09T17:58:00.605203] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-09T17:58:00.806883] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-09T17:58:00.994861] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-09T17:58:00.994953] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-09T17:58:00.995427] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-09T17:58:00.995469] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-09T17:58:00.996601] [DEBUG] [LOCAL ] CCU: Trimmed 32381 records to 22934 (keeping 200 days of data) [2025-10-09T17:58:01.137543] [DEBUG] [LOCAL ] CCU: Primary data saved (22934 records). [2025-10-09T17:58:01.137704] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-09T17:58:01.137798] [INFO ] [MAIN ] Update Progress: 422/2373 symbols completed. CCU took 37.0s. Estimated remaining: 4h 27m 58s. Rate: 7.3 symbols/min [2025-10-09T17:58:01.316253] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:01.333852] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T17:58:01.388766] [DEBUG] [LOCAL ] CE: Loaded 51448 existing records from primary storage. [2025-10-09T17:58:01.389081] [INFO ] [MAIN ] CE: Loaded 51448 existing records. [2025-10-09T17:58:01.576338] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:01.576558] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-09T17:58:01.576612] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-09T17:58:01.576883] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-09T17:58:01.576942] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-09T17:58:01.601940] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-09T17:58:01.941736] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:02.396782] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-09T17:58:02.441425] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T17:58:03.196714] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-09T17:58:03.689683] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-09T17:58:03.996691] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-09T17:58:04.257826] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T17:58:04.550517] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T17:58:04.796774] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-09T17:58:05.596746] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-09T17:58:05.922405] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T17:58:06.007172] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T17:58:06.396751] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-09T17:58:07.196684] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-09T17:58:07.324456] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T17:58:07.772926] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T17:58:07.996734] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-09T17:58:08.487677] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-09T17:58:08.796745] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-09T17:58:09.153041] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T17:58:09.596723] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-09T17:58:10.396705] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-09T17:58:10.593872] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T17:58:10.712175] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T17:58:11.196852] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-09T17:58:11.538324] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T17:58:11.996782] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-09T17:58:12.552780] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T17:58:12.796707] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-09T17:58:13.596718] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-09T17:58:13.677277] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T17:58:14.280292] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T17:58:14.396721] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-09T17:58:15.195567] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T17:58:15.205509] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-09T17:58:15.964197] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T17:58:15.996727] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-09T17:58:16.463574] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T17:58:16.796734] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-09T17:58:17.596774] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-09T17:58:17.962083] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T17:58:18.396774] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-09T17:58:18.627235] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T17:58:18.682016] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T17:58:19.196768] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-09T17:58:19.996777] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-09T17:58:20.507013] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-09T17:58:20.572807] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T17:58:20.796730] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-09T17:58:20.980102] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T17:58:21.596780] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-09T17:58:22.428430] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-09T17:58:22.450738] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T17:58:22.776292] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T17:58:23.196786] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-09T17:58:23.996745] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-09T17:58:24.478938] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-09T17:58:24.785062] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T17:58:24.796678] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-09T17:58:24.876968] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T17:58:24.879917] [INFO ] [REMOTE ] CDRE: Full fetch complete (35035 records). [2025-10-09T17:58:24.880107] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-09T17:58:25.305577] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-09T17:58:25.305705] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-09T17:58:25.306403] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-09T17:58:25.306458] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-09T17:58:25.307541] [DEBUG] [LOCAL ] CDRE: Trimmed 35035 records to 24827 (keeping 200 days of data) [2025-10-09T17:58:25.457207] [DEBUG] [LOCAL ] CDRE: Primary data saved (24827 records). [2025-10-09T17:58:25.457340] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-09T17:58:25.457418] [INFO ] [MAIN ] Update Progress: 423/2373 symbols completed. CDRE took 26.4s. Estimated remaining: 4h 29m 4s. Rate: 7.2 symbols/min [2025-10-09T17:58:25.607382] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-09T17:58:25.641295] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:25.650122] [DEBUG] [LOCAL ] CEE: Loaded 5614 existing records from primary storage. [2025-10-09T17:58:25.650372] [INFO ] [MAIN ] CEE: Loaded 5614 existing records. [2025-10-09T17:58:25.836847] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:25.837059] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-09T17:58:25.837107] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-09T17:58:25.837292] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-09T17:58:25.837349] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-09T17:58:26.194077] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:26.231885] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T17:58:26.396710] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-09T17:58:27.196699] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-09T17:58:27.224952] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T17:58:27.244108] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T17:58:27.996719] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-09T17:58:28.687163] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T17:58:28.796689] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-09T17:58:29.227975] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T17:58:29.596716] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-09T17:58:30.117611] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T17:58:30.396749] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-09T17:58:31.196727] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-09T17:58:31.912605] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T17:58:31.916332] [INFO ] [REMOTE ] CDP: Full fetch complete (61742 records). [2025-10-09T17:58:31.916428] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-09T17:58:32.006699] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-09T17:58:32.032844] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-09T17:58:32.054283] [INFO ] [REMOTE ] CDE: Full fetch complete (77596 records). [2025-10-09T17:58:32.100560] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-09T17:58:32.620889] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-09T17:58:32.627221] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-09T17:58:32.633895] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-09T17:58:32.639122] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-09T17:58:32.702849] [DEBUG] [LOCAL ] CDP: Trimmed 61742 records to 42803 (keeping 200 days of data) [2025-10-09T17:58:32.748392] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T17:58:32.770149] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-09T17:58:32.770486] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-09T17:58:32.772166] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-09T17:58:32.772313] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-09T17:58:32.773881] [DEBUG] [LOCAL ] CDE: Trimmed 77596 records to 54032 (keeping 200 days of data) [2025-10-09T17:58:32.878628] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-09T17:58:32.978544] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T17:58:32.987448] [INFO ] [REMOTE ] CE: Full fetch complete (74756 records). [2025-10-09T17:58:32.991318] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-09T17:58:33.529248] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-09T17:58:33.531463] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-09T17:58:33.532835] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-09T17:58:33.533507] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-09T17:58:33.540720] [DEBUG] [LOCAL ] CE: Trimmed 74756 records to 51809 (keeping 200 days of data) [2025-10-09T17:58:33.782072] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T17:58:33.791890] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-09T17:58:34.072892] [DEBUG] [LOCAL ] CDE: Primary data saved (54032 records). [2025-10-09T17:58:34.081884] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-09T17:58:34.086935] [INFO ] [MAIN ] Update Progress: 424/2373 symbols completed. CDE took 55.6s. Estimated remaining: 4h 28m 57s. Rate: 7.2 symbols/min [2025-10-09T17:58:34.085946] [DEBUG] [LOCAL ] CDP: Primary data saved (42803 records). [2025-10-09T17:58:34.091303] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-09T17:58:34.094822] [INFO ] [MAIN ] Update Progress: 425/2373 symbols completed. CDP took 44.3s. Estimated remaining: 4h 28m 11s. Rate: 7.3 symbols/min [2025-10-09T17:58:34.495832] [DEBUG] [LOCAL ] CE: Primary data saved (51809 records). [2025-10-09T17:58:34.537006] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:34.541182] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:34.541347] [INFO ] [MAIN ] CE: Full history saved. [2025-10-09T17:58:34.542589] [INFO ] [MAIN ] Update Progress: 426/2373 symbols completed. CE took 33.4s. Estimated remaining: 4h 27m 27s. Rate: 7.3 symbols/min [2025-10-09T17:58:34.729885] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:34.756184] [DEBUG] [LOCAL ] CEPU: Loaded 25995 existing records from primary storage. [2025-10-09T17:58:34.757147] [INFO ] [MAIN ] CEPU: Loaded 25995 existing records. [2025-10-09T17:58:34.873454] [DEBUG] [LOCAL ] CF: Loaded 52155 existing records from primary storage. [2025-10-09T17:58:34.903480] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T17:58:34.901975] [INFO ] [MAIN ] CF: Loaded 52155 existing records. [2025-10-09T17:58:35.003471] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-09T17:58:35.104118] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:35.131575] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-09T17:58:35.131755] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-09T17:58:35.132131] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-09T17:58:35.179665] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-09T17:58:35.269333] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:35.296340] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-09T17:58:35.318144] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-09T17:58:35.325206] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-09T17:58:35.332309] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-09T17:58:35.361225] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-09T17:58:35.349925] [INFO ] [MAIN ] CFG: Loaded 53623 existing records. [2025-10-09T17:58:36.035476] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T17:58:36.088186] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-09T17:58:36.097781] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:36.150960] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:36.146622] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-09T17:58:36.164076] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-09T17:58:36.180258] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-09T17:58:36.181376] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-09T17:58:36.186816] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-09T17:58:36.393585] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:36.651229] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:36.796722] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-09T17:58:36.836259] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T17:58:37.428722] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T17:58:37.596736] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-09T17:58:38.257438] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-09T17:58:38.396735] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-09T17:58:38.614879] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T17:58:39.196784] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-09T17:58:39.712271] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T17:58:39.996768] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-09T17:58:40.796729] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-09T17:58:41.012346] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T17:58:41.596759] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-09T17:58:41.681495] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T17:58:42.264810] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T17:58:42.313960] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T17:58:42.396754] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-09T17:58:43.196757] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-09T17:58:43.985458] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T17:58:43.996669] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-09T17:58:44.408967] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T17:58:44.796702] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-09T17:58:45.512770] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T17:58:45.596705] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-09T17:58:46.396742] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-09T17:58:46.511743] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T17:58:47.075912] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T17:58:47.196723] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-09T17:58:47.468951] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T17:58:47.996725] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-09T17:58:48.796691] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-09T17:58:48.811401] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T17:58:49.020519] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T17:58:49.596719] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-09T17:58:50.182421] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T17:58:50.396697] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-09T17:58:50.486159] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T17:58:50.952555] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T17:58:50.953505] [INFO ] [REMOTE ] CEE: Full fetch complete (10166 records). [2025-10-09T17:58:50.953575] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-09T17:58:51.201908] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-09T17:58:51.318086] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-09T17:58:51.318168] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-09T17:58:51.318432] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-09T17:58:51.318469] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-09T17:58:51.318985] [DEBUG] [LOCAL ] CEE: Trimmed 10166 records to 5657 (keeping 200 days of data) [2025-10-09T17:58:51.352260] [DEBUG] [LOCAL ] CEE: Primary data saved (5657 records). [2025-10-09T17:58:51.352378] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-09T17:58:51.352462] [INFO ] [MAIN ] Update Progress: 427/2373 symbols completed. CEE took 25.9s. Estimated remaining: 4h 27m 58s. Rate: 7.3 symbols/min [2025-10-09T17:58:51.518002] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:51.518168] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-09T17:58:51.518204] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-09T17:58:51.518337] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-09T17:58:51.518377] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-09T17:58:51.518418] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-09T17:58:51.518489] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-09T17:58:51.865944] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:51.996699] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-09T17:58:52.191616] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T17:58:52.191962] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-09T17:58:52.192059] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T17:58:52.192110] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-09T17:58:52.192170] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T17:58:52.192244] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-09T17:58:52.192323] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-09T17:58:52.192366] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-09T17:58:52.192431] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-09T17:58:52.192500] [INFO ] [MAIN ] Update Progress: 428/2373 symbols completed. CFND took 0.8s. Estimated remaining: 4h 27m 16s. Rate: 7.3 symbols/min [2025-10-09T17:58:52.360180] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:58:52.395834] [DEBUG] [LOCAL ] CFR: Loaded 32900 existing records from primary storage. [2025-10-09T17:58:52.396122] [INFO ] [MAIN ] CFR: Loaded 32900 existing records. [2025-10-09T17:58:52.576727] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:58:52.576959] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-09T17:58:52.577006] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-09T17:58:52.577345] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-09T17:58:52.577418] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-09T17:58:52.809301] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-09T17:58:52.940957] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:58:52.971607] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T17:58:53.596722] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-09T17:58:54.224447] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T17:58:54.396725] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-09T17:58:55.041830] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T17:58:55.196714] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-09T17:58:55.534994] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T17:58:55.996714] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-09T17:58:56.796692] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-09T17:58:57.060828] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T17:58:57.174970] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T17:58:57.596729] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-09T17:58:58.396806] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-09T17:58:58.672888] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T17:58:58.881626] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T17:58:59.196715] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-09T17:58:59.996748] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-09T17:59:00.047459] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T17:59:00.796750] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-09T17:59:01.048479] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T17:59:01.341307] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T17:59:01.596729] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-09T17:59:01.942773] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T17:59:02.396764] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-09T17:59:03.053149] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T17:59:03.196682] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-09T17:59:03.608779] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T17:59:03.996814] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-09T17:59:04.635837] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T17:59:04.796733] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-09T17:59:05.596859] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-09T17:59:05.766807] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T17:59:06.200252] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T17:59:06.396733] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-09T17:59:06.954151] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T17:59:06.956938] [INFO ] [REMOTE ] CEPU: Full fetch complete (39379 records). [2025-10-09T17:59:06.957027] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-09T17:59:07.206611] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-09T17:59:07.350379] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-09T17:59:07.350460] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-09T17:59:07.351032] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-09T17:59:07.351096] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-09T17:59:07.352063] [DEBUG] [LOCAL ] CEPU: Trimmed 39379 records to 26302 (keeping 200 days of data) [2025-10-09T17:59:07.515217] [DEBUG] [LOCAL ] CEPU: Primary data saved (26302 records). [2025-10-09T17:59:07.515368] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-09T17:59:07.515452] [INFO ] [MAIN ] Update Progress: 429/2373 symbols completed. CEPU took 33.4s. Estimated remaining: 4h 27m 39s. Rate: 7.3 symbols/min [2025-10-09T17:59:07.683410] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:07.721318] [DEBUG] [LOCAL ] CGAU: Loaded 43077 existing records from primary storage. [2025-10-09T17:59:07.721622] [INFO ] [MAIN ] CGAU: Loaded 43077 existing records. [2025-10-09T17:59:07.925675] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:59:07.925914] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-09T17:59:07.925967] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-09T17:59:07.926205] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-09T17:59:07.926282] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-09T17:59:08.002186] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-09T17:59:08.281844] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-09T17:59:08.296774] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-10-09T17:59:08.316770] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-09T17:59:08.316638] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:08.759022] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-09T17:59:08.759150] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-09T17:59:08.760637] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-09T17:59:08.760759] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-09T17:59:08.762898] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54013 (keeping 200 days of data) [2025-10-09T17:59:08.850887] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-09T17:59:09.304301] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T17:59:09.334393] [DEBUG] [LOCAL ] CFG: Primary data saved (54013 records). [2025-10-09T17:59:09.334730] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-09T17:59:09.335513] [INFO ] [MAIN ] Update Progress: 430/2373 symbols completed. CFG took 34.8s. Estimated remaining: 4h 27m 2s. Rate: 7.3 symbols/min [2025-10-09T17:59:09.526198] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-09T17:59:09.601896] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-09T17:59:09.630774] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:09.635563] [DEBUG] [LOCAL ] CGV: Loaded 1395 existing records from primary storage. [2025-10-09T17:59:09.635810] [INFO ] [MAIN ] CGV: Loaded 1395 existing records. [2025-10-09T17:59:09.867319] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:59:09.867541] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-09T17:59:09.867590] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-09T17:59:09.867834] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-09T17:59:09.867927] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-09T17:59:10.332521] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:10.396713] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-09T17:59:10.537337] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T17:59:10.972738] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-09T17:59:11.196698] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-09T17:59:11.318078] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T17:59:11.698338] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-09T17:59:11.996756] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-09T17:59:12.796715] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-09T17:59:13.337635] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-09T17:59:13.596726] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-09T17:59:14.198525] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T17:59:14.396724] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-09T17:59:15.028482] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T17:59:15.196722] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-09T17:59:15.996767] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-09T17:59:16.272172] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T17:59:16.430456] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T17:59:16.605532] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:59:16.796735] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-09T17:59:17.596711] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-09T17:59:18.027289] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T17:59:18.396721] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-09T17:59:18.506318] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T17:59:19.196735] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-09T17:59:19.996697] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-09T17:59:20.492287] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-09T17:59:20.615983] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T17:59:20.620172] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T17:59:20.796782] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-09T17:59:21.596715] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-09T17:59:21.971401] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T17:59:21.974108] [INFO ] [REMOTE ] CFR: Full fetch complete (48238 records). [2025-10-09T17:59:21.974223] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-09T17:59:22.087745] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T17:59:22.370994] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-09T17:59:22.371098] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-09T17:59:22.371735] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-09T17:59:22.371799] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-09T17:59:22.372918] [DEBUG] [LOCAL ] CFR: Trimmed 48238 records to 33080 (keeping 200 days of data) [2025-10-09T17:59:22.430256] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-09T17:59:22.586080] [DEBUG] [LOCAL ] CFR: Primary data saved (33080 records). [2025-10-09T17:59:22.586231] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-09T17:59:22.586316] [INFO ] [MAIN ] Update Progress: 431/2373 symbols completed. CFR took 30.4s. Estimated remaining: 4h 27m 16s. Rate: 7.3 symbols/min [2025-10-09T17:59:22.752029] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:22.752230] [DEBUG] [LOCAL ] CHCT: No existing data file found in primary storage. [2025-10-09T17:59:22.752270] [WARN ] [MAIN ] CHCT: No existing data found, performing full refresh instead. [2025-10-09T17:59:22.752385] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-09T17:59:22.752427] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-09T17:59:22.752469] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-09T17:59:22.752501] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-09T17:59:23.104507] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:23.196750] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-09T17:59:23.996764] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-09T17:59:24.168055] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T17:59:24.415459] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T17:59:24.489621] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T17:59:24.796762] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-09T17:59:25.596723] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-09T17:59:26.284041] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T17:59:26.355482] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T17:59:26.396677] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-09T17:59:27.196751] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-09T17:59:27.428357] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T17:59:27.996749] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-09T17:59:28.614132] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T17:59:28.796738] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-09T17:59:29.106692] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T17:59:29.596736] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-09T17:59:30.396719] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-09T17:59:30.633846] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T17:59:30.662558] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T17:59:31.196791] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-09T17:59:31.749913] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T17:59:32.001812] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-09T17:59:32.010292] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T17:59:32.796772] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-09T17:59:33.596766] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-09T17:59:33.684746] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T17:59:33.689247] [INFO ] [REMOTE ] CF: Full fetch complete (75267 records). [2025-10-09T17:59:33.689419] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-09T17:59:34.019758] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T17:59:34.103124] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-09T17:59:34.103211] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-09T17:59:34.104029] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-09T17:59:34.104093] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-09T17:59:34.107154] [DEBUG] [LOCAL ] CF: Trimmed 75267 records to 52500 (keeping 200 days of data) [2025-10-09T17:59:34.405113] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-09T17:59:34.426528] [DEBUG] [LOCAL ] CF: Primary data saved (52500 records). [2025-10-09T17:59:34.426745] [INFO ] [MAIN ] CF: Full history saved. [2025-10-09T17:59:34.426839] [INFO ] [MAIN ] Update Progress: 432/2373 symbols completed. CF took 1m 0s. Estimated remaining: 4h 27m 24s. Rate: 7.3 symbols/min [2025-10-09T17:59:34.598469] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:34.649694] [DEBUG] [LOCAL ] CHD: Loaded 52208 existing records from primary storage. [2025-10-09T17:59:34.650021] [INFO ] [MAIN ] CHD: Loaded 52208 existing records. [2025-10-09T17:59:34.835819] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:59:34.836030] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-09T17:59:34.836079] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-09T17:59:34.836316] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-09T17:59:34.836373] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-09T17:59:35.114113] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T17:59:35.205606] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-09T17:59:35.214473] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:35.320080] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T17:59:35.996773] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-09T17:59:36.422310] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-09T17:59:36.520677] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T17:59:36.796742] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-09T17:59:37.596727] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-09T17:59:37.951982] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T17:59:38.209749] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T17:59:38.396763] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-09T17:59:39.196733] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-09T17:59:39.996679] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-09T17:59:40.034509] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T17:59:40.328892] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T17:59:40.394437] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T17:59:40.395156] [INFO ] [REMOTE ] CGV: Full fetch complete (2269 records). [2025-10-09T17:59:40.395224] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-09T17:59:40.740673] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-09T17:59:40.740762] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-09T17:59:40.740868] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-09T17:59:40.740906] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-09T17:59:40.741271] [DEBUG] [LOCAL ] CGV: Trimmed 2269 records to 1399 (keeping 200 days of data) [2025-10-09T17:59:40.750326] [DEBUG] [LOCAL ] CGV: Primary data saved (1399 records). [2025-10-09T17:59:40.750388] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-09T17:59:40.750457] [INFO ] [MAIN ] Update Progress: 433/2373 symbols completed. CGV took 31.4s. Estimated remaining: 4h 27m 7s. Rate: 7.3 symbols/min [2025-10-09T17:59:40.801893] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-09T17:59:40.928355] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:40.948399] [DEBUG] [LOCAL ] CHE: Loaded 15279 existing records from primary storage. [2025-10-09T17:59:40.948692] [INFO ] [MAIN ] CHE: Loaded 15279 existing records. [2025-10-09T17:59:41.123938] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:59:41.124177] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-09T17:59:41.124233] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-09T17:59:41.124479] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-09T17:59:41.124536] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-09T17:59:41.477333] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:41.596699] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-09T17:59:41.725579] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T17:59:42.396703] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-09T17:59:43.008855] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T17:59:43.196766] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-09T17:59:43.286392] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T17:59:43.996760] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-09T17:59:44.796690] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-09T17:59:44.915274] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T17:59:45.596694] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-09T17:59:45.786080] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T17:59:46.052853] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T17:59:46.055263] [INFO ] [REMOTE ] CHCT: Full fetch complete (34793 records). [2025-10-09T17:59:46.055337] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-09T17:59:46.406792] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-09T17:59:46.448377] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-09T17:59:46.448467] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-09T17:59:46.449180] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-09T17:59:46.449248] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-09T17:59:46.450251] [DEBUG] [LOCAL ] CHCT: Trimmed 34793 records to 24068 (keeping 200 days of data) [2025-10-09T17:59:46.600083] [DEBUG] [LOCAL ] CHCT: Primary data saved (24068 records). [2025-10-09T17:59:46.600233] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-09T17:59:46.600335] [INFO ] [MAIN ] Update Progress: 434/2373 symbols completed. CHCT took 24.0s. Estimated remaining: 4h 26m 48s. Rate: 7.3 symbols/min [2025-10-09T17:59:46.782186] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:46.782436] [DEBUG] [LOCAL ] CHGG: No existing data file found in primary storage. [2025-10-09T17:59:46.782529] [WARN ] [MAIN ] CHGG: No existing data found, performing full refresh instead. [2025-10-09T17:59:46.782680] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-09T17:59:46.782736] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-09T17:59:46.782782] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-09T17:59:46.782816] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-09T17:59:47.163662] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:47.195017] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T17:59:47.205436] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-09T17:59:47.797425] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T17:59:47.801799] [INFO ] [REMOTE ] CGAU: Full fetch complete (61027 records). [2025-10-09T17:59:47.801912] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-09T17:59:48.006346] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-09T17:59:48.217785] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-09T17:59:48.217913] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-09T17:59:48.219256] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-09T17:59:48.219677] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-09T17:59:48.219571] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T17:59:48.224828] [DEBUG] [LOCAL ] CGAU: Trimmed 61027 records to 43452 (keeping 200 days of data) [2025-10-09T17:59:48.477075] [DEBUG] [LOCAL ] CGAU: Primary data saved (43452 records). [2025-10-09T17:59:48.477214] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-09T17:59:48.477736] [INFO ] [MAIN ] Update Progress: 435/2373 symbols completed. CGAU took 41.0s. Estimated remaining: 4h 26m 11s. Rate: 7.3 symbols/min [2025-10-09T17:59:48.645223] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T17:59:48.686161] [DEBUG] [LOCAL ] CHH: Loaded 32293 existing records from primary storage. [2025-10-09T17:59:48.686457] [INFO ] [MAIN ] CHH: Loaded 32293 existing records. [2025-10-09T17:59:48.801856] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-09T17:59:48.866036] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T17:59:48.866450] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-09T17:59:48.866517] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-09T17:59:48.866774] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-09T17:59:48.866833] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-09T17:59:49.225597] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T17:59:49.596733] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-09T17:59:49.983451] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T17:59:50.396688] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-09T17:59:50.730297] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T17:59:51.033490] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T17:59:51.196733] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-09T17:59:51.853353] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T17:59:51.996672] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-09T17:59:52.325075] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T17:59:52.796702] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-09T17:59:53.485326] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T17:59:53.596696] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-09T17:59:54.120840] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T17:59:54.396697] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-09T17:59:54.541196] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T17:59:55.196756] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-09T17:59:55.996686] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-09T17:59:56.080495] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T17:59:56.640618] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T17:59:56.796705] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-09T17:59:57.596756] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-09T17:59:57.771282] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T17:59:57.848972] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T17:59:58.396692] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-09T17:59:58.420573] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T17:59:59.196776] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-09T17:59:59.996772] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-09T18:00:00.434804] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-09T18:00:00.796775] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-09T18:00:01.138759] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-09T18:00:01.216921] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T18:00:01.596864] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-09T18:00:01.971566] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T18:00:02.396745] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-09T18:00:03.196688] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-09T18:00:03.410801] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T18:00:03.853521] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-09T18:00:03.858256] [INFO ] [REMOTE ] CHD: Full fetch complete (74456 records). [2025-10-09T18:00:03.858436] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-09T18:00:04.001811] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-09T18:00:04.273174] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-09T18:00:04.273318] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-09T18:00:04.274274] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-09T18:00:04.274388] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-09T18:00:04.276436] [DEBUG] [LOCAL ] CHD: Trimmed 74456 records to 52580 (keeping 200 days of data) [2025-10-09T18:00:04.359289] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T18:00:04.638961] [DEBUG] [LOCAL ] CHD: Primary data saved (52580 records). [2025-10-09T18:00:04.639108] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-09T18:00:04.640786] [INFO ] [MAIN ] Update Progress: 436/2373 symbols completed. CHD took 30.2s. Estimated remaining: 4h 26m 38s. Rate: 7.3 symbols/min [2025-10-09T18:00:04.802731] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-09T18:00:04.821199] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:04.844994] [DEBUG] [LOCAL ] CHMI: Loaded 21661 existing records from primary storage. [2025-10-09T18:00:04.845240] [INFO ] [MAIN ] CHMI: Loaded 21661 existing records. [2025-10-09T18:00:05.021488] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:00:05.021715] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-09T18:00:05.021770] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-09T18:00:05.022058] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-09T18:00:05.022125] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-09T18:00:05.379971] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:05.596736] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-09T18:00:06.015606] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T18:00:06.165421] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:00:06.396713] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-09T18:00:06.530094] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T18:00:07.196717] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-09T18:00:07.531253] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T18:00:07.996719] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-09T18:00:08.230508] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T18:00:08.711600] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-09T18:00:08.796713] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-09T18:00:09.596703] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-09T18:00:10.078047] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T18:00:10.396714] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-09T18:00:10.488466] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T18:00:11.196673] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-09T18:00:11.596078] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T18:00:11.996763] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-09T18:00:12.247046] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-09T18:00:12.796728] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-09T18:00:13.596752] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-09T18:00:13.661527] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T18:00:13.979002] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T18:00:14.396771] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-09T18:00:14.821272] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T18:00:15.197501] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-09T18:00:15.199208] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-09T18:00:15.201333] [INFO ] [REMOTE ] CHE: Full fetch complete (20066 records). [2025-10-09T18:00:15.201425] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-09T18:00:15.201982] [FATAL] [VALIDATOR ] CHE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:00:15.202108] [FATAL] [MAIN ] CHE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:00:15.202192] [WARN ] [MAIN ] CHE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:00:15.202285] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-09T18:00:15.202389] [DEBUG] [LOCAL ] CHE: No primary data file found to delete. [2025-10-09T18:00:15.202453] [INFO ] [LOCAL ] CHE: Starting deletion of derivative data. [2025-10-09T18:00:15.202809] [DEBUG] [LOCAL ] CHE: Deleted derivative data file. [2025-10-09T18:00:15.202932] [INFO ] [MAIN ] Update Progress: 437/2373 symbols completed. CHE took 34.5s. Estimated remaining: 4h 26m 40s. Rate: 7.3 symbols/min [2025-10-09T18:00:15.996711] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-09T18:00:16.576726] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:00:16.796761] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-09T18:00:17.584811] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:00:17.596690] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-09T18:00:18.022942] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T18:00:18.396724] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-09T18:00:19.196741] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-09T18:00:19.806572] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T18:00:19.809843] [INFO ] [REMOTE ] CHH: Full fetch complete (47142 records). [2025-10-09T18:00:19.809938] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-09T18:00:20.137305] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-09T18:00:20.224906] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-09T18:00:20.242587] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-09T18:00:20.242677] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-09T18:00:20.243284] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-09T18:00:20.243326] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-09T18:00:20.244341] [DEBUG] [LOCAL ] CHH: Trimmed 47142 records to 32538 (keeping 200 days of data) [2025-10-09T18:00:20.363891] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T18:00:20.476253] [DEBUG] [LOCAL ] CHH: Primary data saved (32538 records). [2025-10-09T18:00:20.476401] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-09T18:00:20.477177] [INFO ] [MAIN ] Update Progress: 438/2373 symbols completed. CHH took 32.0s. Estimated remaining: 4h 26m 19s. Rate: 7.3 symbols/min [2025-10-09T18:00:20.796766] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-09T18:00:21.967478] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T18:00:21.972345] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-09T18:00:22.229984] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-09T18:00:22.396759] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-09T18:00:23.076739] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T18:00:23.196759] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-09T18:00:23.941188] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:00:23.996669] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-09T18:00:24.396372] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T18:00:24.796684] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-09T18:00:24.929516] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T18:00:24.931394] [INFO ] [REMOTE ] CHMI: Full fetch complete (31671 records). [2025-10-09T18:00:24.931467] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-09T18:00:24.932037] [FATAL] [VALIDATOR ] CHMI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:00:24.932125] [FATAL] [MAIN ] CHMI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:00:24.932180] [WARN ] [MAIN ] CHMI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:00:24.932265] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-09T18:00:24.932340] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-09T18:00:24.932390] [INFO ] [LOCAL ] CHMI: Starting deletion of derivative data. [2025-10-09T18:00:24.932606] [DEBUG] [LOCAL ] CHMI: Deleted derivative data file. [2025-10-09T18:00:24.932749] [INFO ] [MAIN ] Update Progress: 439/2373 symbols completed. CHMI took 20.3s. Estimated remaining: 4h 25m 54s. Rate: 7.3 symbols/min [2025-10-09T18:00:26.507389] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T18:00:26.517840] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-09T18:00:28.266031] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:00:28.270505] [INFO ] [REMOTE ] CHGG: Full fetch complete (70386 records). [2025-10-09T18:00:28.270706] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-09T18:00:28.652420] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-09T18:00:28.652502] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-09T18:00:28.653310] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-09T18:00:28.653376] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-09T18:00:28.654742] [DEBUG] [LOCAL ] CHGG: Trimmed 70386 records to 48154 (keeping 200 days of data) [2025-10-09T18:00:28.930292] [DEBUG] [LOCAL ] CHGG: Primary data saved (48154 records). [2025-10-09T18:00:28.930431] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-09T18:00:28.930516] [INFO ] [MAIN ] Update Progress: 440/2373 symbols completed. CHGG took 42.3s. Estimated remaining: 4h 25m 27s. Rate: 7.3 symbols/min [2025-10-09T18:00:29.591224] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:29.629812] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:29.645251] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-09T18:00:29.645403] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-09T18:00:29.684992] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-09T18:00:29.685234] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-09T18:00:29.682103] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:29.685667] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-09T18:00:29.685739] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-09T18:00:29.687467] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-09T18:00:29.686825] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:29.687393] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-09T18:00:29.687783] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-09T18:00:29.688025] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-09T18:00:29.711908] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-09T18:00:29.721692] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-09T18:00:29.765079] [DEBUG] [LOCAL ] CHN: Loaded 4753 existing records from primary storage. [2025-10-09T18:00:29.819153] [INFO ] [MAIN ] CHN: Loaded 4753 existing records. [2025-10-09T18:00:30.345907] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-09T18:00:30.339380] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:00:30.397578] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-10-09T18:00:30.422098] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-09T18:00:30.467756] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-09T18:00:30.554680] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-09T18:00:30.559950] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-09T18:00:30.882473] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:30.946268] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:30.960457] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-09T18:00:31.019669] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-09T18:00:31.053930] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:00:31.054187] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-09T18:00:31.077691] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-09T18:00:31.082254] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-09T18:00:31.082487] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-09T18:00:31.476898] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:31.503192] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-09T18:00:31.695117] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:31.695411] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-09T18:00:32.226884] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T18:00:32.228778] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-09T18:00:32.324114] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T18:00:32.328035] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-09T18:00:32.883545] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T18:00:32.885543] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-09T18:00:33.224004] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T18:00:33.227789] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-09T18:00:33.487328] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T18:00:33.489533] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-09T18:00:33.537582] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-09T18:00:33.596688] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-09T18:00:33.680348] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-09T18:00:33.989634] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T18:00:34.106822] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-09T18:00:34.396743] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-09T18:00:35.016908] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T18:00:35.196763] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-09T18:00:35.740273] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-09T18:00:35.948518] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T18:00:35.996683] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-09T18:00:36.580985] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T18:00:36.796683] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-09T18:00:37.596726] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-09T18:00:38.396735] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-09T18:00:38.828475] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-09T18:00:39.196745] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-09T18:00:39.240549] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T18:00:39.708318] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-09T18:00:39.996734] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-09T18:00:40.501768] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-09T18:00:40.796736] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-09T18:00:40.961968] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T18:00:41.341322] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T18:00:41.596747] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-09T18:00:42.396756] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-09T18:00:42.770890] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T18:00:43.196715] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-09T18:00:43.996706] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-09T18:00:44.012061] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T18:00:44.397832] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T18:00:44.796689] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-09T18:00:45.187358] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:00:45.386717] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:00:45.387556] [INFO ] [REMOTE ] CHN: Full fetch complete (7404 records). [2025-10-09T18:00:45.387623] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-09T18:00:45.602889] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-09T18:00:45.743961] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-09T18:00:45.744029] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-09T18:00:45.744220] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-09T18:00:45.744257] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-09T18:00:45.744629] [DEBUG] [LOCAL ] CHN: Trimmed 7404 records to 4772 (keeping 200 days of data) [2025-10-09T18:00:45.776293] [DEBUG] [LOCAL ] CHN: Primary data saved (4772 records). [2025-10-09T18:00:45.776405] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-09T18:00:45.776513] [INFO ] [MAIN ] Update Progress: 441/2373 symbols completed. CHN took 16.8s. Estimated remaining: 4h 25m 56s. Rate: 7.3 symbols/min [2025-10-09T18:00:45.943253] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:45.992835] [DEBUG] [LOCAL ] CI: Loaded 49812 existing records from primary storage. [2025-10-09T18:00:45.993143] [INFO ] [MAIN ] CI: Loaded 49812 existing records. [2025-10-09T18:00:46.167113] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:00:46.167334] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-09T18:00:46.167382] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-09T18:00:46.167821] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-09T18:00:46.167907] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-09T18:00:46.404136] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-09T18:00:46.520497] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:47.196726] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-09T18:00:47.788053] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-09T18:00:47.815992] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T18:00:47.996708] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-09T18:00:48.308582] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T18:00:48.796760] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-09T18:00:49.596748] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-09T18:00:49.787721] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T18:00:50.396738] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-09T18:00:50.451531] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T18:00:50.700722] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T18:00:51.196714] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-09T18:00:51.996686] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-09T18:00:52.196304] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T18:00:52.303520] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T18:00:52.796712] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-09T18:00:53.442861] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:00:53.596724] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-09T18:00:54.402816] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-09T18:00:54.422041] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:00:54.658259] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T18:00:55.196764] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-09T18:00:56.010842] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-09T18:00:56.013744] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T18:00:56.080103] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T18:00:56.082123] [INFO ] [REMOTE ] CHT: Full fetch complete (27547 records). [2025-10-09T18:00:56.082200] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-09T18:00:56.442763] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-09T18:00:56.442846] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-09T18:00:56.443297] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-09T18:00:56.443337] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-09T18:00:56.444051] [DEBUG] [LOCAL ] CHT: Trimmed 27547 records to 19652 (keeping 200 days of data) [2025-10-09T18:00:56.563442] [DEBUG] [LOCAL ] CHT: Primary data saved (19652 records). [2025-10-09T18:00:56.563598] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-09T18:00:56.563698] [INFO ] [MAIN ] Update Progress: 442/2373 symbols completed. CHT took 27.6s. Estimated remaining: 4h 25m 59s. Rate: 7.3 symbols/min [2025-10-09T18:00:56.735250] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:00:56.751826] [DEBUG] [LOCAL ] CIA: Loaded 16834 existing records from primary storage. [2025-10-09T18:00:56.752069] [INFO ] [MAIN ] CIA: Loaded 16834 existing records. [2025-10-09T18:00:56.805174] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-09T18:00:56.927940] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:00:56.928158] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-09T18:00:56.928204] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-09T18:00:56.928388] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-09T18:00:56.928445] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-09T18:00:57.270676] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:00:57.596702] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-09T18:00:57.710512] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T18:00:58.396745] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-09T18:00:58.491330] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T18:00:59.104189] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-09T18:00:59.196746] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-09T18:00:59.843417] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T18:00:59.996691] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-09T18:01:00.179564] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:01:00.796768] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-09T18:01:01.596759] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-09T18:01:01.917044] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:01:01.964050] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-09T18:01:02.396739] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-09T18:01:03.196734] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-09T18:01:03.544162] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-09T18:01:03.996701] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-09T18:01:04.506943] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-09T18:01:04.796715] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-09T18:01:05.001775] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T18:01:05.004790] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T18:01:05.596722] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-09T18:01:06.396737] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-09T18:01:06.522783] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T18:01:06.810548] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-09T18:01:07.196717] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-09T18:01:08.001875] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-09T18:01:08.021198] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T18:01:08.425828] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T18:01:08.796700] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-09T18:01:09.162138] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T18:01:09.596945] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-09T18:01:10.396756] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-09T18:01:10.776521] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T18:01:11.196710] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-09T18:01:11.385228] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T18:01:11.807313] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-09T18:01:11.996798] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-09T18:01:12.796792] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-09T18:01:13.383347] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-09T18:01:13.551182] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T18:01:13.596695] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-09T18:01:14.067141] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-09T18:01:14.071617] [INFO ] [REMOTE ] CHWY: Full fetch complete (77634 records). [2025-10-09T18:01:14.071758] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-09T18:01:14.401891] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-09T18:01:14.489255] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-09T18:01:14.489332] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-09T18:01:14.490198] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-09T18:01:14.490261] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-09T18:01:14.491812] [DEBUG] [LOCAL ] CHWY: Trimmed 77634 records to 54043 (keeping 200 days of data) [2025-10-09T18:01:14.593796] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T18:01:14.834138] [DEBUG] [LOCAL ] CHWY: Primary data saved (54043 records). [2025-10-09T18:01:14.834278] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-09T18:01:14.834362] [INFO ] [MAIN ] Update Progress: 443/2373 symbols completed. CHWY took 45.9s. Estimated remaining: 4h 26m 35s. Rate: 7.2 symbols/min [2025-10-09T18:01:15.014009] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:15.054388] [DEBUG] [LOCAL ] CIB: Loaded 30591 existing records from primary storage. [2025-10-09T18:01:15.054709] [INFO ] [MAIN ] CIB: Loaded 30591 existing records. [2025-10-09T18:01:15.201831] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-09T18:01:15.242761] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:01:15.242999] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-09T18:01:15.243056] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-09T18:01:15.243308] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-09T18:01:15.243367] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-09T18:01:15.658994] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:15.943306] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:01:15.996677] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-09T18:01:16.180342] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T18:01:16.796753] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-09T18:01:16.891858] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T18:01:16.893447] [INFO ] [REMOTE ] CIA: Full fetch complete (23507 records). [2025-10-09T18:01:16.893520] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-09T18:01:17.258279] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-09T18:01:17.258358] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-09T18:01:17.258790] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-09T18:01:17.258866] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-09T18:01:17.259580] [DEBUG] [LOCAL ] CIA: Trimmed 23507 records to 16925 (keeping 200 days of data) [2025-10-09T18:01:17.351140] [DEBUG] [LOCAL ] CIA: Primary data saved (16925 records). [2025-10-09T18:01:17.351271] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-09T18:01:17.351351] [INFO ] [MAIN ] Update Progress: 444/2373 symbols completed. CIA took 20.8s. Estimated remaining: 4h 26m 1s. Rate: 7.3 symbols/min [2025-10-09T18:01:17.518975] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:17.519161] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-09T18:01:17.519203] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-09T18:01:17.519324] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-09T18:01:17.519365] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-09T18:01:17.519405] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-09T18:01:17.519436] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-09T18:01:17.601951] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-09T18:01:17.885516] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:18.193399] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T18:01:18.197013] [INFO ] [REMOTE ] CHPT: Full fetch complete (72112 records). [2025-10-09T18:01:18.197126] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-09T18:01:18.399638] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-09T18:01:18.601068] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-09T18:01:18.601153] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-09T18:01:18.601965] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-09T18:01:18.602030] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-09T18:01:18.603536] [DEBUG] [LOCAL ] CHPT: Trimmed 72112 records to 48419 (keeping 200 days of data) [2025-10-09T18:01:18.721967] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T18:01:18.924625] [DEBUG] [LOCAL ] CHPT: Primary data saved (48419 records). [2025-10-09T18:01:18.924796] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-09T18:01:18.924874] [INFO ] [MAIN ] Update Progress: 445/2373 symbols completed. CHPT took 50.0s. Estimated remaining: 4h 25m 24s. Rate: 7.3 symbols/min [2025-10-09T18:01:19.099339] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:19.099508] [DEBUG] [LOCAL ] CIEN: No existing data file found in primary storage. [2025-10-09T18:01:19.099546] [WARN ] [MAIN ] CIEN: No existing data found, performing full refresh instead. [2025-10-09T18:01:19.099687] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-09T18:01:19.099774] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-09T18:01:19.099850] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-09T18:01:19.099898] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-09T18:01:19.199816] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-09T18:01:19.466262] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:19.996701] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-09T18:01:20.122574] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T18:01:20.182411] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:01:20.544309] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-09T18:01:20.796701] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-09T18:01:21.596780] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-09T18:01:22.070317] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T18:01:22.307162] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T18:01:22.311343] [INFO ] [REMOTE ] CI: Full fetch complete (71873 records). [2025-10-09T18:01:22.311473] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-09T18:01:22.312464] [FATAL] [VALIDATOR ] CI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:01:22.312575] [FATAL] [MAIN ] CI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:01:22.312690] [WARN ] [MAIN ] CI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:01:22.312783] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-09T18:01:22.312871] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-09T18:01:22.312952] [INFO ] [LOCAL ] CI: Starting deletion of derivative data. [2025-10-09T18:01:22.313258] [DEBUG] [LOCAL ] CI: Deleted derivative data file. [2025-10-09T18:01:22.313388] [INFO ] [MAIN ] Update Progress: 446/2373 symbols completed. CI took 36.5s. Estimated remaining: 4h 24m 55s. Rate: 7.3 symbols/min [2025-10-09T18:01:22.401830] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-09T18:01:22.527064] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:22.533976] [DEBUG] [LOCAL ] CIF: Loaded 4097 existing records from primary storage. [2025-10-09T18:01:22.534142] [INFO ] [MAIN ] CIF: Loaded 4097 existing records. [2025-10-09T18:01:22.730519] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:01:22.730761] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-09T18:01:22.730815] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-09T18:01:22.731028] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-09T18:01:22.731086] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-09T18:01:23.086782] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:23.196729] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-09T18:01:23.922463] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T18:01:23.996709] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-09T18:01:24.151818] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T18:01:24.600306] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:01:24.796726] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-09T18:01:25.356328] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T18:01:25.596706] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-09T18:01:26.284467] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T18:01:26.396721] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-09T18:01:26.680285] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-09T18:01:27.196727] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-09T18:01:27.605266] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-09T18:01:27.996731] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-09T18:01:28.796762] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-09T18:01:29.217846] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:01:29.438497] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:01:29.596712] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-09T18:01:30.396721] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-09T18:01:30.877384] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T18:01:30.905926] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T18:01:31.196775] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-09T18:01:31.491257] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-09T18:01:31.996744] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-09T18:01:32.756849] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T18:01:32.796736] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-09T18:01:33.436090] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T18:01:33.596714] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-09T18:01:34.190963] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T18:01:34.396689] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-09T18:01:35.196767] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-09T18:01:35.996723] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-09T18:01:36.041597] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T18:01:36.515094] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-09T18:01:36.538146] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:01:36.796737] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-09T18:01:37.596772] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-09T18:01:38.012829] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T18:01:38.396709] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-09T18:01:38.443735] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:01:39.196721] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-09T18:01:39.620455] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T18:01:39.630860] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T18:01:39.996770] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-09T18:01:40.796778] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-09T18:01:41.596767] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-09T18:01:41.723712] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T18:01:41.946173] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T18:01:42.184212] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T18:01:42.396776] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-09T18:01:43.058412] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-09T18:01:43.196736] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-09T18:01:43.996718] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-09T18:01:44.446667] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T18:01:44.796763] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-09T18:01:45.085352] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-09T18:01:45.130998] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-09T18:01:45.596759] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-09T18:01:46.396764] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-09T18:01:47.015575] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T18:01:47.016997] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T18:01:47.196673] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-09T18:01:47.996758] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-09T18:01:48.623354] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T18:01:48.624176] [INFO ] [REMOTE ] CIF: Full fetch complete (6586 records). [2025-10-09T18:01:48.624244] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-09T18:01:48.818194] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-09T18:01:49.006891] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-09T18:01:49.007099] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-09T18:01:49.007310] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-09T18:01:49.007384] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-09T18:01:49.008099] [DEBUG] [LOCAL ] CIF: Trimmed 6586 records to 4108 (keeping 200 days of data) [2025-10-09T18:01:49.059029] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T18:01:49.072623] [DEBUG] [LOCAL ] CIF: Primary data saved (4108 records). [2025-10-09T18:01:49.073180] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-09T18:01:49.073272] [INFO ] [MAIN ] Update Progress: 447/2373 symbols completed. CIF took 26.8s. Estimated remaining: 4h 26m 6s. Rate: 7.2 symbols/min [2025-10-09T18:01:49.238223] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:49.277450] [DEBUG] [LOCAL ] CIG: Loaded 43848 existing records from primary storage. [2025-10-09T18:01:49.277768] [INFO ] [MAIN ] CIG: Loaded 43848 existing records. [2025-10-09T18:01:49.359363] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T18:01:49.381494] [INFO ] [REMOTE ] CICB: Full fetch complete (1991 records). [2025-10-09T18:01:49.381602] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-09T18:01:49.382049] [FATAL] [VALIDATOR ] CICB: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:01:49.382157] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:01:49.382203] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:01:49.382242] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-09T18:01:49.387963] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-09T18:01:49.403730] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-09T18:01:49.422331] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-09T18:01:49.434812] [INFO ] [MAIN ] Update Progress: 448/2373 symbols completed. CICB took 32.1s. Estimated remaining: 4h 25m 24s. Rate: 7.3 symbols/min [2025-10-09T18:01:49.508962] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:01:49.542909] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-09T18:01:49.559959] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-09T18:01:49.571520] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-09T18:01:49.582099] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-09T18:01:49.603235] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-09T18:01:49.711221] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:49.716577] [DEBUG] [LOCAL ] CII: No existing data file found in primary storage. [2025-10-09T18:01:49.723553] [WARN ] [MAIN ] CII: No existing data found, performing full refresh instead. [2025-10-09T18:01:49.728927] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-09T18:01:49.750721] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-09T18:01:49.772455] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-09T18:01:49.810094] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-09T18:01:50.310973] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:50.408458] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-09T18:01:50.414418] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:51.196740] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-09T18:01:51.421967] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T18:01:51.793952] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T18:01:51.996694] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-09T18:01:52.202477] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T18:01:52.796768] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-09T18:01:53.397887] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T18:01:53.596688] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-09T18:01:53.795433] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T18:01:54.396719] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-09T18:01:54.760146] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:01:54.762852] [INFO ] [REMOTE ] CIB: Full fetch complete (44582 records). [2025-10-09T18:01:54.762997] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-09T18:01:55.151254] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-09T18:01:55.151588] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T18:01:55.151728] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-09T18:01:55.155956] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-09T18:01:55.156023] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-09T18:01:55.156924] [DEBUG] [LOCAL ] CIB: Trimmed 44582 records to 30800 (keeping 200 days of data) [2025-10-09T18:01:55.206801] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-09T18:01:55.341768] [DEBUG] [LOCAL ] CIB: Primary data saved (30800 records). [2025-10-09T18:01:55.341903] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-09T18:01:55.341984] [INFO ] [MAIN ] Update Progress: 449/2373 symbols completed. CIB took 40.5s. Estimated remaining: 4h 25m 5s. Rate: 7.3 symbols/min [2025-10-09T18:01:55.514363] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:01:55.514546] [DEBUG] [LOCAL ] CIM: No existing data file found in primary storage. [2025-10-09T18:01:55.514606] [WARN ] [MAIN ] CIM: No existing data found, performing full refresh instead. [2025-10-09T18:01:55.514759] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-09T18:01:55.514802] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-09T18:01:55.514842] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-09T18:01:55.514873] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-09T18:01:55.865821] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:01:55.996704] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-09T18:01:56.796751] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-09T18:01:57.244860] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-09T18:01:57.545081] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:01:57.596667] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-09T18:01:58.396686] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-09T18:01:58.478355] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T18:01:59.061414] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T18:01:59.196686] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-09T18:01:59.296711] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T18:01:59.996723] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-09T18:02:00.703126] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T18:02:00.796715] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-09T18:02:01.052449] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T18:02:01.596703] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-09T18:02:02.039548] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T18:02:02.396897] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-09T18:02:03.051814] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T18:02:03.055805] [INFO ] [REMOTE ] CIEN: Full fetch complete (75173 records). [2025-10-09T18:02:03.055931] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-09T18:02:03.056751] [FATAL] [VALIDATOR ] CIEN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:02:03.056843] [FATAL] [MAIN ] CIEN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:02:03.056889] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:02:03.056932] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-09T18:02:03.056991] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-09T18:02:03.057029] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-10-09T18:02:03.057096] [DEBUG] [LOCAL ] CIEN: No derivative data file found to delete. [2025-10-09T18:02:03.057219] [INFO ] [MAIN ] Update Progress: 450/2373 symbols completed. CIEN took 44.1s. Estimated remaining: 4h 24m 55s. Rate: 7.3 symbols/min [2025-10-09T18:02:03.206395] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-09T18:02:03.243172] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:03.249703] [DEBUG] [LOCAL ] CIMN: Loaded 2733 existing records from primary storage. [2025-10-09T18:02:03.250203] [INFO ] [MAIN ] CIMN: Loaded 2733 existing records. [2025-10-09T18:02:03.364350] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:02:03.445413] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:02:03.445722] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-09T18:02:03.445782] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-09T18:02:03.445983] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-09T18:02:03.446040] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-09T18:02:03.814779] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:03.996718] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-09T18:02:04.796694] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-09T18:02:04.889329] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T18:02:05.392116] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:02:05.552745] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T18:02:05.596663] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-09T18:02:06.396704] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-09T18:02:06.861252] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T18:02:07.146118] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:02:07.196687] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-09T18:02:07.653314] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T18:02:07.996786] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-09T18:02:08.775423] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T18:02:08.796703] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-09T18:02:09.596695] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-09T18:02:09.659900] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T18:02:10.020022] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:02:10.396719] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-09T18:02:10.961610] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T18:02:11.196754] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-09T18:02:11.996746] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-09T18:02:12.251720] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T18:02:12.796754] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-09T18:02:13.286576] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T18:02:13.501701] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T18:02:13.596712] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-09T18:02:14.396849] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-09T18:02:15.196704] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-09T18:02:15.493522] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T18:02:15.816495] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T18:02:15.996724] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-09T18:02:16.034045] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T18:02:16.796725] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-09T18:02:17.370308] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T18:02:17.455915] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T18:02:17.596699] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-09T18:02:18.396696] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-09T18:02:18.462107] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T18:02:18.464241] [INFO ] [REMOTE ] CII: Full fetch complete (22959 records). [2025-10-09T18:02:18.464351] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-09T18:02:18.857454] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-09T18:02:18.857541] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-09T18:02:18.857987] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-09T18:02:18.858051] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-09T18:02:18.858706] [DEBUG] [LOCAL ] CII: Trimmed 22959 records to 15402 (keeping 200 days of data) [2025-10-09T18:02:18.930062] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T18:02:18.958760] [DEBUG] [LOCAL ] CII: Primary data saved (15402 records). [2025-10-09T18:02:18.958909] [INFO ] [MAIN ] CII: Full history saved. [2025-10-09T18:02:18.959020] [INFO ] [MAIN ] Update Progress: 451/2373 symbols completed. CII took 29.5s. Estimated remaining: 4h 25m 19s. Rate: 7.2 symbols/min [2025-10-09T18:02:19.124181] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:19.124331] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-09T18:02:19.124368] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-09T18:02:19.124475] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-09T18:02:19.124516] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-09T18:02:19.124556] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-09T18:02:19.124588] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-09T18:02:19.201885] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-09T18:02:19.482019] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:19.996723] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-09T18:02:20.721255] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T18:02:20.796734] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-09T18:02:20.889781] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T18:02:21.596715] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-09T18:02:22.062117] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T18:02:22.111738] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T18:02:22.396774] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-09T18:02:23.196742] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-09T18:02:23.717993] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-09T18:02:23.996756] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-09T18:02:24.025232] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:02:24.452942] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T18:02:24.796705] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-09T18:02:25.596723] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-09T18:02:26.386902] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:02:26.396675] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-09T18:02:26.926615] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T18:02:27.196725] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-09T18:02:27.372134] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T18:02:27.631418] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T18:02:27.632264] [INFO ] [REMOTE ] CIMN: Full fetch complete (3915 records). [2025-10-09T18:02:27.632332] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-09T18:02:27.632699] [FATAL] [VALIDATOR ] CIMN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:02:27.632782] [FATAL] [MAIN ] CIMN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:02:27.632825] [WARN ] [MAIN ] CIMN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:02:27.632862] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-09T18:02:27.632940] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-09T18:02:27.632994] [INFO ] [LOCAL ] CIMN: Starting deletion of derivative data. [2025-10-09T18:02:27.633207] [DEBUG] [LOCAL ] CIMN: Deleted derivative data file. [2025-10-09T18:02:27.633294] [INFO ] [MAIN ] Update Progress: 452/2373 symbols completed. CIMN took 24.6s. Estimated remaining: 4h 25m 12s. Rate: 7.2 symbols/min [2025-10-09T18:02:27.799421] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:27.799612] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-09T18:02:27.799690] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-09T18:02:27.799806] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-09T18:02:27.799847] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-09T18:02:27.799918] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-09T18:02:27.799961] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-09T18:02:28.001919] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-09T18:02:28.152922] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:28.796686] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-09T18:02:29.596750] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-09T18:02:29.742827] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:02:30.102795] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T18:02:30.180465] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T18:02:30.396726] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-09T18:02:31.088145] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-09T18:02:31.196729] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-09T18:02:31.473969] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-09T18:02:31.996761] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-09T18:02:32.188722] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:02:32.188957] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-09T18:02:32.189056] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:02:32.189135] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-09T18:02:32.189202] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:02:32.189274] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-09T18:02:32.189372] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-09T18:02:32.189416] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-09T18:02:32.189473] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-09T18:02:32.189542] [INFO ] [MAIN ] Update Progress: 453/2373 symbols completed. CIMP took 4.6s. Estimated remaining: 4h 24m 48s. Rate: 7.3 symbols/min [2025-10-09T18:02:32.354839] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:32.373319] [DEBUG] [LOCAL ] CINT: Loaded 19416 existing records from primary storage. [2025-10-09T18:02:32.373550] [INFO ] [MAIN ] CINT: Loaded 19416 existing records. [2025-10-09T18:02:32.553425] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:02:32.553666] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-09T18:02:32.553727] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-09T18:02:32.553958] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-09T18:02:32.554016] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-09T18:02:32.801833] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-09T18:02:32.916772] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:33.596770] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-09T18:02:34.164373] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T18:02:34.396763] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-09T18:02:34.656116] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T18:02:35.196758] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-09T18:02:35.820680] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T18:02:35.830950] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T18:02:35.834722] [INFO ] [REMOTE ] CIM: Full fetch complete (54998 records). [2025-10-09T18:02:35.834869] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-09T18:02:36.000078] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-09T18:02:36.245545] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-09T18:02:36.245630] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-09T18:02:36.246356] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-09T18:02:36.246408] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-09T18:02:36.247497] [DEBUG] [LOCAL ] CIM: Trimmed 54998 records to 37987 (keeping 200 days of data) [2025-10-09T18:02:36.486984] [DEBUG] [LOCAL ] CIM: Primary data saved (37987 records). [2025-10-09T18:02:36.487471] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-09T18:02:36.487704] [INFO ] [MAIN ] Update Progress: 454/2373 symbols completed. CIM took 41.1s. Estimated remaining: 4h 24m 23s. Rate: 7.3 symbols/min [2025-10-09T18:02:36.675491] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:36.695068] [DEBUG] [LOCAL ] CIO: Loaded 20422 existing records from primary storage. [2025-10-09T18:02:36.695316] [INFO ] [MAIN ] CIO: Loaded 20422 existing records. [2025-10-09T18:02:36.808084] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-09T18:02:36.895152] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:02:36.895369] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-09T18:02:36.895417] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-09T18:02:36.895678] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-09T18:02:36.895739] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-09T18:02:37.030309] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T18:02:37.327984] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:37.596963] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-09T18:02:38.396723] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-09T18:02:38.585550] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T18:02:38.589798] [INFO ] [REMOTE ] CIG: Full fetch complete (61438 records). [2025-10-09T18:02:38.589936] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-09T18:02:38.883062] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-09T18:02:38.926378] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T18:02:39.027151] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-09T18:02:39.027247] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-09T18:02:39.028011] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-09T18:02:39.028075] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-09T18:02:39.029381] [DEBUG] [LOCAL ] CIG: Trimmed 61438 records to 44200 (keeping 200 days of data) [2025-10-09T18:02:39.202472] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-09T18:02:39.300008] [DEBUG] [LOCAL ] CIG: Primary data saved (44200 records). [2025-10-09T18:02:39.300151] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-09T18:02:39.300235] [INFO ] [MAIN ] Update Progress: 455/2373 symbols completed. CIG took 50.2s. Estimated remaining: 4h 23m 52s. Rate: 7.3 symbols/min [2025-10-09T18:02:39.467893] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:39.468126] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-09T18:02:39.468169] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-09T18:02:39.468280] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-09T18:02:39.468322] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-09T18:02:39.468362] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-09T18:02:39.468393] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-09T18:02:39.903776] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:40.001861] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-09T18:02:40.013131] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T18:02:40.796693] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-09T18:02:41.435254] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T18:02:41.603715] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-09T18:02:41.608268] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T18:02:42.211203] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T18:02:42.396795] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-09T18:02:43.196708] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-09T18:02:43.370377] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T18:02:43.996721] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-09T18:02:44.275483] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T18:02:44.796768] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-09T18:02:44.815118] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T18:02:45.596779] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-09T18:02:45.853914] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T18:02:46.396730] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-09T18:02:46.628485] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T18:02:47.155843] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T18:02:47.156765] [INFO ] [REMOTE ] CIMO: Full fetch complete (5180 records). [2025-10-09T18:02:47.156835] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-09T18:02:47.201984] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-09T18:02:47.336408] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T18:02:47.336616] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:02:47.336703] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:02:47.336773] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-09T18:02:47.336834] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-09T18:02:47.336869] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-09T18:02:47.336934] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-09T18:02:47.337012] [INFO ] [MAIN ] Update Progress: 456/2373 symbols completed. CIMO took 28.4s. Estimated remaining: 4h 23m 43s. Rate: 7.3 symbols/min [2025-10-09T18:02:47.501965] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:47.573497] [DEBUG] [LOCAL ] CIVI: Loaded 52615 existing records from primary storage. [2025-10-09T18:02:47.573856] [INFO ] [MAIN ] CIVI: Loaded 52615 existing records. [2025-10-09T18:02:47.750554] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:02:47.750770] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-09T18:02:47.750817] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-09T18:02:47.751246] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-09T18:02:47.751303] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-09T18:02:47.998806] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-09T18:02:48.109713] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:02:48.208739] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T18:02:48.796678] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-09T18:02:49.179714] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T18:02:49.579497] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:02:49.596670] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-09T18:02:50.275443] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T18:02:50.396730] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-09T18:02:51.196688] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-09T18:02:51.387887] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T18:02:51.996680] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-09T18:02:52.013021] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T18:02:52.796712] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-09T18:02:53.589376] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T18:02:53.596962] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-09T18:02:53.608388] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T18:02:54.396805] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-09T18:02:55.196805] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-09T18:02:55.467635] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T18:02:55.474233] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T18:02:55.987339] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T18:02:55.996701] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-09T18:02:56.796701] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-09T18:02:57.215217] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T18:02:57.512393] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T18:02:57.596771] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-09T18:02:58.396719] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-09T18:02:58.821599] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T18:02:58.825022] [INFO ] [REMOTE ] CINT: Full fetch complete (27460 records). [2025-10-09T18:02:58.825184] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-09T18:02:59.204569] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-09T18:02:59.206442] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-09T18:02:59.207514] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-09T18:02:59.208051] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-09T18:02:59.208119] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-09T18:02:59.208999] [DEBUG] [LOCAL ] CINT: Trimmed 27460 records to 19687 (keeping 200 days of data) [2025-10-09T18:02:59.326267] [DEBUG] [LOCAL ] CINT: Primary data saved (19687 records). [2025-10-09T18:02:59.326430] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-09T18:02:59.326516] [INFO ] [MAIN ] Update Progress: 457/2373 symbols completed. CINT took 27.1s. Estimated remaining: 4h 23m 50s. Rate: 7.3 symbols/min [2025-10-09T18:02:59.499280] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:02:59.519093] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T18:02:59.577196] [DEBUG] [LOCAL ] CL: Loaded 53648 existing records from primary storage. [2025-10-09T18:02:59.577535] [INFO ] [MAIN ] CL: Loaded 53648 existing records. [2025-10-09T18:02:59.753099] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:02:59.753310] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-09T18:02:59.753358] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-09T18:02:59.753600] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-09T18:02:59.753688] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-09T18:02:59.997343] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-09T18:03:00.110325] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:00.198688] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T18:03:00.796738] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-09T18:03:01.587524] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T18:03:01.597214] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-09T18:03:02.396751] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-09T18:03:02.556603] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T18:03:02.662718] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T18:03:03.196706] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-09T18:03:03.959940] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T18:03:03.996671] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-09T18:03:04.776900] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T18:03:04.796670] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-09T18:03:05.596780] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-09T18:03:05.999888] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T18:03:06.396681] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-09T18:03:06.598954] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T18:03:06.721539] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T18:03:07.196742] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-09T18:03:07.996691] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-09T18:03:08.094898] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T18:03:08.527400] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T18:03:08.615100] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T18:03:08.796737] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-09T18:03:09.596709] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-09T18:03:10.396683] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-09T18:03:10.744358] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T18:03:10.751045] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T18:03:10.765350] [INFO ] [REMOTE ] CIO: Full fetch complete (29218 records). [2025-10-09T18:03:10.765796] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-09T18:03:11.164564] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-09T18:03:11.164662] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-09T18:03:11.165111] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-09T18:03:11.165154] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-09T18:03:11.165924] [DEBUG] [LOCAL ] CIO: Trimmed 29218 records to 20663 (keeping 200 days of data) [2025-10-09T18:03:11.212825] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-09T18:03:11.286167] [DEBUG] [LOCAL ] CIO: Primary data saved (20663 records). [2025-10-09T18:03:11.286602] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-09T18:03:11.286730] [INFO ] [MAIN ] Update Progress: 458/2373 symbols completed. CIO took 34.8s. Estimated remaining: 4h 23m 57s. Rate: 7.3 symbols/min [2025-10-09T18:03:11.458771] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:11.491741] [DEBUG] [LOCAL ] CLB: Loaded 33007 existing records from primary storage. [2025-10-09T18:03:11.492011] [INFO ] [MAIN ] CLB: Loaded 33007 existing records. [2025-10-09T18:03:11.680979] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:03:11.681351] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-09T18:03:11.681424] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-09T18:03:11.686852] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-09T18:03:11.695666] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-09T18:03:11.696142] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T18:03:12.001788] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-09T18:03:12.057564] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:12.796688] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-09T18:03:12.853199] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T18:03:13.292963] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T18:03:13.596741] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-09T18:03:14.396751] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-09T18:03:14.532591] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T18:03:15.071963] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T18:03:15.196726] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-09T18:03:15.548053] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T18:03:15.996762] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-09T18:03:16.796716] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-09T18:03:17.032922] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T18:03:17.034038] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T18:03:17.047851] [INFO ] [REMOTE ] CION: Full fetch complete (40306 records). [2025-10-09T18:03:17.048533] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-09T18:03:17.050093] [FATAL] [VALIDATOR ] CION: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:03:17.050204] [FATAL] [MAIN ] CION: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:03:17.050293] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:03:17.050381] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-09T18:03:17.050457] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-09T18:03:17.050508] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-10-09T18:03:17.050559] [DEBUG] [LOCAL ] CION: No derivative data file found to delete. [2025-10-09T18:03:17.050634] [INFO ] [MAIN ] Update Progress: 459/2373 symbols completed. CION took 37.8s. Estimated remaining: 4h 23m 39s. Rate: 7.3 symbols/min [2025-10-09T18:03:17.249961] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:17.265310] [DEBUG] [LOCAL ] CLCO: Loaded 12762 existing records from primary storage. [2025-10-09T18:03:17.265549] [INFO ] [MAIN ] CLCO: Loaded 12762 existing records. [2025-10-09T18:03:17.486044] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:03:17.486298] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-09T18:03:17.486347] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-09T18:03:17.486600] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-09T18:03:17.486697] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-09T18:03:17.600221] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-09T18:03:17.881270] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:18.353458] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T18:03:18.396682] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-09T18:03:18.644255] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T18:03:19.196732] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-09T18:03:19.625113] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T18:03:19.996735] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-09T18:03:20.796695] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-09T18:03:20.842934] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T18:03:21.596748] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-09T18:03:21.682887] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T18:03:22.019732] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T18:03:22.396778] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-09T18:03:23.196690] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-09T18:03:23.259719] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:03:23.656431] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:03:23.996752] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-09T18:03:24.796712] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-09T18:03:24.959955] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:03:25.596700] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-09T18:03:25.772154] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T18:03:26.300830] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:03:26.396678] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-09T18:03:27.196701] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-09T18:03:27.244228] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T18:03:27.661858] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T18:03:27.996707] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-09T18:03:28.266357] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T18:03:28.796711] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-09T18:03:29.596689] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-09T18:03:29.869912] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T18:03:29.874753] [INFO ] [REMOTE ] CL: Full fetch complete (77620 records). [2025-10-09T18:03:29.874894] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-09T18:03:30.288062] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-09T18:03:30.288154] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-09T18:03:30.289006] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-09T18:03:30.289070] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-09T18:03:30.290598] [DEBUG] [LOCAL ] CL: Trimmed 77620 records to 54038 (keeping 200 days of data) [2025-10-09T18:03:30.396827] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-09T18:03:30.537260] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:03:30.543233] [INFO ] [REMOTE ] CIVI: Full fetch complete (75746 records). [2025-10-09T18:03:30.547046] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-09T18:03:30.890242] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T18:03:31.052965] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-09T18:03:31.053361] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-09T18:03:31.054619] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-09T18:03:31.055195] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-09T18:03:31.061383] [DEBUG] [LOCAL ] CIVI: Trimmed 75746 records to 53005 (keeping 200 days of data) [2025-10-09T18:03:31.196906] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-09T18:03:31.263659] [DEBUG] [LOCAL ] CL: Primary data saved (54038 records). [2025-10-09T18:03:31.289703] [INFO ] [MAIN ] CL: Full history saved. [2025-10-09T18:03:31.291188] [INFO ] [MAIN ] Update Progress: 460/2373 symbols completed. CL took 32.0s. Estimated remaining: 4h 23m 55s. Rate: 7.2 symbols/min [2025-10-09T18:03:31.487825] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:31.516100] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:03:31.619128] [DEBUG] [LOCAL ] CIVI: Primary data saved (53005 records). [2025-10-09T18:03:31.626374] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-09T18:03:31.627750] [INFO ] [MAIN ] Update Progress: 461/2373 symbols completed. CIVI took 44.3s. Estimated remaining: 4h 23m 14s. Rate: 7.3 symbols/min [2025-10-09T18:03:31.700551] [DEBUG] [LOCAL ] CLDT: Loaded 25381 existing records from primary storage. [2025-10-09T18:03:31.722620] [INFO ] [MAIN ] CLDT: Loaded 25381 existing records. [2025-10-09T18:03:31.946705] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:31.962846] [DEBUG] [LOCAL ] CLF: No existing data file found in primary storage. [2025-10-09T18:03:31.962926] [WARN ] [MAIN ] CLF: No existing data found, performing full refresh instead. [2025-10-09T18:03:31.964888] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-09T18:03:31.965526] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-09T18:03:31.983564] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-09T18:03:31.987728] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:03:31.987863] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-09T18:03:31.988036] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-09T18:03:31.988105] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-09T18:03:32.001769] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-09T18:03:32.033568] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-09T18:03:32.061111] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-09T18:03:32.659666] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:32.736715] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:32.755548] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T18:03:32.796716] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-09T18:03:33.240360] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T18:03:33.596734] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-09T18:03:33.889407] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T18:03:34.396754] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-09T18:03:34.751921] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T18:03:35.196743] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-09T18:03:35.996696] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-09T18:03:36.029117] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T18:03:36.187920] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T18:03:36.796673] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-09T18:03:36.880155] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T18:03:37.596738] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-09T18:03:38.403040] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-09T18:03:38.425139] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:03:38.645611] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T18:03:39.196812] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-09T18:03:39.613272] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T18:03:39.616141] [INFO ] [REMOTE ] CLB: Full fetch complete (46579 records). [2025-10-09T18:03:39.616227] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-09T18:03:39.906764] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-09T18:03:40.006266] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-09T18:03:40.023579] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-09T18:03:40.023721] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-09T18:03:40.024355] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-09T18:03:40.024400] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-09T18:03:40.025459] [DEBUG] [LOCAL ] CLB: Trimmed 46579 records to 33260 (keeping 200 days of data) [2025-10-09T18:03:40.231993] [DEBUG] [LOCAL ] CLB: Primary data saved (33260 records). [2025-10-09T18:03:40.232134] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-09T18:03:40.232408] [INFO ] [MAIN ] Update Progress: 462/2373 symbols completed. CLB took 28.9s. Estimated remaining: 4h 23m 7s. Rate: 7.3 symbols/min [2025-10-09T18:03:40.402703] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:40.431896] [DEBUG] [LOCAL ] CLH: Loaded 27621 existing records from primary storage. [2025-10-09T18:03:40.432161] [INFO ] [MAIN ] CLH: Loaded 27621 existing records. [2025-10-09T18:03:40.609030] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:03:40.609317] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-09T18:03:40.609373] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-09T18:03:40.609585] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-09T18:03:40.609670] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-09T18:03:40.796849] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-09T18:03:40.975312] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:41.134038] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T18:03:41.596776] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-09T18:03:41.927266] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T18:03:42.396753] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-09T18:03:42.579937] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T18:03:42.968275] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T18:03:43.196731] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-09T18:03:43.996723] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-09T18:03:44.795411] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T18:03:44.797782] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-09T18:03:45.043830] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T18:03:45.596774] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-09T18:03:46.269811] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T18:03:46.396685] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-09T18:03:47.196771] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-09T18:03:47.531752] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T18:03:47.623898] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T18:03:47.813595] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T18:03:47.996841] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-09T18:03:48.796727] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-09T18:03:49.596719] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-09T18:03:50.132368] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T18:03:50.167407] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-09T18:03:50.396691] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-09T18:03:50.655468] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T18:03:51.196714] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-09T18:03:51.413171] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T18:03:51.996752] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-09T18:03:52.796710] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-09T18:03:52.950046] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T18:03:53.152035] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:03:53.154458] [INFO ] [REMOTE ] CLCO: Full fetch complete (22617 records). [2025-10-09T18:03:53.154566] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-09T18:03:53.546250] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-09T18:03:53.546334] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-09T18:03:53.546816] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-09T18:03:53.546879] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-09T18:03:53.547491] [DEBUG] [LOCAL ] CLCO: Trimmed 22617 records to 12916 (keeping 200 days of data) [2025-10-09T18:03:53.604940] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-09T18:03:53.628952] [DEBUG] [LOCAL ] CLCO: Primary data saved (12916 records). [2025-10-09T18:03:53.629150] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-09T18:03:53.629245] [INFO ] [MAIN ] Update Progress: 463/2373 symbols completed. CLCO took 36.6s. Estimated remaining: 4h 23m 20s. Rate: 7.3 symbols/min [2025-10-09T18:03:53.811761] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:03:53.824600] [DEBUG] [LOCAL ] CLPR: Loaded 10563 existing records from primary storage. [2025-10-09T18:03:53.824871] [INFO ] [MAIN ] CLPR: Loaded 10563 existing records. [2025-10-09T18:03:54.011466] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:03:54.011696] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-09T18:03:54.011756] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-09T18:03:54.012020] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-09T18:03:54.012078] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-09T18:03:54.382662] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T18:03:54.399400] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-09T18:03:54.405920] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:03:55.196725] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-09T18:03:55.299449] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T18:03:55.419048] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T18:03:55.996771] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-09T18:03:56.379293] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T18:03:56.796745] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-09T18:03:57.155358] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T18:03:57.596781] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-09T18:03:57.988477] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T18:03:58.306972] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T18:03:58.396717] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-09T18:03:59.196725] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-09T18:03:59.457306] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T18:03:59.459939] [INFO ] [REMOTE ] CLDT: Full fetch complete (37222 records). [2025-10-09T18:03:59.460013] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-09T18:03:59.835060] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-09T18:03:59.835139] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-09T18:03:59.835708] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-09T18:03:59.835770] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-09T18:03:59.836522] [DEBUG] [LOCAL ] CLDT: Trimmed 37222 records to 25582 (keeping 200 days of data) [2025-10-09T18:03:59.981850] [DEBUG] [LOCAL ] CLDT: Primary data saved (25582 records). [2025-10-09T18:03:59.981986] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-09T18:03:59.982066] [INFO ] [MAIN ] Update Progress: 464/2373 symbols completed. CLDT took 28.7s. Estimated remaining: 4h 23m 4s. Rate: 7.3 symbols/min [2025-10-09T18:04:00.002468] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-09T18:04:00.184577] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:00.184803] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-10-09T18:04:00.184847] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-10-09T18:04:00.184964] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-09T18:04:00.185006] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-09T18:04:00.185047] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-09T18:04:00.185078] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-09T18:04:00.551760] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:00.574722] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:04:00.796693] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-09T18:04:00.951291] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T18:04:01.596710] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-09T18:04:01.941847] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T18:04:02.396720] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-09T18:04:03.186900] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T18:04:03.196675] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-09T18:04:03.942746] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-09T18:04:03.996682] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-09T18:04:04.146991] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T18:04:04.796757] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-09T18:04:05.351116] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T18:04:05.596673] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-09T18:04:05.716756] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T18:04:06.399503] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-09T18:04:06.402479] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T18:04:07.196725] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-09T18:04:07.996696] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-09T18:04:08.237699] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T18:04:08.796741] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-09T18:04:08.981789] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T18:04:09.210906] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T18:04:09.596747] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-09T18:04:10.396722] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-09T18:04:10.746596] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-09T18:04:10.751298] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-10-09T18:04:10.751413] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-09T18:04:11.163267] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-09T18:04:11.163415] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-09T18:04:11.164303] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-09T18:04:11.164525] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-09T18:04:11.166254] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 54131 (keeping 200 days of data) [2025-10-09T18:04:11.221674] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-09T18:04:11.281775] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T18:04:11.323915] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:04:11.541825] [DEBUG] [LOCAL ] CLF: Primary data saved (54131 records). [2025-10-09T18:04:11.541929] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-09T18:04:11.542000] [INFO ] [MAIN ] Update Progress: 465/2373 symbols completed. CLF took 39.9s. Estimated remaining: 4h 23m 9s. Rate: 7.3 symbols/min [2025-10-09T18:04:11.708150] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:11.760829] [DEBUG] [LOCAL ] CLVT: Loaded 51982 existing records from primary storage. [2025-10-09T18:04:11.761160] [INFO ] [MAIN ] CLVT: Loaded 51982 existing records. [2025-10-09T18:04:11.938445] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:11.938686] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-09T18:04:11.938743] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-09T18:04:11.939029] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-09T18:04:11.939086] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-09T18:04:12.001919] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-09T18:04:12.288066] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:12.470969] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T18:04:12.796707] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-09T18:04:13.596833] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-09T18:04:13.755460] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T18:04:13.970673] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-09T18:04:14.396750] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-09T18:04:15.158918] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:04:15.196664] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-09T18:04:15.996728] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-09T18:04:16.462180] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-09T18:04:16.775116] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T18:04:16.793302] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T18:04:16.796708] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-09T18:04:17.407679] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-09T18:04:17.596700] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-09T18:04:18.396714] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-09T18:04:18.746099] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T18:04:19.196825] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-09T18:04:19.724037] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T18:04:19.819115] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T18:04:19.996721] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-09T18:04:20.689363] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T18:04:20.690512] [INFO ] [REMOTE ] CLPR: Full fetch complete (16668 records). [2025-10-09T18:04:20.690579] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-09T18:04:20.801817] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-09T18:04:21.051890] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-09T18:04:21.051997] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-09T18:04:21.052375] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-09T18:04:21.052434] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-09T18:04:21.052994] [DEBUG] [LOCAL ] CLPR: Trimmed 16668 records to 10621 (keeping 200 days of data) [2025-10-09T18:04:21.114813] [DEBUG] [LOCAL ] CLPR: Primary data saved (10621 records). [2025-10-09T18:04:21.114942] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-09T18:04:21.115021] [INFO ] [MAIN ] Update Progress: 466/2373 symbols completed. CLPR took 27.5s. Estimated remaining: 4h 23m 6s. Rate: 7.2 symbols/min [2025-10-09T18:04:21.279892] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:21.300723] [DEBUG] [LOCAL ] CLW: Loaded 21669 existing records from primary storage. [2025-10-09T18:04:21.300946] [INFO ] [MAIN ] CLW: Loaded 21669 existing records. [2025-10-09T18:04:21.473399] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:21.473578] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-09T18:04:21.473623] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-09T18:04:21.473895] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-09T18:04:21.473952] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-09T18:04:21.614857] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-09T18:04:21.830470] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:21.985005] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T18:04:21.987502] [INFO ] [REMOTE ] CLH: Full fetch complete (41804 records). [2025-10-09T18:04:21.987574] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-09T18:04:22.353254] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-09T18:04:22.353329] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-09T18:04:22.353839] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-09T18:04:22.353909] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-09T18:04:22.354724] [DEBUG] [LOCAL ] CLH: Trimmed 41804 records to 27839 (keeping 200 days of data) [2025-10-09T18:04:22.405120] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-09T18:04:22.522198] [DEBUG] [LOCAL ] CLH: Primary data saved (27839 records). [2025-10-09T18:04:22.522325] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-09T18:04:22.522404] [INFO ] [MAIN ] Update Progress: 467/2373 symbols completed. CLH took 42.3s. Estimated remaining: 4h 22m 30s. Rate: 7.3 symbols/min [2025-10-09T18:04:22.692868] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:22.751100] [DEBUG] [LOCAL ] CLX: Loaded 51594 existing records from primary storage. [2025-10-09T18:04:22.751395] [INFO ] [MAIN ] CLX: Loaded 51594 existing records. [2025-10-09T18:04:22.929836] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:22.930018] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-09T18:04:22.930086] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-09T18:04:22.930546] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-09T18:04:22.930604] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-09T18:04:23.201584] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-09T18:04:23.282327] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:23.969008] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:04:23.996666] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-09T18:04:24.042905] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-09T18:04:24.796697] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-09T18:04:24.842323] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T18:04:25.317020] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T18:04:25.596750] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-09T18:04:26.396766] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-09T18:04:26.527978] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:04:26.876411] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:04:27.196718] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-09T18:04:27.996738] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-09T18:04:28.267026] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T18:04:28.796723] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-09T18:04:28.889091] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T18:04:29.140034] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T18:04:29.596694] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-09T18:04:30.396680] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-09T18:04:30.623970] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T18:04:31.044636] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-09T18:04:31.196690] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-09T18:04:31.847071] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T18:04:31.996717] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-09T18:04:32.796714] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-09T18:04:32.989715] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T18:04:33.523277] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T18:04:33.596741] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-09T18:04:34.396678] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-09T18:04:34.513308] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T18:04:35.196678] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-09T18:04:35.589393] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:04:35.996750] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-09T18:04:36.194954] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-09T18:04:36.796756] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-09T18:04:37.305316] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-09T18:04:37.596689] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-09T18:04:37.671611] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:04:38.396760] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-09T18:04:38.564672] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T18:04:38.743086] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T18:04:39.196732] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-09T18:04:40.006691] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-09T18:04:40.026895] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:04:40.796693] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-09T18:04:41.003720] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T18:04:41.596764] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-09T18:04:42.307553] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-09T18:04:42.396698] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-09T18:04:42.442927] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:04:42.705275] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T18:04:43.196728] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-09T18:04:43.996723] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-09T18:04:44.251545] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T18:04:44.256196] [INFO ] [REMOTE ] CLS: Full fetch complete (77470 records). [2025-10-09T18:04:44.256319] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-09T18:04:44.674553] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-09T18:04:44.674632] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-09T18:04:44.675618] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-09T18:04:44.675821] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-09T18:04:44.677421] [DEBUG] [LOCAL ] CLS: Trimmed 77470 records to 53980 (keeping 200 days of data) [2025-10-09T18:04:44.800379] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-09T18:04:45.039764] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T18:04:45.059616] [DEBUG] [LOCAL ] CLS: Primary data saved (53980 records). [2025-10-09T18:04:45.059779] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-09T18:04:45.059897] [INFO ] [MAIN ] Update Progress: 468/2373 symbols completed. CLS took 45.1s. Estimated remaining: 4h 23m 20s. Rate: 7.2 symbols/min [2025-10-09T18:04:45.245975] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:45.291518] [DEBUG] [LOCAL ] CM: Loaded 48747 existing records from primary storage. [2025-10-09T18:04:45.291836] [INFO ] [MAIN ] CM: Loaded 48747 existing records. [2025-10-09T18:04:45.482310] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:45.482628] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-09T18:04:45.482794] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-09T18:04:45.483244] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-09T18:04:45.483302] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-09T18:04:45.599131] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-09T18:04:45.804792] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T18:04:45.912439] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:45.944589] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T18:04:46.396741] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-09T18:04:47.196683] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-09T18:04:47.237290] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T18:04:47.256353] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T18:04:47.996763] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-09T18:04:48.796720] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-09T18:04:48.833834] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T18:04:48.838607] [INFO ] [REMOTE ] CLVT: Full fetch complete (75227 records). [2025-10-09T18:04:48.838769] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-09T18:04:49.227548] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-09T18:04:49.227624] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-09T18:04:49.228420] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-09T18:04:49.228484] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-09T18:04:49.230097] [DEBUG] [LOCAL ] CLVT: Trimmed 75227 records to 52362 (keeping 200 days of data) [2025-10-09T18:04:49.516901] [DEBUG] [LOCAL ] CLVT: Primary data saved (52362 records). [2025-10-09T18:04:49.517035] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-09T18:04:49.518120] [INFO ] [MAIN ] Update Progress: 469/2373 symbols completed. CLVT took 38.0s. Estimated remaining: 4h 22m 56s. Rate: 7.2 symbols/min [2025-10-09T18:04:49.622470] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-09T18:04:49.698033] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:49.732305] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:04:49.751157] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T18:04:49.754600] [INFO ] [REMOTE ] CLW: Full fetch complete (34465 records). [2025-10-09T18:04:49.754722] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-09T18:04:49.961295] [DEBUG] [LOCAL ] CMA: Loaded 49919 existing records from primary storage. [2025-10-09T18:04:49.984699] [INFO ] [MAIN ] CMA: Loaded 49919 existing records. [2025-10-09T18:04:50.352385] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:50.375476] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-09T18:04:50.382836] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-09T18:04:50.399497] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-09T18:04:50.400850] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-09T18:04:50.405117] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-09T18:04:50.446913] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-09T18:04:50.472632] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-09T18:04:50.488397] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-09T18:04:50.499566] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-09T18:04:50.528172] [DEBUG] [LOCAL ] CLW: Trimmed 34465 records to 21847 (keeping 200 days of data) [2025-10-09T18:04:50.919497] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:50.923496] [DEBUG] [LOCAL ] CLW: Primary data saved (21847 records). [2025-10-09T18:04:50.923693] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-09T18:04:50.923825] [INFO ] [MAIN ] Update Progress: 470/2373 symbols completed. CLW took 29.8s. Estimated remaining: 4h 22m 20s. Rate: 7.3 symbols/min [2025-10-09T18:04:51.130447] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:51.156435] [DEBUG] [LOCAL ] CMBT: Loaded 24761 existing records from primary storage. [2025-10-09T18:04:51.156905] [INFO ] [MAIN ] CMBT: Loaded 24761 existing records. [2025-10-09T18:04:51.211377] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-09T18:04:51.374779] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:51.375155] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-09T18:04:51.375244] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-09T18:04:51.384827] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-09T18:04:51.390204] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-09T18:04:51.461520] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T18:04:51.854106] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:04:51.996704] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-09T18:04:52.188251] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T18:04:52.796721] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-09T18:04:53.116355] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T18:04:53.496213] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T18:04:53.596683] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-09T18:04:53.930268] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T18:04:54.396725] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-09T18:04:55.060913] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:04:55.196689] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-09T18:04:55.253634] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T18:04:55.996735] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-09T18:04:56.796733] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-09T18:04:56.857018] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T18:04:57.596776] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-09T18:04:57.626029] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T18:04:58.396706] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-09T18:04:58.709746] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-09T18:04:58.714131] [INFO ] [REMOTE ] CLX: Full fetch complete (73241 records). [2025-10-09T18:04:58.714233] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-09T18:04:59.113425] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-09T18:04:59.113540] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-09T18:04:59.114506] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-09T18:04:59.114614] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-09T18:04:59.116285] [DEBUG] [LOCAL ] CLX: Trimmed 73241 records to 51973 (keeping 200 days of data) [2025-10-09T18:04:59.202980] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-09T18:04:59.264200] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:04:59.515895] [DEBUG] [LOCAL ] CLX: Primary data saved (51973 records). [2025-10-09T18:04:59.516026] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-09T18:04:59.516129] [INFO ] [MAIN ] Update Progress: 471/2373 symbols completed. CLX took 37.0s. Estimated remaining: 4h 22m 13s. Rate: 7.3 symbols/min [2025-10-09T18:04:59.711592] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:04:59.780198] [DEBUG] [LOCAL ] CMC: Loaded 45379 existing records from primary storage. [2025-10-09T18:04:59.781580] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:04:59.791688] [INFO ] [MAIN ] CMC: Loaded 45379 existing records. [2025-10-09T18:04:59.972066] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:04:59.972245] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-09T18:04:59.972291] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-09T18:04:59.972548] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-09T18:04:59.972606] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-09T18:05:00.002735] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-09T18:05:00.230859] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T18:05:00.341278] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:00.796695] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-09T18:05:01.596734] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-09T18:05:01.904461] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T18:05:02.047820] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-09T18:05:02.396764] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-09T18:05:03.196707] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-09T18:05:03.268226] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T18:05:03.569724] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T18:05:03.996782] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-09T18:05:04.796686] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-09T18:05:05.132852] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T18:05:05.144207] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T18:05:05.596732] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-09T18:05:06.396714] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-09T18:05:06.469950] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T18:05:07.196685] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-09T18:05:07.254443] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T18:05:07.944535] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T18:05:07.996669] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-09T18:05:08.385184] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T18:05:08.796701] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-09T18:05:09.388925] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T18:05:09.596734] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-09T18:05:09.757471] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T18:05:10.396744] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-09T18:05:11.196703] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-09T18:05:11.311276] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T18:05:11.996689] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-09T18:05:12.143517] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T18:05:12.188884] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T18:05:12.796783] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-09T18:05:13.596687] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-09T18:05:13.820282] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T18:05:14.396788] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-09T18:05:14.592884] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T18:05:14.771093] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T18:05:15.196771] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-09T18:05:15.996673] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-09T18:05:16.356818] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T18:05:16.796696] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-09T18:05:17.023513] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T18:05:17.596737] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-09T18:05:17.834227] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T18:05:18.396768] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-09T18:05:18.803536] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-09T18:05:18.807841] [INFO ] [REMOTE ] CM: Full fetch complete (69583 records). [2025-10-09T18:05:18.807987] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-09T18:05:19.199298] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-09T18:05:19.240632] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-09T18:05:19.240865] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-09T18:05:19.241811] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-09T18:05:19.242061] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-09T18:05:19.253999] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T18:05:19.259014] [INFO ] [REMOTE ] CMBT: Full fetch complete (31618 records). [2025-10-09T18:05:19.259118] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-09T18:05:19.259400] [DEBUG] [LOCAL ] CM: Trimmed 69583 records to 49101 (keeping 200 days of data) [2025-10-09T18:05:19.744303] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-09T18:05:19.745293] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-09T18:05:19.747132] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-09T18:05:19.747459] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-09T18:05:19.752586] [DEBUG] [LOCAL ] CMBT: Trimmed 31618 records to 25145 (keeping 200 days of data) [2025-10-09T18:05:19.994320] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T18:05:20.011567] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-09T18:05:20.103883] [DEBUG] [LOCAL ] CMBT: Primary data saved (25145 records). [2025-10-09T18:05:20.104605] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-09T18:05:20.104755] [INFO ] [MAIN ] Update Progress: 472/2373 symbols completed. CMBT took 29.2s. Estimated remaining: 4h 22m 54s. Rate: 7.2 symbols/min [2025-10-09T18:05:20.348260] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:05:20.351402] [DEBUG] [LOCAL ] CM: Primary data saved (49101 records). [2025-10-09T18:05:20.351998] [INFO ] [MAIN ] CM: Full history saved. [2025-10-09T18:05:20.352531] [INFO ] [MAIN ] Update Progress: 473/2373 symbols completed. CM took 35.3s. Estimated remaining: 4h 22m 13s. Rate: 7.2 symbols/min [2025-10-09T18:05:20.452404] [DEBUG] [LOCAL ] CMCM: Loaded 4735 existing records from primary storage. [2025-10-09T18:05:20.466280] [INFO ] [MAIN ] CMCM: Loaded 4735 existing records. [2025-10-09T18:05:20.687907] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:05:20.721079] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-09T18:05:20.721176] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-09T18:05:20.721328] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-09T18:05:20.721404] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-09T18:05:20.721473] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-09T18:05:20.743626] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-09T18:05:20.743484] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:05:20.744123] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-09T18:05:20.765002] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-09T18:05:20.787265] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-09T18:05:20.807772] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-09T18:05:21.280298] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:21.297935] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-09T18:05:21.437347] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-09T18:05:21.527999] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:21.596685] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-09T18:05:21.660119] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:05:21.660493] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-09T18:05:21.660582] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:05:21.660628] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-09T18:05:21.660715] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:05:21.660786] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-09T18:05:21.660849] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-09T18:05:21.660884] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-09T18:05:21.660923] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-09T18:05:21.660972] [INFO ] [MAIN ] Update Progress: 474/2373 symbols completed. CMDB took 1.3s. Estimated remaining: 4h 21m 37s. Rate: 7.3 symbols/min [2025-10-09T18:05:21.865526] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:05:21.866438] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T18:05:21.928689] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-09T18:05:21.929090] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-10-09T18:05:22.102659] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:05:22.102905] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-09T18:05:22.102952] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-09T18:05:22.103173] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-09T18:05:22.103231] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-09T18:05:22.401977] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-09T18:05:22.463054] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:23.196750] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-09T18:05:23.382707] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T18:05:23.682112] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T18:05:23.996746] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-09T18:05:24.796757] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-09T18:05:25.342788] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T18:05:25.574538] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-09T18:05:25.596668] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-09T18:05:25.991737] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T18:05:26.396727] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-09T18:05:27.160586] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T18:05:27.196666] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-09T18:05:27.537948] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T18:05:27.652412] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T18:05:27.996733] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-09T18:05:28.796707] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-09T18:05:29.596754] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-09T18:05:29.894608] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T18:05:30.396692] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-09T18:05:30.838896] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-09T18:05:31.196749] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-09T18:05:31.521449] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-09T18:05:31.996718] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-09T18:05:32.796750] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-09T18:05:33.266456] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (5.27 seconds). [2025-10-09T18:05:33.596699] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-09T18:05:33.859009] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (4.26 seconds). [2025-10-09T18:05:33.863059] [INFO ] [REMOTE ] CMA: Full fetch complete (72724 records). [2025-10-09T18:05:33.863177] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-09T18:05:33.864042] [FATAL] [VALIDATOR ] CMA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:05:33.864133] [FATAL] [MAIN ] CMA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:05:33.864177] [WARN ] [MAIN ] CMA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:05:33.864242] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-09T18:05:33.864348] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-09T18:05:33.864400] [INFO ] [LOCAL ] CMA: Starting deletion of derivative data. [2025-10-09T18:05:33.864703] [DEBUG] [LOCAL ] CMA: Deleted derivative data file. [2025-10-09T18:05:33.865917] [INFO ] [MAIN ] Update Progress: 475/2373 symbols completed. CMA took 44.3s. Estimated remaining: 4h 21m 45s. Rate: 7.3 symbols/min [2025-10-09T18:05:33.940789] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T18:05:34.057095] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:05:34.085416] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T18:05:34.130346] [DEBUG] [LOCAL ] CMI: Loaded 41656 existing records from primary storage. [2025-10-09T18:05:34.130685] [INFO ] [MAIN ] CMI: Loaded 41656 existing records. [2025-10-09T18:05:34.313264] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:05:34.313505] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-09T18:05:34.313552] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-09T18:05:34.313853] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-09T18:05:34.313911] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-09T18:05:34.401909] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-09T18:05:34.704142] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:35.196759] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-09T18:05:35.780105] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-09T18:05:35.996695] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-09T18:05:36.236721] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T18:05:36.240303] [INFO ] [REMOTE ] CMC: Full fetch complete (66503 records). [2025-10-09T18:05:36.240431] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-09T18:05:36.241159] [FATAL] [VALIDATOR ] CMC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:05:36.241278] [FATAL] [MAIN ] CMC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:05:36.241323] [WARN ] [MAIN ] CMC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:05:36.241363] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-09T18:05:36.241418] [DEBUG] [LOCAL ] CMC: No primary data file found to delete. [2025-10-09T18:05:36.241454] [INFO ] [LOCAL ] CMC: Starting deletion of derivative data. [2025-10-09T18:05:36.241680] [DEBUG] [LOCAL ] CMC: Deleted derivative data file. [2025-10-09T18:05:36.241777] [INFO ] [MAIN ] Update Progress: 476/2373 symbols completed. CMC took 36.7s. Estimated remaining: 4h 21m 13s. Rate: 7.3 symbols/min [2025-10-09T18:05:36.410496] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:05:36.444277] [DEBUG] [LOCAL ] CMP: Loaded 36066 existing records from primary storage. [2025-10-09T18:05:36.444572] [INFO ] [MAIN ] CMP: Loaded 36066 existing records. [2025-10-09T18:05:36.567890] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T18:05:36.626584] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:05:36.626951] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-09T18:05:36.627110] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-09T18:05:36.627361] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-09T18:05:36.627419] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-09T18:05:36.804567] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-09T18:05:37.012078] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:05:37.013559] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T18:05:37.596757] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-09T18:05:37.625082] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T18:05:38.396727] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-09T18:05:38.862148] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T18:05:38.963359] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T18:05:39.196709] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-09T18:05:39.995191] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T18:05:39.998618] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-09T18:05:40.796709] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-09T18:05:41.274866] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T18:05:41.596753] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-09T18:05:42.088359] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T18:05:42.089369] [INFO ] [REMOTE ] CMCM: Full fetch complete (6851 records). [2025-10-09T18:05:42.089438] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-09T18:05:42.401871] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-09T18:05:42.459475] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-09T18:05:42.459558] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-09T18:05:42.459789] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-09T18:05:42.459852] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-09T18:05:42.460331] [DEBUG] [LOCAL ] CMCM: Trimmed 6851 records to 4766 (keeping 200 days of data) [2025-10-09T18:05:42.488416] [DEBUG] [LOCAL ] CMCM: Primary data saved (4766 records). [2025-10-09T18:05:42.488562] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-09T18:05:42.488672] [INFO ] [MAIN ] Update Progress: 477/2373 symbols completed. CMCM took 22.4s. Estimated remaining: 4h 20m 57s. Rate: 7.3 symbols/min [2025-10-09T18:05:42.992958] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-09T18:05:43.196702] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-09T18:05:43.802816] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T18:05:43.996699] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-09T18:05:44.298459] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T18:05:44.796774] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-09T18:05:45.334940] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T18:05:45.596785] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-09T18:05:46.396778] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-09T18:05:47.012703] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-09T18:05:47.119226] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:05:47.196669] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-09T18:05:47.996750] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-09T18:05:48.184071] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T18:05:48.659594] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T18:05:48.796760] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-09T18:05:49.596799] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-09T18:05:49.727932] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T18:05:50.319367] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T18:05:50.396673] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-09T18:05:51.083187] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T18:05:51.196723] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-09T18:05:51.627933] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:05:51.996741] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-09T18:05:52.796780] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-09T18:05:53.527753] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-09T18:05:53.596731] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-09T18:05:53.936960] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T18:05:53.946862] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T18:05:54.396714] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-09T18:05:55.196784] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-09T18:05:55.776545] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-09T18:05:55.953333] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T18:05:55.996714] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-09T18:05:56.729874] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:05:56.796721] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-09T18:05:57.596711] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-09T18:05:57.679922] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T18:05:57.683609] [INFO ] [REMOTE ] CMI: Full fetch complete (60185 records). [2025-10-09T18:05:57.683742] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-09T18:05:58.110721] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-09T18:05:58.118475] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-09T18:05:58.129775] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-09T18:05:58.132205] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-09T18:05:58.134757] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:05:58.134866] [DEBUG] [LOCAL ] CMI: Trimmed 60185 records to 41934 (keeping 200 days of data) [2025-10-09T18:05:58.398943] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-09T18:05:58.404853] [DEBUG] [LOCAL ] CMI: Primary data saved (41934 records). [2025-10-09T18:05:58.405681] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-09T18:05:58.406820] [INFO ] [MAIN ] Update Progress: 478/2373 symbols completed. CMI took 24.5s. Estimated remaining: 4h 21m 19s. Rate: 7.3 symbols/min [2025-10-09T18:05:59.907270] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T18:05:59.916291] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-09T18:05:59.951673] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-09T18:05:59.996677] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-09T18:06:00.782007] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T18:06:00.786588] [INFO ] [REMOTE ] CMG: Full fetch complete (77796 records). [2025-10-09T18:06:00.786745] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-09T18:06:01.184339] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-09T18:06:01.184477] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-09T18:06:01.185462] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-09T18:06:01.185567] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-09T18:06:01.187154] [DEBUG] [LOCAL ] CMG: Trimmed 77796 records to 54111 (keeping 200 days of data) [2025-10-09T18:06:01.517190] [DEBUG] [LOCAL ] CMG: Primary data saved (54111 records). [2025-10-09T18:06:01.517328] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-09T18:06:01.517887] [INFO ] [MAIN ] Update Progress: 479/2373 symbols completed. CMG took 39.9s. Estimated remaining: 4h 20m 50s. Rate: 7.3 symbols/min [2025-10-09T18:06:01.571181] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:06:01.578313] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-09T18:06:02.568790] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T18:06:02.578453] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-09T18:06:03.764565] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T18:06:03.767300] [INFO ] [REMOTE ] CMP: Full fetch complete (51955 records). [2025-10-09T18:06:03.767386] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-09T18:06:04.169072] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-09T18:06:04.169157] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-09T18:06:04.169870] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-09T18:06:04.169938] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-09T18:06:04.171129] [DEBUG] [LOCAL ] CMP: Trimmed 51955 records to 36351 (keeping 200 days of data) [2025-10-09T18:06:04.388318] [DEBUG] [LOCAL ] CMP: Primary data saved (36351 records). [2025-10-09T18:06:04.388457] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-09T18:06:04.388554] [INFO ] [MAIN ] Update Progress: 480/2373 symbols completed. CMP took 28.1s. Estimated remaining: 4h 20m 21s. Rate: 7.3 symbols/min [2025-10-09T18:06:04.954638] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:05.070245] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:05.092882] [DEBUG] [LOCAL ] CMRE: No existing data file found in primary storage. [2025-10-09T18:06:05.156138] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:05.160012] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:05.156277] [WARN ] [MAIN ] CMRE: No existing data found, performing full refresh instead. [2025-10-09T18:06:05.161559] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-09T18:06:05.162263] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-09T18:06:05.162854] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-09T18:06:05.162966] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-09T18:06:05.248120] [DEBUG] [LOCAL ] CMSA: Loaded 3509 existing records from primary storage. [2025-10-09T18:06:05.282166] [INFO ] [MAIN ] CMSA: Loaded 3509 existing records. [2025-10-09T18:06:05.596052] [DEBUG] [LOCAL ] CMS: Loaded 52610 existing records from primary storage. [2025-10-09T18:06:05.627053] [INFO ] [MAIN ] CMS: Loaded 52610 existing records. [2025-10-09T18:06:05.606416] [DEBUG] [LOCAL ] CMPO: Loaded 38977 existing records from primary storage. [2025-10-09T18:06:05.750260] [INFO ] [MAIN ] CMPO: Loaded 38977 existing records. [2025-10-09T18:06:05.790803] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:05.823528] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-09T18:06:05.894122] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-09T18:06:05.962731] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-09T18:06:06.020186] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-09T18:06:06.070916] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:06.113859] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-09T18:06:06.206506] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:06.243571] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-09T18:06:06.286055] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-09T18:06:06.314263] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:06.330031] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-09T18:06:06.345278] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-09T18:06:06.329942] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-09T18:06:06.350567] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-09T18:06:06.367440] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-09T18:06:06.402322] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-09T18:06:06.982551] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:07.000233] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-09T18:06:07.275426] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:07.285997] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-09T18:06:07.343017] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:07.343443] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-09T18:06:07.641335] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:06:07.642313] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T18:06:07.649739] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-09T18:06:07.650471] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-09T18:06:08.217808] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T18:06:08.219360] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-09T18:06:08.550523] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T18:06:08.558969] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-09T18:06:08.613077] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-09T18:06:08.796701] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-09T18:06:09.059545] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T18:06:09.094784] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T18:06:09.265298] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T18:06:09.596735] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-09T18:06:09.792016] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T18:06:10.396743] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-09T18:06:11.202866] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-09T18:06:11.222161] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:06:11.454485] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T18:06:11.996777] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-09T18:06:12.647285] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T18:06:12.796714] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-09T18:06:13.596702] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-09T18:06:13.794623] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T18:06:13.997963] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-09T18:06:14.291187] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T18:06:14.396703] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-09T18:06:15.196769] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-09T18:06:15.996698] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-09T18:06:16.091907] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T18:06:16.796690] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-09T18:06:16.851807] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T18:06:17.467815] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T18:06:17.596765] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-09T18:06:18.206961] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T18:06:18.396685] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-09T18:06:19.028566] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T18:06:19.196752] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-09T18:06:19.906835] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T18:06:19.996698] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-09T18:06:20.796686] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-09T18:06:21.117759] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T18:06:21.484864] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T18:06:21.596664] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-09T18:06:21.617064] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T18:06:22.396726] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-09T18:06:22.992099] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T18:06:23.196745] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-09T18:06:23.983130] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:06:23.996664] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-09T18:06:24.585505] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T18:06:24.796705] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-09T18:06:25.596686] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-09T18:06:25.683090] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T18:06:25.897803] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:06:25.900991] [INFO ] [REMOTE ] CMPO: Full fetch complete (58637 records). [2025-10-09T18:06:25.901084] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-09T18:06:26.273532] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-09T18:06:26.273608] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-09T18:06:26.274283] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-09T18:06:26.274346] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-09T18:06:26.275457] [DEBUG] [LOCAL ] CMPO: Trimmed 58637 records to 39261 (keeping 200 days of data) [2025-10-09T18:06:26.396762] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-09T18:06:26.515746] [DEBUG] [LOCAL ] CMPO: Primary data saved (39261 records). [2025-10-09T18:06:26.515924] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-09T18:06:26.516017] [INFO ] [MAIN ] Update Progress: 481/2373 symbols completed. CMPO took 22.1s. Estimated remaining: 4h 21m 7s. Rate: 7.2 symbols/min [2025-10-09T18:06:26.704868] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:26.712480] [DEBUG] [LOCAL ] CMSC: Loaded 5006 existing records from primary storage. [2025-10-09T18:06:26.712711] [INFO ] [MAIN ] CMSC: Loaded 5006 existing records. [2025-10-09T18:06:26.910792] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:26.911233] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-09T18:06:26.911349] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-09T18:06:26.911558] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-09T18:06:26.911616] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-09T18:06:27.036419] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T18:06:27.056234] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T18:06:27.201832] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-09T18:06:27.308824] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:27.996715] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-09T18:06:28.529149] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T18:06:28.658575] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T18:06:28.796691] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-09T18:06:29.596722] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-09T18:06:30.396691] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-09T18:06:30.574850] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T18:06:30.727798] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T18:06:31.117846] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T18:06:31.196728] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-09T18:06:31.996756] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-09T18:06:32.764027] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T18:06:32.796748] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-09T18:06:33.031631] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T18:06:33.110528] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-09T18:06:33.596721] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-09T18:06:34.004263] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-09T18:06:34.396745] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-09T18:06:35.196737] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-09T18:06:35.772889] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T18:06:35.996785] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-09T18:06:36.549233] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-09T18:06:36.723744] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T18:06:36.727564] [INFO ] [REMOTE ] CMS: Full fetch complete (75600 records). [2025-10-09T18:06:36.727705] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-09T18:06:36.728498] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:06:36.728587] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:06:36.728630] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:06:36.728718] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-09T18:06:36.728800] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-09T18:06:36.728852] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-09T18:06:36.729086] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-10-09T18:06:36.729182] [INFO ] [MAIN ] Update Progress: 482/2373 symbols completed. CMS took 32.3s. Estimated remaining: 4h 21m 6s. Rate: 7.2 symbols/min [2025-10-09T18:06:36.801900] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-09T18:06:36.901760] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:36.911000] [DEBUG] [LOCAL ] CMSD: Loaded 8001 existing records from primary storage. [2025-10-09T18:06:36.911175] [INFO ] [MAIN ] CMSD: Loaded 8001 existing records. [2025-10-09T18:06:37.117180] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:37.117388] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-09T18:06:37.117434] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-09T18:06:37.117632] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-09T18:06:37.117724] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-09T18:06:37.483244] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:37.487850] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T18:06:37.596678] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-09T18:06:38.099672] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T18:06:38.100489] [INFO ] [REMOTE ] CMSA: Full fetch complete (5060 records). [2025-10-09T18:06:38.100563] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-09T18:06:38.101035] [FATAL] [VALIDATOR ] CMSA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:06:38.101100] [FATAL] [MAIN ] CMSA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:06:38.101138] [WARN ] [MAIN ] CMSA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:06:38.101180] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-09T18:06:38.101236] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-09T18:06:38.101337] [INFO ] [LOCAL ] CMSA: Starting deletion of derivative data. [2025-10-09T18:06:38.101491] [DEBUG] [LOCAL ] CMSA: Deleted derivative data file. [2025-10-09T18:06:38.101593] [INFO ] [MAIN ] Update Progress: 483/2373 symbols completed. CMSA took 33.7s. Estimated remaining: 4h 20m 31s. Rate: 7.3 symbols/min [2025-10-09T18:06:38.272762] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:38.310824] [DEBUG] [LOCAL ] CMTG: Loaded 36233 existing records from primary storage. [2025-10-09T18:06:38.311126] [INFO ] [MAIN ] CMTG: Loaded 36233 existing records. [2025-10-09T18:06:38.401893] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-09T18:06:38.495056] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:38.495238] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-09T18:06:38.495287] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-09T18:06:38.495587] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-09T18:06:38.495678] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-09T18:06:38.843063] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:39.196679] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-09T18:06:39.547634] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T18:06:39.996732] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-09T18:06:40.733686] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T18:06:40.796772] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-09T18:06:41.192516] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T18:06:41.554899] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T18:06:41.596780] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-09T18:06:42.396780] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-09T18:06:42.922849] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T18:06:43.196757] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-09T18:06:43.754505] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T18:06:43.996698] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-09T18:06:44.620103] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T18:06:44.796690] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-09T18:06:44.844824] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T18:06:45.596692] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-09T18:06:45.998493] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T18:06:46.001812] [INFO ] [REMOTE ] CMRE: Full fetch complete (50565 records). [2025-10-09T18:06:46.001923] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-09T18:06:46.275436] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T18:06:46.391524] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-09T18:06:46.391610] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-09T18:06:46.392271] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-09T18:06:46.392336] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-09T18:06:46.393409] [DEBUG] [LOCAL ] CMRE: Trimmed 50565 records to 35870 (keeping 200 days of data) [2025-10-09T18:06:46.396692] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-09T18:06:46.627627] [DEBUG] [LOCAL ] CMRE: Primary data saved (35870 records). [2025-10-09T18:06:46.627800] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-09T18:06:46.627937] [INFO ] [MAIN ] Update Progress: 484/2373 symbols completed. CMRE took 42.2s. Estimated remaining: 4h 20m 24s. Rate: 7.3 symbols/min [2025-10-09T18:06:46.795392] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:46.803632] [DEBUG] [LOCAL ] CMU: Loaded 6347 existing records from primary storage. [2025-10-09T18:06:46.803850] [INFO ] [MAIN ] CMU: Loaded 6347 existing records. [2025-10-09T18:06:46.983949] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:46.984221] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-09T18:06:46.984302] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-09T18:06:46.984514] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-09T18:06:46.984571] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-09T18:06:47.089473] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-09T18:06:47.201899] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-09T18:06:47.342802] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:47.996715] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-09T18:06:48.512416] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T18:06:48.627967] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-09T18:06:48.796706] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-09T18:06:49.480613] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T18:06:49.596668] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-09T18:06:49.996790] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T18:06:50.396744] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-09T18:06:51.196720] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-09T18:06:51.826833] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T18:06:51.937232] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T18:06:51.996720] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-09T18:06:52.738956] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T18:06:52.796674] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-09T18:06:53.426660] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T18:06:53.596734] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-09T18:06:54.396730] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-09T18:06:54.827115] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T18:06:55.189265] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T18:06:55.196670] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-09T18:06:55.808594] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T18:06:55.996715] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-09T18:06:56.728419] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T18:06:56.796682] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-09T18:06:57.422476] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T18:06:57.423619] [INFO ] [REMOTE ] CMSC: Full fetch complete (7126 records). [2025-10-09T18:06:57.423738] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-09T18:06:57.601793] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-09T18:06:57.876004] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-09T18:06:57.876082] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-09T18:06:57.876283] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-09T18:06:57.876323] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-09T18:06:57.876834] [DEBUG] [LOCAL ] CMSC: Trimmed 7126 records to 5017 (keeping 200 days of data) [2025-10-09T18:06:57.911561] [DEBUG] [LOCAL ] CMSC: Primary data saved (5017 records). [2025-10-09T18:06:57.911696] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-09T18:06:57.911811] [INFO ] [MAIN ] Update Progress: 485/2373 symbols completed. CMSC took 31.4s. Estimated remaining: 4h 20m 27s. Rate: 7.2 symbols/min [2025-10-09T18:06:58.114274] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:06:58.147971] [DEBUG] [LOCAL ] CNA: Loaded 32849 existing records from primary storage. [2025-10-09T18:06:58.148283] [INFO ] [MAIN ] CNA: Loaded 32849 existing records. [2025-10-09T18:06:58.340467] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:06:58.340712] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-09T18:06:58.340770] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-09T18:06:58.341107] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-09T18:06:58.341165] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-09T18:06:58.401945] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-09T18:06:58.690016] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:06:59.097573] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T18:06:59.156325] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T18:06:59.196670] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-09T18:06:59.996691] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-09T18:07:00.155915] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T18:07:00.796787] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-09T18:07:00.807224] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T18:07:01.540792] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T18:07:01.596707] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-09T18:07:02.231486] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T18:07:02.396760] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-09T18:07:03.039490] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T18:07:03.196709] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-09T18:07:03.994879] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T18:07:03.997588] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-09T18:07:04.590100] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:07:04.591230] [INFO ] [REMOTE ] CMSD: Full fetch complete (12092 records). [2025-10-09T18:07:04.591299] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-09T18:07:04.805206] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-09T18:07:04.964235] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-09T18:07:04.964313] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-09T18:07:04.964600] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-09T18:07:04.964639] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-09T18:07:04.965125] [DEBUG] [LOCAL ] CMSD: Trimmed 12092 records to 8044 (keeping 200 days of data) [2025-10-09T18:07:05.014660] [DEBUG] [LOCAL ] CMSD: Primary data saved (8044 records). [2025-10-09T18:07:05.014799] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-09T18:07:05.014884] [INFO ] [MAIN ] Update Progress: 486/2373 symbols completed. CMSD took 28.3s. Estimated remaining: 4h 20m 14s. Rate: 7.3 symbols/min [2025-10-09T18:07:05.188203] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:05.238815] [DEBUG] [LOCAL ] CNC: Loaded 53755 existing records from primary storage. [2025-10-09T18:07:05.239193] [INFO ] [MAIN ] CNC: Loaded 53755 existing records. [2025-10-09T18:07:05.349089] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T18:07:05.420153] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:07:05.420384] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-09T18:07:05.420442] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-09T18:07:05.420838] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-09T18:07:05.420898] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-09T18:07:05.604759] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-09T18:07:05.781470] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:06.396721] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-09T18:07:07.107288] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T18:07:07.196759] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-09T18:07:07.996694] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-09T18:07:08.346865] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T18:07:08.463562] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T18:07:08.796732] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-09T18:07:08.886029] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T18:07:09.596771] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-09T18:07:10.384512] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T18:07:10.396684] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-09T18:07:10.502052] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T18:07:11.121509] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T18:07:11.196704] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-09T18:07:11.996718] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-09T18:07:12.147623] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T18:07:12.796685] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-09T18:07:13.596689] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-09T18:07:13.812766] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:07:14.107026] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T18:07:14.396715] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-09T18:07:14.627079] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T18:07:15.196720] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-09T18:07:15.699400] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T18:07:15.702168] [INFO ] [REMOTE ] CMTG: Full fetch complete (53444 records). [2025-10-09T18:07:15.702246] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-09T18:07:16.005167] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-09T18:07:16.102778] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-09T18:07:16.102864] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-09T18:07:16.103592] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-09T18:07:16.103636] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-09T18:07:16.104790] [DEBUG] [LOCAL ] CMTG: Trimmed 53444 records to 36441 (keeping 200 days of data) [2025-10-09T18:07:16.324857] [DEBUG] [LOCAL ] CMTG: Primary data saved (36441 records). [2025-10-09T18:07:16.324991] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-09T18:07:16.325085] [INFO ] [MAIN ] Update Progress: 487/2373 symbols completed. CMTG took 38.2s. Estimated remaining: 4h 20m 18s. Rate: 7.2 symbols/min [2025-10-09T18:07:16.498765] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:16.511503] [DEBUG] [LOCAL ] CNF: Loaded 10508 existing records from primary storage. [2025-10-09T18:07:16.511750] [INFO ] [MAIN ] CNF: Loaded 10508 existing records. [2025-10-09T18:07:16.714744] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:07:16.716355] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:07:16.718944] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-09T18:07:16.723238] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-09T18:07:16.723712] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-09T18:07:16.723769] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-09T18:07:16.801792] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-09T18:07:16.958076] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-09T18:07:17.114935] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:17.596725] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-09T18:07:18.396741] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-09T18:07:18.709602] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T18:07:18.785245] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:07:19.016919] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T18:07:19.196710] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-09T18:07:19.996781] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-09T18:07:20.482773] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T18:07:20.578845] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T18:07:20.796718] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-09T18:07:21.369928] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T18:07:21.370855] [INFO ] [REMOTE ] CMU: Full fetch complete (9566 records). [2025-10-09T18:07:21.370924] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-09T18:07:21.602438] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-09T18:07:21.775023] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-09T18:07:21.775112] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-09T18:07:21.775427] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-09T18:07:21.775467] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-09T18:07:21.776000] [DEBUG] [LOCAL ] CMU: Trimmed 9566 records to 6361 (keeping 200 days of data) [2025-10-09T18:07:21.823638] [DEBUG] [LOCAL ] CMU: Primary data saved (6361 records). [2025-10-09T18:07:21.823850] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-09T18:07:21.823966] [INFO ] [MAIN ] Update Progress: 488/2373 symbols completed. CMU took 35.2s. Estimated remaining: 4h 19m 59s. Rate: 7.3 symbols/min [2025-10-09T18:07:21.994290] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:22.047697] [DEBUG] [LOCAL ] CNH: Loaded 53551 existing records from primary storage. [2025-10-09T18:07:22.048056] [INFO ] [MAIN ] CNH: Loaded 53551 existing records. [2025-10-09T18:07:22.220089] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:07:22.220309] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-09T18:07:22.220356] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-09T18:07:22.220601] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-09T18:07:22.220694] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-09T18:07:22.403791] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-09T18:07:22.568375] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:23.196699] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-09T18:07:23.306312] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T18:07:23.738070] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T18:07:23.996686] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-09T18:07:24.236797] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T18:07:24.796780] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-09T18:07:25.189398] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-09T18:07:25.397123] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T18:07:25.596726] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-09T18:07:26.021321] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-09T18:07:26.396723] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-09T18:07:27.161738] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-09T18:07:27.196678] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-09T18:07:27.766317] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T18:07:27.996702] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-09T18:07:28.744148] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T18:07:28.796707] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-09T18:07:29.505981] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T18:07:29.596764] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-09T18:07:30.396791] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-09T18:07:31.151233] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T18:07:31.196707] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-09T18:07:31.494463] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T18:07:31.996734] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-09T18:07:32.796710] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-09T18:07:32.924458] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:07:33.334105] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:07:33.596810] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-09T18:07:33.774959] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:07:34.396754] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-09T18:07:35.196684] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-09T18:07:35.302250] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T18:07:35.398720] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T18:07:35.996720] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-09T18:07:36.583945] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T18:07:36.796694] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-09T18:07:37.326824] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T18:07:37.596725] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-09T18:07:38.042357] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T18:07:38.045388] [INFO ] [REMOTE ] CNA: Full fetch complete (45710 records). [2025-10-09T18:07:38.045491] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-09T18:07:38.401960] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-09T18:07:38.446999] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-09T18:07:38.447097] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-09T18:07:38.447768] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-09T18:07:38.447836] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-09T18:07:38.449211] [DEBUG] [LOCAL ] CNA: Trimmed 45710 records to 33082 (keeping 200 days of data) [2025-10-09T18:07:38.658485] [DEBUG] [LOCAL ] CNA: Primary data saved (33082 records). [2025-10-09T18:07:38.658635] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-09T18:07:38.658770] [INFO ] [MAIN ] Update Progress: 489/2373 symbols completed. CNA took 40.7s. Estimated remaining: 4h 20m 23s. Rate: 7.2 symbols/min [2025-10-09T18:07:38.831347] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:38.831579] [DEBUG] [LOCAL ] CNI: No existing data file found in primary storage. [2025-10-09T18:07:38.831635] [WARN ] [MAIN ] CNI: No existing data found, performing full refresh instead. [2025-10-09T18:07:38.831778] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-09T18:07:38.831822] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-09T18:07:38.831864] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-09T18:07:38.831896] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-09T18:07:39.198131] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-09T18:07:39.201584] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:39.486049] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T18:07:39.858823] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T18:07:39.860082] [INFO ] [REMOTE ] CNF: Full fetch complete (13175 records). [2025-10-09T18:07:39.860173] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-09T18:07:40.001814] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-09T18:07:40.261487] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-09T18:07:40.261570] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-09T18:07:40.261914] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-09T18:07:40.261976] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-09T18:07:40.262476] [DEBUG] [LOCAL ] CNF: Trimmed 13175 records to 10597 (keeping 200 days of data) [2025-10-09T18:07:40.336316] [DEBUG] [LOCAL ] CNF: Primary data saved (10597 records). [2025-10-09T18:07:40.336466] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-09T18:07:40.336554] [INFO ] [MAIN ] Update Progress: 490/2373 symbols completed. CNF took 24.0s. Estimated remaining: 4h 19m 50s. Rate: 7.2 symbols/min [2025-10-09T18:07:40.511079] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:40.561157] [DEBUG] [LOCAL ] CNK: Loaded 52888 existing records from primary storage. [2025-10-09T18:07:40.561476] [INFO ] [MAIN ] CNK: Loaded 52888 existing records. [2025-10-09T18:07:40.752515] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:07:40.752905] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-09T18:07:40.753023] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-09T18:07:40.753329] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-09T18:07:40.753388] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-09T18:07:40.807341] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-09T18:07:41.118387] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:41.151782] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-09T18:07:41.509379] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T18:07:41.596726] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-09T18:07:42.396710] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-09T18:07:42.621749] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T18:07:43.196715] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-09T18:07:43.805380] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-09T18:07:43.884443] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T18:07:43.996708] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-09T18:07:44.702119] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T18:07:44.796686] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-09T18:07:45.202599] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:07:45.596766] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-09T18:07:46.396722] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-09T18:07:46.992215] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-09T18:07:47.196711] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-09T18:07:47.250456] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T18:07:47.996685] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-09T18:07:48.078976] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T18:07:48.788477] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T18:07:48.798685] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-09T18:07:49.294497] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T18:07:49.596768] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-09T18:07:50.396744] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-09T18:07:50.555521] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T18:07:51.196729] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-09T18:07:51.251745] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T18:07:51.996771] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-09T18:07:52.572606] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-09T18:07:52.578298] [INFO ] [REMOTE ] CNC: Full fetch complete (77674 records). [2025-10-09T18:07:52.578445] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-09T18:07:52.799258] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-09T18:07:53.077200] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-09T18:07:53.077320] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-09T18:07:53.078393] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-09T18:07:53.078562] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-09T18:07:53.092927] [DEBUG] [LOCAL ] CNC: Trimmed 77674 records to 54145 (keeping 200 days of data) [2025-10-09T18:07:53.119768] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T18:07:53.547095] [DEBUG] [LOCAL ] CNC: Primary data saved (54145 records). [2025-10-09T18:07:53.547264] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-09T18:07:53.547946] [INFO ] [MAIN ] Update Progress: 491/2373 symbols completed. CNC took 48.5s. Estimated remaining: 4h 20m 0s. Rate: 7.2 symbols/min [2025-10-09T18:07:53.611554] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-09T18:07:53.726147] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:07:53.771077] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:07:53.830531] [DEBUG] [LOCAL ] CNM: Loaded 51046 existing records from primary storage. [2025-10-09T18:07:53.830893] [INFO ] [MAIN ] CNM: Loaded 51046 existing records. [2025-10-09T18:07:54.003798] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:07:54.004031] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-09T18:07:54.004079] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-09T18:07:54.004413] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-09T18:07:54.004470] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-09T18:07:54.371710] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:07:54.396701] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-09T18:07:54.581118] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T18:07:55.196725] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-09T18:07:55.502357] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T18:07:55.996734] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-09T18:07:56.411151] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T18:07:56.503784] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:07:56.796762] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-09T18:07:57.596739] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-09T18:07:57.703660] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T18:07:58.396721] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-09T18:07:58.538332] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T18:07:59.144106] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T18:07:59.196716] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-09T18:07:59.996691] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-09T18:08:00.251829] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T18:08:00.796723] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-09T18:08:01.028973] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T18:08:01.596734] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-09T18:08:02.038839] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T18:08:02.103893] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:08:02.108366] [INFO ] [REMOTE ] CNH: Full fetch complete (77540 records). [2025-10-09T18:08:02.108482] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-09T18:08:02.398555] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-09T18:08:02.494389] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-09T18:08:02.494468] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-09T18:08:02.495353] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-09T18:08:02.495418] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-09T18:08:02.496916] [DEBUG] [LOCAL ] CNH: Trimmed 77540 records to 53941 (keeping 200 days of data) [2025-10-09T18:08:02.826458] [DEBUG] [LOCAL ] CNH: Primary data saved (53941 records). [2025-10-09T18:08:02.826620] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-09T18:08:02.827564] [INFO ] [MAIN ] Update Progress: 492/2373 symbols completed. CNH took 41.0s. Estimated remaining: 4h 19m 56s. Rate: 7.2 symbols/min [2025-10-09T18:08:02.995691] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:03.066724] [DEBUG] [LOCAL ] CNMD: Loaded 32106 existing records from primary storage. [2025-10-09T18:08:03.068506] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T18:08:03.068632] [INFO ] [MAIN ] CNMD: Loaded 32106 existing records. [2025-10-09T18:08:03.201865] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-09T18:08:03.264927] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:03.265123] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-09T18:08:03.265170] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-09T18:08:03.265448] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-09T18:08:03.265508] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-09T18:08:03.635927] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:03.996725] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-09T18:08:04.328909] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T18:08:04.436129] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T18:08:04.796742] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-09T18:08:05.600763] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-09T18:08:05.606361] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T18:08:06.396758] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-09T18:08:06.585060] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-09T18:08:06.589351] [INFO ] [REMOTE ] CNI: Full fetch complete (74579 records). [2025-10-09T18:08:06.589495] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-09T18:08:07.013985] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-09T18:08:07.014070] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-09T18:08:07.015088] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-09T18:08:07.015157] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-09T18:08:07.017318] [DEBUG] [LOCAL ] CNI: Trimmed 74579 records to 52058 (keeping 200 days of data) [2025-10-09T18:08:07.205546] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-09T18:08:07.353793] [DEBUG] [LOCAL ] CNI: Primary data saved (52058 records). [2025-10-09T18:08:07.353929] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-09T18:08:07.354004] [INFO ] [MAIN ] Update Progress: 493/2373 symbols completed. CNI took 28.7s. Estimated remaining: 4h 19m 33s. Rate: 7.2 symbols/min [2025-10-09T18:08:07.539380] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:07.558732] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T18:08:07.602770] [DEBUG] [LOCAL ] CNNE: Loaded 36255 existing records from primary storage. [2025-10-09T18:08:07.603051] [INFO ] [MAIN ] CNNE: Loaded 36255 existing records. [2025-10-09T18:08:07.780382] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:07.780715] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-09T18:08:07.780793] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-09T18:08:07.781162] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-09T18:08:07.781221] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-09T18:08:08.017420] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-09T18:08:08.024886] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T18:08:08.183201] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:08.203083] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T18:08:08.796704] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-09T18:08:09.596754] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-09T18:08:09.781411] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T18:08:09.906637] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T18:08:10.396714] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-09T18:08:11.087815] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T18:08:11.196767] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-09T18:08:11.440940] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T18:08:11.996733] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-09T18:08:12.646630] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:08:12.796759] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-09T18:08:13.416361] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T18:08:13.421314] [INFO ] [REMOTE ] CNK: Full fetch complete (75470 records). [2025-10-09T18:08:13.421584] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-09T18:08:13.422797] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:08:13.422929] [FATAL] [MAIN ] CNK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:08:13.423014] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:08:13.423129] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-09T18:08:13.423244] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-09T18:08:13.423327] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-10-09T18:08:13.423731] [DEBUG] [LOCAL ] CNK: Deleted derivative data file. [2025-10-09T18:08:13.423872] [INFO ] [MAIN ] Update Progress: 494/2373 symbols completed. CNK took 33.1s. Estimated remaining: 4h 19m 16s. Rate: 7.2 symbols/min [2025-10-09T18:08:13.599698] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-09T18:08:13.602717] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:13.645624] [DEBUG] [LOCAL ] CNO: Loaded 40837 existing records from primary storage. [2025-10-09T18:08:13.645982] [INFO ] [MAIN ] CNO: Loaded 40837 existing records. [2025-10-09T18:08:13.822788] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:13.823007] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-09T18:08:13.823056] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-09T18:08:13.823381] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-09T18:08:13.823437] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-09T18:08:14.104500] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T18:08:14.267415] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:14.396737] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-09T18:08:14.849097] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T18:08:15.177175] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:08:15.196686] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-09T18:08:15.996792] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-09T18:08:16.276284] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T18:08:16.796717] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-09T18:08:17.374374] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:08:17.596744] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-09T18:08:18.398251] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-09T18:08:18.401464] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T18:08:19.044488] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T18:08:19.196773] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-09T18:08:19.851424] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T18:08:19.996719] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-09T18:08:20.389227] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T18:08:20.796727] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-09T18:08:21.251373] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T18:08:21.596742] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-09T18:08:22.121222] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T18:08:22.396700] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-09T18:08:22.990689] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T18:08:23.196718] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-09T18:08:23.996754] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-09T18:08:24.110267] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T18:08:24.601306] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T18:08:24.796721] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-09T18:08:25.299888] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T18:08:25.596740] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-09T18:08:26.249588] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T18:08:26.396693] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-09T18:08:26.801264] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T18:08:27.196717] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-09T18:08:27.858772] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T18:08:27.996752] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-09T18:08:28.796693] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-09T18:08:28.892683] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T18:08:28.897016] [INFO ] [REMOTE ] CNM: Full fetch complete (73612 records). [2025-10-09T18:08:28.897140] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-09T18:08:29.311114] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-09T18:08:29.323420] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-09T18:08:29.324441] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-09T18:08:29.324564] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-09T18:08:29.326507] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T18:08:29.335321] [DEBUG] [LOCAL ] CNM: Trimmed 73612 records to 51430 (keeping 200 days of data) [2025-10-09T18:08:29.614489] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-09T18:08:29.659048] [DEBUG] [LOCAL ] CNM: Primary data saved (51430 records). [2025-10-09T18:08:29.659202] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-09T18:08:29.659806] [INFO ] [MAIN ] Update Progress: 495/2373 symbols completed. CNM took 36.1s. Estimated remaining: 4h 19m 38s. Rate: 7.2 symbols/min [2025-10-09T18:08:29.864099] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:29.882917] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T18:08:29.942204] [DEBUG] [LOCAL ] CNP: Loaded 53476 existing records from primary storage. [2025-10-09T18:08:29.942542] [INFO ] [MAIN ] CNP: Loaded 53476 existing records. [2025-10-09T18:08:30.157215] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:30.157484] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-09T18:08:30.157535] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-09T18:08:30.157796] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-09T18:08:30.157876] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-09T18:08:30.401963] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-09T18:08:30.575544] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:30.982163] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T18:08:31.196713] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-09T18:08:31.809302] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T18:08:31.812518] [INFO ] [REMOTE ] CNNE: Full fetch complete (50230 records). [2025-10-09T18:08:31.812604] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-09T18:08:32.001873] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-09T18:08:32.192480] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-09T18:08:32.192559] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-09T18:08:32.193263] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-09T18:08:32.193326] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-09T18:08:32.194592] [DEBUG] [LOCAL ] CNNE: Trimmed 50230 records to 36507 (keeping 200 days of data) [2025-10-09T18:08:32.421610] [DEBUG] [LOCAL ] CNNE: Primary data saved (36507 records). [2025-10-09T18:08:32.421778] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-09T18:08:32.421865] [INFO ] [MAIN ] Update Progress: 496/2373 symbols completed. CNNE took 25.1s. Estimated remaining: 4h 19m 9s. Rate: 7.2 symbols/min [2025-10-09T18:08:32.590156] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:32.642084] [DEBUG] [LOCAL ] CNQ: Loaded 53577 existing records from primary storage. [2025-10-09T18:08:32.642411] [INFO ] [MAIN ] CNQ: Loaded 53577 existing records. [2025-10-09T18:08:32.802101] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-09T18:08:32.822695] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:32.823018] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-09T18:08:32.823074] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-09T18:08:32.823340] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-09T18:08:32.823398] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-09T18:08:33.230140] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:33.234144] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T18:08:33.282620] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T18:08:33.596777] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-09T18:08:34.072480] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T18:08:34.396717] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-09T18:08:35.196743] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-09T18:08:35.241253] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:08:35.461510] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T18:08:35.996729] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-09T18:08:36.796691] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-09T18:08:37.064982] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T18:08:37.104372] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:08:37.596716] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-09T18:08:38.260083] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T18:08:38.396702] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-09T18:08:38.868182] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T18:08:39.196731] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-09T18:08:39.678321] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:08:39.996759] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-09T18:08:40.437042] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:08:40.439812] [INFO ] [REMOTE ] CNMD: Full fetch complete (47180 records). [2025-10-09T18:08:40.439900] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-09T18:08:40.803973] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-09T18:08:40.831104] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-09T18:08:40.831180] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-09T18:08:40.831868] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-09T18:08:40.832016] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-09T18:08:40.833231] [DEBUG] [LOCAL ] CNMD: Trimmed 47180 records to 32304 (keeping 200 days of data) [2025-10-09T18:08:41.045569] [DEBUG] [LOCAL ] CNMD: Primary data saved (32304 records). [2025-10-09T18:08:41.045738] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-09T18:08:41.046777] [INFO ] [MAIN ] Update Progress: 497/2373 symbols completed. CNMD took 38.2s. Estimated remaining: 4h 19m 2s. Rate: 7.2 symbols/min [2025-10-09T18:08:41.221503] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:41.221711] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-09T18:08:41.221762] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-09T18:08:41.221881] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-09T18:08:41.221924] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-09T18:08:41.221994] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-09T18:08:41.222056] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-09T18:08:41.598864] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:41.598967] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-09T18:08:41.722602] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:08:42.408676] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-09T18:08:42.411074] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T18:08:42.603499] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:08:42.603814] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-09T18:08:42.603902] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:08:42.603949] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-09T18:08:42.603984] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:08:42.604020] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-09T18:08:42.604075] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-09T18:08:42.604128] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-09T18:08:42.604197] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-09T18:08:42.604248] [INFO ] [MAIN ] Update Progress: 498/2373 symbols completed. CNR took 1.6s. Estimated remaining: 4h 18m 28s. Rate: 7.3 symbols/min [2025-10-09T18:08:42.774784] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:42.797110] [DEBUG] [LOCAL ] CNS: Loaded 20802 existing records from primary storage. [2025-10-09T18:08:42.797376] [INFO ] [MAIN ] CNS: Loaded 20802 existing records. [2025-10-09T18:08:42.974532] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:08:42.974811] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-09T18:08:42.974879] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-09T18:08:42.975190] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-09T18:08:42.975271] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-09T18:08:43.198594] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-09T18:08:43.337680] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:43.409702] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:08:43.996794] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-09T18:08:44.402624] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T18:08:44.796686] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-09T18:08:45.125707] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T18:08:45.596737] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-09T18:08:45.814996] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T18:08:46.396746] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-09T18:08:47.196746] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-09T18:08:47.355079] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T18:08:47.996748] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-09T18:08:48.148291] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T18:08:48.369585] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:08:48.796701] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-09T18:08:49.596679] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-09T18:08:49.650611] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:08:50.154101] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:08:50.157794] [INFO ] [REMOTE ] CNO: Full fetch complete (60616 records). [2025-10-09T18:08:50.157933] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-09T18:08:50.408994] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-09T18:08:50.545019] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-09T18:08:50.545108] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-09T18:08:50.546745] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-09T18:08:50.546827] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-09T18:08:50.548237] [DEBUG] [LOCAL ] CNO: Trimmed 60616 records to 41137 (keeping 200 days of data) [2025-10-09T18:08:50.814317] [DEBUG] [LOCAL ] CNO: Primary data saved (41137 records). [2025-10-09T18:08:50.814446] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-09T18:08:50.814557] [INFO ] [MAIN ] Update Progress: 499/2373 symbols completed. CNO took 37.4s. Estimated remaining: 4h 18m 20s. Rate: 7.3 symbols/min [2025-10-09T18:08:50.993410] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:08:50.993620] [DEBUG] [LOCAL ] CNX: No existing data file found in primary storage. [2025-10-09T18:08:50.993748] [WARN ] [MAIN ] CNX: No existing data found, performing full refresh instead. [2025-10-09T18:08:50.993869] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-09T18:08:50.993912] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-09T18:08:50.993957] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-09T18:08:50.993989] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-09T18:08:51.203550] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-09T18:08:51.390811] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:08:51.420987] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T18:08:51.845106] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T18:08:51.996699] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-09T18:08:52.420531] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T18:08:52.796692] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-09T18:08:53.596686] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-09T18:08:53.823778] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T18:08:54.396725] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-09T18:08:54.494446] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T18:08:54.527176] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T18:08:55.196728] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-09T18:08:55.944524] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T18:08:55.996676] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-09T18:08:56.796678] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-09T18:08:57.063571] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T18:08:57.596737] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-09T18:08:57.890760] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T18:08:58.396687] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-09T18:08:58.547741] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T18:08:58.811062] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T18:08:59.196758] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-09T18:08:59.996725] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-09T18:09:00.163463] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T18:09:00.796744] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-09T18:09:00.930024] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T18:09:01.126956] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T18:09:01.596761] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-09T18:09:02.396721] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-09T18:09:02.496368] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T18:09:02.657477] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T18:09:03.196716] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-09T18:09:03.976321] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T18:09:03.996678] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-09T18:09:04.276712] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T18:09:04.796704] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-09T18:09:05.596688] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-09T18:09:05.746017] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:09:05.751878] [INFO ] [REMOTE ] CNP: Full fetch complete (77365 records). [2025-10-09T18:09:05.752010] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-09T18:09:06.125121] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T18:09:06.241705] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-09T18:09:06.241828] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-09T18:09:06.243016] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-09T18:09:06.243090] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-09T18:09:06.244676] [DEBUG] [LOCAL ] CNP: Trimmed 77365 records to 53863 (keeping 200 days of data) [2025-10-09T18:09:06.428719] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-09T18:09:06.586110] [DEBUG] [LOCAL ] CNP: Primary data saved (53863 records). [2025-10-09T18:09:06.586258] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-09T18:09:06.586881] [INFO ] [MAIN ] Update Progress: 500/2373 symbols completed. CNP took 36.9s. Estimated remaining: 4h 18m 40s. Rate: 7.2 symbols/min [2025-10-09T18:09:06.752219] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:06.791779] [DEBUG] [LOCAL ] CODI: Loaded 40636 existing records from primary storage. [2025-10-09T18:09:06.792079] [INFO ] [MAIN ] CODI: Loaded 40636 existing records. [2025-10-09T18:09:06.964409] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:09:06.964615] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-09T18:09:06.964690] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-09T18:09:06.964959] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-09T18:09:06.965015] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-09T18:09:07.206464] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-09T18:09:07.356234] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:07.386073] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T18:09:07.996712] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-09T18:09:08.048388] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T18:09:08.113314] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T18:09:08.796717] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-09T18:09:09.439148] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T18:09:09.443634] [INFO ] [REMOTE ] CNQ: Full fetch complete (77554 records). [2025-10-09T18:09:09.443785] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-09T18:09:09.599859] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-09T18:09:09.847600] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-09T18:09:09.847771] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-09T18:09:09.848769] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-09T18:09:09.848836] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-09T18:09:09.850414] [DEBUG] [LOCAL ] CNQ: Trimmed 77554 records to 53967 (keeping 200 days of data) [2025-10-09T18:09:09.967797] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:09:10.207999] [DEBUG] [LOCAL ] CNQ: Primary data saved (53967 records). [2025-10-09T18:09:10.208148] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-09T18:09:10.208242] [INFO ] [MAIN ] Update Progress: 501/2373 symbols completed. CNQ took 37.8s. Estimated remaining: 4h 18m 14s. Rate: 7.2 symbols/min [2025-10-09T18:09:10.374206] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:10.403583] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-09T18:09:10.427508] [DEBUG] [LOCAL ] COF: Loaded 53612 existing records from primary storage. [2025-10-09T18:09:10.429849] [INFO ] [MAIN ] COF: Loaded 53612 existing records. [2025-10-09T18:09:10.608698] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:09:10.608991] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-09T18:09:10.609051] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-09T18:09:10.609526] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-09T18:09:10.609585] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-09T18:09:10.981076] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:09:10.984850] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:11.196684] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-09T18:09:11.482325] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:09:11.485134] [INFO ] [REMOTE ] CNS: Full fetch complete (30386 records). [2025-10-09T18:09:11.485217] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-09T18:09:11.868498] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-09T18:09:11.868587] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-09T18:09:11.869107] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-09T18:09:11.869171] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-09T18:09:11.869984] [DEBUG] [LOCAL ] CNS: Trimmed 30386 records to 20993 (keeping 200 days of data) [2025-10-09T18:09:11.998200] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-09T18:09:12.002602] [DEBUG] [LOCAL ] CNS: Primary data saved (20993 records). [2025-10-09T18:09:12.002771] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-09T18:09:12.002862] [INFO ] [MAIN ] Update Progress: 502/2373 symbols completed. CNS took 29.4s. Estimated remaining: 4h 17m 42s. Rate: 7.3 symbols/min [2025-10-09T18:09:12.169606] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:12.221117] [DEBUG] [LOCAL ] COHR: Loaded 53371 existing records from primary storage. [2025-10-09T18:09:12.221524] [INFO ] [MAIN ] COHR: Loaded 53371 existing records. [2025-10-09T18:09:12.397685] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:09:12.397985] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-09T18:09:12.398036] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-09T18:09:12.398278] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-09T18:09:12.398335] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-09T18:09:12.709729] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T18:09:12.775215] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:12.796671] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-09T18:09:13.596740] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-09T18:09:13.955368] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T18:09:14.396769] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-09T18:09:14.678862] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-09T18:09:15.045729] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T18:09:15.196690] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-09T18:09:15.996737] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-09T18:09:16.372286] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T18:09:16.796798] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-09T18:09:16.876467] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T18:09:17.546270] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:09:17.596692] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-09T18:09:18.396775] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-09T18:09:18.616369] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:09:18.818956] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T18:09:19.196724] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-09T18:09:19.996690] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-09T18:09:20.322716] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-09T18:09:20.769779] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T18:09:20.796678] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-09T18:09:21.508695] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T18:09:21.596675] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-09T18:09:22.396690] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-09T18:09:22.564911] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:09:23.196716] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-09T18:09:23.504987] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T18:09:23.996741] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-09T18:09:24.142606] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:09:24.434084] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:09:24.796771] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-09T18:09:25.596687] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-09T18:09:26.135989] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-09T18:09:26.222910] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T18:09:26.396671] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-09T18:09:26.826615] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T18:09:27.196756] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-09T18:09:27.820969] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T18:09:27.996796] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-09T18:09:28.410191] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T18:09:28.796740] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-09T18:09:29.275228] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T18:09:29.279509] [INFO ] [REMOTE ] CNX: Full fetch complete (74710 records). [2025-10-09T18:09:29.279615] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-09T18:09:29.606469] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-09T18:09:29.663687] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-09T18:09:29.663774] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-09T18:09:29.664588] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-09T18:09:29.664629] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-09T18:09:29.666206] [DEBUG] [LOCAL ] CNX: Trimmed 74710 records to 51694 (keeping 200 days of data) [2025-10-09T18:09:29.963660] [DEBUG] [LOCAL ] CNX: Primary data saved (51694 records). [2025-10-09T18:09:29.963794] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-09T18:09:29.963876] [INFO ] [MAIN ] Update Progress: 503/2373 symbols completed. CNX took 39.1s. Estimated remaining: 4h 18m 9s. Rate: 7.2 symbols/min [2025-10-09T18:09:30.131308] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:30.181236] [DEBUG] [LOCAL ] COLD: Loaded 52250 existing records from primary storage. [2025-10-09T18:09:30.181756] [INFO ] [MAIN ] COLD: Loaded 52250 existing records. [2025-10-09T18:09:30.355285] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:09:30.355458] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-09T18:09:30.355504] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-09T18:09:30.355747] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-09T18:09:30.355803] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-09T18:09:30.408982] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-09T18:09:30.720045] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:30.914057] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-09T18:09:31.196709] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-09T18:09:31.342181] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T18:09:31.996722] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-09T18:09:32.291419] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T18:09:32.744136] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:09:32.796679] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-09T18:09:33.596736] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-09T18:09:33.803701] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T18:09:34.396697] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-09T18:09:34.423486] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:09:35.196741] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-09T18:09:35.346125] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T18:09:35.996802] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-09T18:09:36.305589] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-09T18:09:36.796908] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-09T18:09:37.068193] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T18:09:37.564714] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T18:09:37.596681] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-09T18:09:38.389369] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:09:38.400340] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-09T18:09:38.951953] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T18:09:39.196784] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-09T18:09:39.568151] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T18:09:39.996706] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-09T18:09:40.796718] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-09T18:09:41.146443] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T18:09:41.328666] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T18:09:41.596711] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-09T18:09:42.396725] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-09T18:09:43.096552] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-09T18:09:43.196694] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-09T18:09:43.285064] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T18:09:43.996707] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-09T18:09:44.352414] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-09T18:09:44.796714] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-09T18:09:45.155075] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-09T18:09:45.600688] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-09T18:09:45.606374] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T18:09:46.396749] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-09T18:09:46.442971] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T18:09:46.447453] [INFO ] [REMOTE ] COF: Full fetch complete (77446 records). [2025-10-09T18:09:46.447559] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-09T18:09:46.861515] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-09T18:09:46.861596] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-09T18:09:46.862443] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-09T18:09:46.862507] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-09T18:09:46.863920] [DEBUG] [LOCAL ] COF: Trimmed 77446 records to 54002 (keeping 200 days of data) [2025-10-09T18:09:47.197677] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-09T18:09:47.227144] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T18:09:47.247717] [DEBUG] [LOCAL ] COF: Primary data saved (54002 records). [2025-10-09T18:09:47.247836] [INFO ] [MAIN ] COF: Full history saved. [2025-10-09T18:09:47.247949] [INFO ] [MAIN ] Update Progress: 504/2373 symbols completed. COF took 37.0s. Estimated remaining: 4h 18m 35s. Rate: 7.2 symbols/min [2025-10-09T18:09:47.419601] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:47.419802] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-09T18:09:47.419859] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-09T18:09:47.419967] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-09T18:09:47.420010] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-09T18:09:47.420051] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-09T18:09:47.420125] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-09T18:09:47.808213] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:47.840846] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T18:09:47.996723] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-09T18:09:48.796716] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-09T18:09:49.459594] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-09T18:09:49.464130] [INFO ] [REMOTE ] COHR: Full fetch complete (77175 records). [2025-10-09T18:09:49.464252] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-09T18:09:49.603836] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-09T18:09:49.874850] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-09T18:09:49.875039] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-09T18:09:49.876030] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-09T18:09:49.876192] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-09T18:09:49.909539] [DEBUG] [LOCAL ] COHR: Trimmed 77175 records to 53761 (keeping 200 days of data) [2025-10-09T18:09:49.911728] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T18:09:50.254635] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T18:09:50.265026] [DEBUG] [LOCAL ] COHR: Primary data saved (53761 records). [2025-10-09T18:09:50.265602] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-09T18:09:50.266569] [INFO ] [MAIN ] Update Progress: 505/2373 symbols completed. COHR took 38.3s. Estimated remaining: 4h 18m 7s. Rate: 7.2 symbols/min [2025-10-09T18:09:50.266720] [INFO ] [REMOTE ] CODI: Full fetch complete (51691 records). [2025-10-09T18:09:50.278842] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-09T18:09:50.406077] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-09T18:09:50.617337] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:50.642020] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-10-09T18:09:50.647230] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-10-09T18:09:50.654342] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-09T18:09:50.669619] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-09T18:09:50.670225] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-09T18:09:50.682054] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-09T18:09:51.171579] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-09T18:09:51.186236] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-09T18:09:51.197982] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-09T18:09:51.207444] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-09T18:09:51.264359] [DEBUG] [LOCAL ] CODI: Trimmed 51691 records to 40992 (keeping 200 days of data) [2025-10-09T18:09:51.417283] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:51.446894] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-09T18:09:51.620548] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T18:09:51.669582] [DEBUG] [LOCAL ] CODI: Primary data saved (40992 records). [2025-10-09T18:09:51.669792] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-09T18:09:51.670494] [INFO ] [MAIN ] Update Progress: 506/2373 symbols completed. CODI took 45.1s. Estimated remaining: 4h 17m 33s. Rate: 7.2 symbols/min [2025-10-09T18:09:51.811403] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T18:09:51.919093] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:09:51.919282] [DEBUG] [LOCAL ] COOK: No existing data file found in primary storage. [2025-10-09T18:09:51.919323] [WARN ] [MAIN ] COOK: No existing data found, performing full refresh instead. [2025-10-09T18:09:51.919432] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-09T18:09:51.919474] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-09T18:09:51.919514] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-09T18:09:51.919546] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-09T18:09:52.001867] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-09T18:09:52.270525] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:09:52.796696] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-09T18:09:52.915800] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T18:09:53.489531] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T18:09:53.596718] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-09T18:09:54.241749] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T18:09:54.396723] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-09T18:09:55.044979] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T18:09:55.196739] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-09T18:09:55.996704] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-09T18:09:56.122916] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T18:09:56.639994] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T18:09:56.796712] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-09T18:09:56.889681] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T18:09:57.596720] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-09T18:09:58.396754] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-09T18:09:58.540000] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:09:59.053564] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T18:09:59.196686] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-09T18:09:59.390007] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-09T18:09:59.394438] [INFO ] [REMOTE ] COLD: Full fetch complete (74478 records). [2025-10-09T18:09:59.394552] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-09T18:09:59.788075] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-09T18:09:59.788170] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-09T18:09:59.789420] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-09T18:09:59.789489] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-09T18:09:59.791261] [DEBUG] [LOCAL ] COLD: Trimmed 74478 records to 52638 (keeping 200 days of data) [2025-10-09T18:10:00.005467] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-09T18:10:00.126719] [DEBUG] [LOCAL ] COLD: Primary data saved (52638 records). [2025-10-09T18:10:00.126866] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-09T18:10:00.126951] [INFO ] [MAIN ] Update Progress: 507/2373 symbols completed. COLD took 30.2s. Estimated remaining: 4h 17m 25s. Rate: 7.2 symbols/min [2025-10-09T18:10:00.296676] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:00.296891] [DEBUG] [LOCAL ] COP: No existing data file found in primary storage. [2025-10-09T18:10:00.296942] [WARN ] [MAIN ] COP: No existing data found, performing full refresh instead. [2025-10-09T18:10:00.297065] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-09T18:10:00.297106] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-09T18:10:00.297148] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-09T18:10:00.297179] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-09T18:10:00.663000] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:00.796724] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-09T18:10:00.818138] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T18:10:01.170785] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-09T18:10:01.596719] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-09T18:10:02.396814] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-09T18:10:02.714972] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T18:10:03.196705] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-09T18:10:03.227522] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T18:10:03.940797] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T18:10:03.996680] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-09T18:10:04.796776] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-09T18:10:05.112594] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-09T18:10:05.511751] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T18:10:05.596718] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-09T18:10:06.396682] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-09T18:10:06.608834] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T18:10:06.685250] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T18:10:07.196725] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-09T18:10:07.900395] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:10:07.996711] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-09T18:10:08.796726] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-09T18:10:08.985023] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T18:10:09.064132] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T18:10:09.596776] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-09T18:10:10.008557] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T18:10:10.396774] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-09T18:10:10.774502] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T18:10:11.196794] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-09T18:10:11.996760] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-09T18:10:12.229761] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T18:10:12.796710] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-09T18:10:13.100240] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T18:10:13.282460] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-09T18:10:13.596753] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-09T18:10:14.396746] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-09T18:10:14.955216] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:10:15.126711] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-09T18:10:15.196671] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-09T18:10:15.996693] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-09T18:10:16.020471] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T18:10:16.796794] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-09T18:10:16.814018] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T18:10:17.341402] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-09T18:10:17.596730] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-09T18:10:18.320423] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T18:10:18.396745] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-09T18:10:19.196692] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-09T18:10:19.511639] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T18:10:19.874235] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T18:10:19.996728] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-09T18:10:20.796795] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-09T18:10:21.596699] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-09T18:10:21.683382] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-09T18:10:21.688038] [INFO ] [REMOTE ] COMP: Full fetch complete (77196 records). [2025-10-09T18:10:21.688157] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-09T18:10:22.085881] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-09T18:10:22.085969] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-09T18:10:22.086831] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-09T18:10:22.086898] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-09T18:10:22.088622] [DEBUG] [LOCAL ] COMP: Trimmed 77196 records to 53792 (keeping 200 days of data) [2025-10-09T18:10:22.393369] [DEBUG] [LOCAL ] COMP: Primary data saved (53792 records). [2025-10-09T18:10:22.393505] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-09T18:10:22.393579] [INFO ] [MAIN ] Update Progress: 508/2373 symbols completed. COMP took 35.1s. Estimated remaining: 4h 18m 8s. Rate: 7.2 symbols/min [2025-10-09T18:10:22.537596] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:10:22.589526] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:22.569154] [INFO ] [REMOTE ] CON: Full fetch complete (56699 records). [2025-10-09T18:10:22.589819] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-09T18:10:22.944379] [DEBUG] [LOCAL ] COR: Loaded 46781 existing records from primary storage. [2025-10-09T18:10:22.972613] [INFO ] [MAIN ] COR: Loaded 46781 existing records. [2025-10-09T18:10:23.102513] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-09T18:10:23.117028] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-09T18:10:23.133856] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-09T18:10:23.139208] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-09T18:10:23.199391] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:10:23.200263] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-09T18:10:23.200441] [DEBUG] [LOCAL ] CON: Trimmed 56699 records to 39099 (keeping 200 days of data) [2025-10-09T18:10:23.205977] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-09T18:10:23.215331] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-09T18:10:23.216630] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T18:10:23.215891] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-09T18:10:23.360122] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-09T18:10:23.382000] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (3.39 seconds). [2025-10-09T18:10:23.473298] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-09T18:10:23.761210] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:23.911233] [DEBUG] [LOCAL ] CON: Primary data saved (39099 records). [2025-10-09T18:10:23.911409] [INFO ] [MAIN ] CON: Full history saved. [2025-10-09T18:10:23.911491] [INFO ] [MAIN ] Update Progress: 509/2373 symbols completed. CON took 33.6s. Estimated remaining: 4h 17m 35s. Rate: 7.2 symbols/min [2025-10-09T18:10:24.006387] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-09T18:10:24.090934] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:24.091106] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-10-09T18:10:24.091144] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-10-09T18:10:24.091254] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-09T18:10:24.091297] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-09T18:10:24.091337] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-09T18:10:24.091370] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-09T18:10:24.459177] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T18:10:24.518119] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:24.796747] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-09T18:10:25.596697] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-09T18:10:25.773813] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-09T18:10:25.866279] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T18:10:26.396682] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-09T18:10:26.559762] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T18:10:26.776147] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T18:10:26.778721] [INFO ] [REMOTE ] COOK: Full fetch complete (32719 records). [2025-10-09T18:10:26.778813] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-09T18:10:27.159152] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-09T18:10:27.159270] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-09T18:10:27.159811] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-09T18:10:27.159876] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-09T18:10:27.160771] [DEBUG] [LOCAL ] COOK: Trimmed 32719 records to 24658 (keeping 200 days of data) [2025-10-09T18:10:27.205634] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-09T18:10:27.303968] [DEBUG] [LOCAL ] COOK: Primary data saved (24658 records). [2025-10-09T18:10:27.304124] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-09T18:10:27.304240] [INFO ] [MAIN ] Update Progress: 510/2373 symbols completed. COOK took 35.6s. Estimated remaining: 4h 17m 9s. Rate: 7.2 symbols/min [2025-10-09T18:10:27.476367] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:27.523099] [DEBUG] [LOCAL ] COUR: Loaded 49053 existing records from primary storage. [2025-10-09T18:10:27.523409] [INFO ] [MAIN ] COUR: Loaded 49053 existing records. [2025-10-09T18:10:27.697617] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:10:27.697842] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-09T18:10:27.697956] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-09T18:10:27.698172] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-09T18:10:27.698229] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-09T18:10:27.998625] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-09T18:10:28.185973] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:28.238168] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T18:10:28.700555] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T18:10:28.796785] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-09T18:10:29.596707] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-09T18:10:29.666328] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T18:10:30.396766] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-09T18:10:30.628192] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T18:10:31.196685] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-09T18:10:31.271054] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:10:31.981044] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T18:10:31.996665] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-09T18:10:32.796772] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-09T18:10:33.100050] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T18:10:33.596736] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-09T18:10:33.757243] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T18:10:34.397054] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-09T18:10:34.400117] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T18:10:35.196710] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-09T18:10:35.322688] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T18:10:35.869694] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T18:10:35.874332] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-09T18:10:35.874490] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-09T18:10:36.001798] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-09T18:10:36.278585] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-09T18:10:36.278738] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-09T18:10:36.279814] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-09T18:10:36.279896] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-09T18:10:36.310053] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T18:10:36.308579] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54117 (keeping 200 days of data) [2025-10-09T18:10:36.654544] [DEBUG] [LOCAL ] COP: Primary data saved (54117 records). [2025-10-09T18:10:36.654718] [INFO ] [MAIN ] COP: Full history saved. [2025-10-09T18:10:36.654821] [INFO ] [MAIN ] Update Progress: 511/2373 symbols completed. COP took 36.5s. Estimated remaining: 4h 17m 5s. Rate: 7.2 symbols/min [2025-10-09T18:10:36.804666] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-09T18:10:36.823077] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:36.823334] [DEBUG] [LOCAL ] CP: No existing data file found in primary storage. [2025-10-09T18:10:36.823989] [WARN ] [MAIN ] CP: No existing data found, performing full refresh instead. [2025-10-09T18:10:36.824101] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-09T18:10:36.824143] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-09T18:10:36.824184] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-09T18:10:36.824225] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-09T18:10:37.178985] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:37.596762] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-09T18:10:37.744756] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T18:10:38.396755] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-09T18:10:38.535571] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T18:10:39.196782] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-09T18:10:39.415187] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T18:10:39.996776] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-09T18:10:40.042904] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:10:40.796699] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-09T18:10:40.882864] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T18:10:41.596712] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-09T18:10:41.704419] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T18:10:42.396684] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-09T18:10:42.630393] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T18:10:43.196685] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-09T18:10:43.451177] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T18:10:43.996727] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-09T18:10:44.120288] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:10:44.663626] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T18:10:44.796714] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-09T18:10:45.549836] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T18:10:45.596699] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-09T18:10:46.396761] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-09T18:10:46.598630] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T18:10:46.673288] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T18:10:47.196722] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-09T18:10:47.996710] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-09T18:10:48.133103] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T18:10:48.789751] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:10:48.798813] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-09T18:10:49.601912] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-09T18:10:49.617407] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T18:10:50.396704] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-09T18:10:50.688733] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T18:10:51.108970] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T18:10:51.196709] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-09T18:10:51.996690] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-09T18:10:52.151033] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T18:10:52.796792] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-09T18:10:53.474714] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-09T18:10:53.596698] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-09T18:10:54.396721] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-09T18:10:55.386876] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-09T18:10:55.398025] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-09T18:10:55.481950] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T18:10:55.505871] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (3.51 seconds). [2025-10-09T18:10:55.996768] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-09T18:10:56.290517] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T18:10:56.796694] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-09T18:10:56.843942] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T18:10:56.848388] [INFO ] [REMOTE ] COUR: Full fetch complete (70861 records). [2025-10-09T18:10:56.848501] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-09T18:10:57.239686] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-09T18:10:57.239776] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-09T18:10:57.240663] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-09T18:10:57.240726] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-09T18:10:57.242086] [DEBUG] [LOCAL ] COUR: Trimmed 70861 records to 49416 (keeping 200 days of data) [2025-10-09T18:10:57.550017] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T18:10:57.574450] [DEBUG] [LOCAL ] COUR: Primary data saved (49416 records). [2025-10-09T18:10:57.574568] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-09T18:10:57.575155] [INFO ] [MAIN ] Update Progress: 512/2373 symbols completed. COUR took 30.3s. Estimated remaining: 4h 17m 42s. Rate: 7.2 symbols/min [2025-10-09T18:10:57.604191] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-09T18:10:57.746013] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:57.777400] [DEBUG] [LOCAL ] CPA: Loaded 28240 existing records from primary storage. [2025-10-09T18:10:57.777718] [INFO ] [MAIN ] CPA: Loaded 28240 existing records. [2025-10-09T18:10:57.960121] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:10:57.960328] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-09T18:10:57.960416] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-09T18:10:57.960838] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-09T18:10:57.960899] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-09T18:10:58.325181] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:58.362217] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T18:10:58.366127] [INFO ] [REMOTE ] COR: Full fetch complete (68587 records). [2025-10-09T18:10:58.366269] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-09T18:10:58.401793] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-09T18:10:58.777312] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-09T18:10:58.777407] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-09T18:10:58.778247] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-09T18:10:58.778315] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-09T18:10:58.779772] [DEBUG] [LOCAL ] COR: Trimmed 68587 records to 47111 (keeping 200 days of data) [2025-10-09T18:10:59.082704] [DEBUG] [LOCAL ] COR: Primary data saved (47111 records). [2025-10-09T18:10:59.082864] [INFO ] [MAIN ] COR: Full history saved. [2025-10-09T18:10:59.082952] [INFO ] [MAIN ] Update Progress: 513/2373 symbols completed. COR took 36.7s. Estimated remaining: 4h 17m 9s. Rate: 7.2 symbols/min [2025-10-09T18:10:59.198485] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-09T18:10:59.287322] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:10:59.304975] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-09T18:10:59.305090] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-09T18:10:59.305282] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-09T18:10:59.305563] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-09T18:10:59.306068] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-09T18:10:59.307332] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T18:10:59.318305] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-09T18:10:59.706378] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:10:59.996703] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-09T18:11:00.240512] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T18:11:00.654006] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T18:11:00.796727] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-09T18:11:01.259878] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-09T18:11:01.596750] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-09T18:11:01.838300] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T18:11:02.396743] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-09T18:11:03.083440] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T18:11:03.196672] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-09T18:11:03.282722] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T18:11:03.287173] [INFO ] [REMOTE ] COTY: Full fetch complete (77114 records). [2025-10-09T18:11:03.287279] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-09T18:11:03.686727] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-09T18:11:03.686881] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-09T18:11:03.687941] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-09T18:11:03.688015] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-09T18:11:03.689701] [DEBUG] [LOCAL ] COTY: Trimmed 77114 records to 53632 (keeping 200 days of data) [2025-10-09T18:11:03.990909] [DEBUG] [LOCAL ] COTY: Primary data saved (53632 records). [2025-10-09T18:11:03.991057] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-09T18:11:03.991176] [INFO ] [MAIN ] Update Progress: 514/2373 symbols completed. COTY took 40.1s. Estimated remaining: 4h 16m 49s. Rate: 7.2 symbols/min [2025-10-09T18:11:04.002501] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-09T18:11:04.158785] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:04.188428] [DEBUG] [LOCAL ] CPAY: Loaded 30443 existing records from primary storage. [2025-10-09T18:11:04.188711] [INFO ] [MAIN ] CPAY: Loaded 30443 existing records. [2025-10-09T18:11:04.367479] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:04.367726] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-09T18:11:04.367783] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-09T18:11:04.371758] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-09T18:11:04.371889] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-09T18:11:04.740680] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:04.796671] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-09T18:11:05.073889] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T18:11:05.556338] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T18:11:05.596695] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-09T18:11:05.836694] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T18:11:06.396802] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-09T18:11:06.912985] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:11:07.196778] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-09T18:11:07.996681] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-09T18:11:08.038538] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T18:11:08.043048] [INFO ] [REMOTE ] CP: Full fetch complete (77125 records). [2025-10-09T18:11:08.043159] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-09T18:11:08.271081] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-09T18:11:08.444390] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-09T18:11:08.444590] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-09T18:11:08.445723] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-09T18:11:08.445829] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-09T18:11:08.458089] [DEBUG] [LOCAL ] CP: Trimmed 77125 records to 53653 (keeping 200 days of data) [2025-10-09T18:11:08.467334] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T18:11:08.796721] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-09T18:11:08.813424] [DEBUG] [LOCAL ] CP: Primary data saved (53653 records). [2025-10-09T18:11:08.813527] [INFO ] [MAIN ] CP: Full history saved. [2025-10-09T18:11:08.813601] [INFO ] [MAIN ] Update Progress: 515/2373 symbols completed. CP took 32.2s. Estimated remaining: 4h 16m 28s. Rate: 7.2 symbols/min [2025-10-09T18:11:08.984627] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:09.000159] [DEBUG] [LOCAL ] CPF: Loaded 15169 existing records from primary storage. [2025-10-09T18:11:09.000395] [INFO ] [MAIN ] CPF: Loaded 15169 existing records. [2025-10-09T18:11:09.184585] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:09.187298] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-09T18:11:09.187205] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-09T18:11:09.187443] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-09T18:11:09.188831] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-09T18:11:09.188891] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-09T18:11:09.543206] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:09.596684] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-09T18:11:09.962043] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-09T18:11:10.396715] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-09T18:11:11.196689] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-09T18:11:11.575240] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T18:11:11.996683] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-09T18:11:12.481015] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T18:11:12.796700] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-09T18:11:13.102440] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T18:11:13.596736] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-09T18:11:14.011362] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T18:11:14.396711] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-09T18:11:14.610095] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T18:11:15.197193] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-09T18:11:15.681924] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-09T18:11:15.701158] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T18:11:15.996732] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-09T18:11:16.276545] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-09T18:11:16.796725] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-09T18:11:17.596714] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-09T18:11:17.789846] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T18:11:18.396776] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-09T18:11:18.924119] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T18:11:19.196728] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-09T18:11:19.811954] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T18:11:19.996693] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-09T18:11:20.245810] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-09T18:11:20.796800] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-09T18:11:21.222914] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T18:11:21.596725] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-09T18:11:21.880701] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T18:11:22.396776] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-09T18:11:22.949690] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T18:11:23.196748] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-09T18:11:23.215794] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-09T18:11:23.561230] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T18:11:23.996729] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-09T18:11:24.796741] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-09T18:11:25.302248] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T18:11:25.596681] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-09T18:11:25.800019] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T18:11:26.396732] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-09T18:11:26.784887] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T18:11:27.196702] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-09T18:11:27.307124] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T18:11:27.996714] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-09T18:11:28.293192] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:11:28.295709] [INFO ] [REMOTE ] CPA: Full fetch complete (41371 records). [2025-10-09T18:11:28.295791] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-09T18:11:28.487780] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T18:11:28.672892] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-09T18:11:28.672976] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-09T18:11:28.673510] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-09T18:11:28.673550] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-09T18:11:28.674396] [DEBUG] [LOCAL ] CPA: Trimmed 41371 records to 28446 (keeping 200 days of data) [2025-10-09T18:11:28.799002] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-09T18:11:28.858850] [DEBUG] [LOCAL ] CPA: Primary data saved (28446 records). [2025-10-09T18:11:28.858978] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-09T18:11:28.859083] [INFO ] [MAIN ] Update Progress: 516/2373 symbols completed. CPA took 31.3s. Estimated remaining: 4h 17m 2s. Rate: 7.2 symbols/min [2025-10-09T18:11:29.026585] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:29.041524] [DEBUG] [LOCAL ] CPK: Loaded 13647 existing records from primary storage. [2025-10-09T18:11:29.041746] [INFO ] [MAIN ] CPK: Loaded 13647 existing records. [2025-10-09T18:11:29.217196] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:29.217417] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-09T18:11:29.217490] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-09T18:11:29.217780] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-09T18:11:29.217875] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-09T18:11:29.310112] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T18:11:29.575710] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:29.596669] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-09T18:11:30.396684] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-09T18:11:30.535576] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T18:11:30.778465] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-09T18:11:30.779279] [INFO ] [REMOTE ] CPAC: Full fetch complete (1874 records). [2025-10-09T18:11:30.779352] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-09T18:11:30.964793] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T18:11:30.965035] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:11:30.965129] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:11:30.965223] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-09T18:11:30.965305] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-09T18:11:30.965358] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-09T18:11:30.965427] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-09T18:11:30.965489] [INFO ] [MAIN ] Update Progress: 517/2373 symbols completed. CPAC took 31.9s. Estimated remaining: 4h 16m 32s. Rate: 7.2 symbols/min [2025-10-09T18:11:31.196735] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-09T18:11:31.996737] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-09T18:11:32.563119] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T18:11:32.796692] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-09T18:11:33.032019] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:11:33.596684] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-09T18:11:33.780030] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:11:34.396758] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-09T18:11:34.546827] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T18:11:34.952905] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T18:11:35.196733] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-09T18:11:35.989753] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T18:11:35.996665] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-09T18:11:36.796765] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-09T18:11:37.191586] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T18:11:37.596799] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-09T18:11:37.699688] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T18:11:38.396774] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-09T18:11:38.788585] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T18:11:38.791173] [INFO ] [REMOTE ] CPAY: Full fetch complete (44795 records). [2025-10-09T18:11:38.791256] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-09T18:11:39.177887] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-09T18:11:39.177975] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-09T18:11:39.178550] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-09T18:11:39.178638] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-09T18:11:39.179697] [DEBUG] [LOCAL ] CPAY: Trimmed 44795 records to 30592 (keeping 200 days of data) [2025-10-09T18:11:39.233951] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-09T18:11:39.297814] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T18:11:39.386111] [DEBUG] [LOCAL ] CPAY: Primary data saved (30592 records). [2025-10-09T18:11:39.386242] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-09T18:11:39.387274] [INFO ] [MAIN ] Update Progress: 518/2373 symbols completed. CPAY took 35.4s. Estimated remaining: 4h 16m 24s. Rate: 7.2 symbols/min [2025-10-09T18:11:39.864668] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T18:11:39.996698] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-09T18:11:40.796701] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-09T18:11:40.988144] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T18:11:41.596702] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-09T18:11:41.711559] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T18:11:42.119760] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-09T18:11:42.396721] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-09T18:11:43.196763] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-09T18:11:43.300712] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T18:11:43.996679] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-09T18:11:44.111004] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T18:11:44.113710] [INFO ] [REMOTE ] CPF: Full fetch complete (23833 records). [2025-10-09T18:11:44.113815] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-09T18:11:44.493935] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-09T18:11:44.494032] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-09T18:11:44.495196] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-09T18:11:44.495258] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-09T18:11:44.495965] [DEBUG] [LOCAL ] CPF: Trimmed 23833 records to 15320 (keeping 200 days of data) [2025-10-09T18:11:44.592330] [DEBUG] [LOCAL ] CPF: Primary data saved (15320 records). [2025-10-09T18:11:44.592466] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-09T18:11:44.592545] [INFO ] [MAIN ] Update Progress: 519/2373 symbols completed. CPF took 35.8s. Estimated remaining: 4h 16m 4s. Rate: 7.2 symbols/min [2025-10-09T18:11:44.621687] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T18:11:44.796709] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-09T18:11:45.718392] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T18:11:45.721887] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-09T18:11:46.591339] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T18:11:46.593132] [INFO ] [REMOTE ] CPK: Full fetch complete (18127 records). [2025-10-09T18:11:46.593204] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-09T18:11:46.965000] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-09T18:11:46.965119] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-09T18:11:46.965552] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-09T18:11:46.965597] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-09T18:11:46.966177] [DEBUG] [LOCAL ] CPK: Trimmed 18127 records to 13753 (keeping 200 days of data) [2025-10-09T18:11:47.056675] [DEBUG] [LOCAL ] CPK: Primary data saved (13753 records). [2025-10-09T18:11:47.056821] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-09T18:11:47.056900] [INFO ] [MAIN ] Update Progress: 520/2373 symbols completed. CPK took 18.2s. Estimated remaining: 4h 15m 35s. Rate: 7.2 symbols/min [2025-10-09T18:11:47.667616] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:47.656869] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:47.736726] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:47.791917] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:11:47.838238] [DEBUG] [LOCAL ] CPS: Loaded 25526 existing records from primary storage. [2025-10-09T18:11:47.838859] [INFO ] [MAIN ] CPS: Loaded 25526 existing records. [2025-10-09T18:11:48.008025] [DEBUG] [LOCAL ] CPT: Loaded 44405 existing records from primary storage. [2025-10-09T18:11:48.008885] [INFO ] [MAIN ] CPT: Loaded 44405 existing records. [2025-10-09T18:11:48.205299] [DEBUG] [LOCAL ] CPRI: Loaded 52519 existing records from primary storage. [2025-10-09T18:11:48.209218] [INFO ] [MAIN ] CPRI: Loaded 52519 existing records. [2025-10-09T18:11:48.208803] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:48.229988] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-09T18:11:48.246175] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-09T18:11:48.246077] [DEBUG] [LOCAL ] CPNG: Loaded 53670 existing records from primary storage. [2025-10-09T18:11:48.307173] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-09T18:11:48.335112] [INFO ] [MAIN ] CPNG: Loaded 53670 existing records. [2025-10-09T18:11:48.340407] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-09T18:11:48.724012] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:48.726932] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:48.776847] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-09T18:11:48.795392] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-09T18:11:48.809213] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-09T18:11:48.782153] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-09T18:11:48.871664] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-09T18:11:48.900722] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-09T18:11:48.943482] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-09T18:11:48.941152] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-09T18:11:48.946447] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:11:49.057041] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-09T18:11:49.128174] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-09T18:11:49.257020] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-09T18:11:49.291411] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-09T18:11:49.357258] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:49.495466] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-09T18:11:50.066160] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:50.113316] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-09T18:11:50.172211] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:50.188954] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-09T18:11:50.254553] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:11:50.254846] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-09T18:11:50.664797] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T18:11:50.669042] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-09T18:11:51.722785] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:11:51.730835] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-09T18:11:51.749193] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T18:11:51.757108] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-09T18:11:51.922486] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T18:11:51.996693] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-09T18:11:52.334003] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T18:11:52.511025] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T18:11:52.796719] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-09T18:11:52.916343] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T18:11:53.596719] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-09T18:11:53.976885] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T18:11:54.013093] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-09T18:11:54.396751] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-09T18:11:55.021111] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T18:11:55.196758] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-09T18:11:55.677328] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:11:55.996740] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-09T18:11:56.536312] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T18:11:56.796765] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-09T18:11:57.596725] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-09T18:11:57.747972] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:11:58.396704] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-09T18:11:58.442422] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T18:11:59.092780] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T18:11:59.196716] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-09T18:11:59.996706] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-09T18:12:00.241389] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T18:12:00.421506] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T18:12:00.796817] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-09T18:12:01.596775] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-09T18:12:02.063743] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-09T18:12:02.089560] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T18:12:02.396742] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-09T18:12:03.170153] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T18:12:03.196695] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-09T18:12:03.429964] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T18:12:03.996730] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-09T18:12:04.796728] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-09T18:12:04.867151] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T18:12:05.596727] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-09T18:12:06.332228] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-09T18:12:06.402027] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-09T18:12:06.421548] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:12:07.114744] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T18:12:07.196770] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-09T18:12:07.996733] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-09T18:12:08.393618] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T18:12:08.682853] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-09T18:12:08.796795] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-09T18:12:08.917367] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T18:12:09.596731] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-09T18:12:10.396824] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-09T18:12:11.064678] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-09T18:12:11.155904] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T18:12:11.196671] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-09T18:12:11.254845] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T18:12:11.996727] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-09T18:12:12.796705] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-09T18:12:13.022836] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T18:12:13.596694] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-09T18:12:13.714188] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T18:12:13.877975] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:12:13.880023] [INFO ] [REMOTE ] CPS: Full fetch complete (36351 records). [2025-10-09T18:12:13.880093] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-09T18:12:14.270351] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-09T18:12:14.270430] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-09T18:12:14.270968] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-09T18:12:14.271033] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-09T18:12:14.272245] [DEBUG] [LOCAL ] CPS: Trimmed 36351 records to 25661 (keeping 200 days of data) [2025-10-09T18:12:14.408600] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-09T18:12:14.430260] [DEBUG] [LOCAL ] CPS: Primary data saved (25661 records). [2025-10-09T18:12:14.430422] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-09T18:12:14.430520] [INFO ] [MAIN ] Update Progress: 521/2373 symbols completed. CPS took 27.4s. Estimated remaining: 4h 16m 35s. Rate: 7.2 symbols/min [2025-10-09T18:12:14.608734] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:14.627556] [DEBUG] [LOCAL ] CQP: Loaded 18929 existing records from primary storage. [2025-10-09T18:12:14.627836] [INFO ] [MAIN ] CQP: Loaded 18929 existing records. [2025-10-09T18:12:14.823286] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:14.824467] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-09T18:12:14.824531] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-09T18:12:14.825264] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-09T18:12:14.825326] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-09T18:12:15.199392] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-09T18:12:15.231099] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:15.356322] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:12:15.996721] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-09T18:12:16.571510] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T18:12:16.798117] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-09T18:12:16.801309] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-09T18:12:16.972724] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T18:12:17.596737] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-09T18:12:18.333078] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T18:12:18.336893] [INFO ] [REMOTE ] CPT: Full fetch complete (64054 records). [2025-10-09T18:12:18.337002] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-09T18:12:18.403407] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-09T18:12:18.717049] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T18:12:18.775864] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-09T18:12:18.775941] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-09T18:12:18.776695] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-09T18:12:18.776757] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-09T18:12:18.778027] [DEBUG] [LOCAL ] CPT: Trimmed 64054 records to 44728 (keeping 200 days of data) [2025-10-09T18:12:19.064979] [DEBUG] [LOCAL ] CPT: Primary data saved (44728 records). [2025-10-09T18:12:19.065101] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-09T18:12:19.065969] [INFO ] [MAIN ] Update Progress: 522/2373 symbols completed. CPT took 32.0s. Estimated remaining: 4h 16m 14s. Rate: 7.2 symbols/min [2025-10-09T18:12:19.209821] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-09T18:12:19.244781] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:19.271567] [DEBUG] [LOCAL ] CR: Loaded 24113 existing records from primary storage. [2025-10-09T18:12:19.271871] [INFO ] [MAIN ] CR: Loaded 24113 existing records. [2025-10-09T18:12:19.451459] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:19.451694] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-09T18:12:19.451751] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-09T18:12:19.451983] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-09T18:12:19.452039] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-09T18:12:19.799314] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:19.996712] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-09T18:12:20.280805] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T18:12:20.796767] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-09T18:12:21.288118] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T18:12:21.297001] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-09T18:12:21.596778] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-09T18:12:22.348986] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T18:12:22.353871] [INFO ] [REMOTE ] CPRI: Full fetch complete (75715 records). [2025-10-09T18:12:22.353995] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-09T18:12:22.354756] [FATAL] [VALIDATOR ] CPRI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:12:22.354847] [FATAL] [MAIN ] CPRI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:12:22.354893] [WARN ] [MAIN ] CPRI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:12:22.354935] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-09T18:12:22.354992] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-10-09T18:12:22.355031] [INFO ] [LOCAL ] CPRI: Starting deletion of derivative data. [2025-10-09T18:12:22.355263] [DEBUG] [LOCAL ] CPRI: Deleted derivative data file. [2025-10-09T18:12:22.355357] [INFO ] [MAIN ] Update Progress: 523/2373 symbols completed. CPRI took 35.3s. Estimated remaining: 4h 15m 48s. Rate: 7.2 symbols/min [2025-10-09T18:12:22.409099] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-09T18:12:22.535940] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:22.551107] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T18:12:22.563311] [DEBUG] [LOCAL ] CRBD: Loaded 9039 existing records from primary storage. [2025-10-09T18:12:22.563506] [INFO ] [MAIN ] CRBD: Loaded 9039 existing records. [2025-10-09T18:12:22.741698] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:22.741909] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-09T18:12:22.741958] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-09T18:12:22.742155] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-09T18:12:22.742214] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-09T18:12:23.098109] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:23.196697] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-09T18:12:23.538496] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T18:12:23.996728] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-09T18:12:24.281556] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T18:12:24.796705] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-09T18:12:25.021191] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T18:12:25.596743] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-09T18:12:25.773006] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T18:12:26.396684] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-09T18:12:26.788552] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T18:12:27.196730] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-09T18:12:27.607261] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T18:12:27.996752] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-09T18:12:28.796732] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-09T18:12:29.274774] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-09T18:12:29.454503] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T18:12:29.596805] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-09T18:12:29.950839] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T18:12:30.396772] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-09T18:12:31.066102] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T18:12:31.196733] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-09T18:12:31.870776] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-09T18:12:31.908097] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T18:12:31.996729] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-09T18:12:32.796701] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-09T18:12:33.085845] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T18:12:33.596729] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-09T18:12:34.396691] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-09T18:12:34.761636] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T18:12:34.775895] [INFO ] [REMOTE ] CPNG: Full fetch complete (77675 records). [2025-10-09T18:12:34.790797] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-09T18:12:34.799390] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T18:12:35.206607] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-09T18:12:35.212053] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-09T18:12:35.212121] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-09T18:12:35.213046] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-09T18:12:35.213250] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-09T18:12:35.214889] [DEBUG] [LOCAL ] CPNG: Trimmed 77675 records to 54060 (keeping 200 days of data) [2025-10-09T18:12:35.441968] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T18:12:35.576011] [DEBUG] [LOCAL ] CPNG: Primary data saved (54060 records). [2025-10-09T18:12:35.576163] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-09T18:12:35.576249] [INFO ] [MAIN ] Update Progress: 524/2373 symbols completed. CPNG took 48.5s. Estimated remaining: 4h 15m 57s. Rate: 7.2 symbols/min [2025-10-09T18:12:35.748550] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:35.798260] [DEBUG] [LOCAL ] CRBG: Loaded 52448 existing records from primary storage. [2025-10-09T18:12:35.798584] [INFO ] [MAIN ] CRBG: Loaded 52448 existing records. [2025-10-09T18:12:35.981175] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:35.984871] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-09T18:12:35.984964] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-09T18:12:35.988587] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T18:12:35.990724] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-09T18:12:35.991525] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-09T18:12:36.002639] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-09T18:12:36.347930] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:36.796716] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-09T18:12:37.187314] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T18:12:37.586937] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T18:12:37.596667] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-09T18:12:38.032869] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T18:12:38.396769] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-09T18:12:39.196752] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-09T18:12:39.996718] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-09T18:12:40.220117] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T18:12:40.246921] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T18:12:40.796737] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-09T18:12:40.978419] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:12:41.596767] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-09T18:12:42.401839] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-09T18:12:42.418076] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T18:12:42.770275] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:12:43.197285] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-09T18:12:43.199785] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T18:12:43.996764] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-09T18:12:44.704949] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T18:12:44.796672] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-09T18:12:44.914152] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-09T18:12:45.596703] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-09T18:12:46.366297] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T18:12:46.396677] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-09T18:12:46.499373] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T18:12:46.929934] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T18:12:47.196701] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-09T18:12:47.785160] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:12:47.786455] [INFO ] [REMOTE ] CRBD: Full fetch complete (13792 records). [2025-10-09T18:12:47.786565] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-09T18:12:48.001876] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-09T18:12:48.156232] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-09T18:12:48.156310] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-09T18:12:48.156606] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-09T18:12:48.156665] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-09T18:12:48.157149] [DEBUG] [LOCAL ] CRBD: Trimmed 13792 records to 9076 (keeping 200 days of data) [2025-10-09T18:12:48.213551] [DEBUG] [LOCAL ] CRBD: Primary data saved (9076 records). [2025-10-09T18:12:48.213730] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-09T18:12:48.213832] [INFO ] [MAIN ] Update Progress: 525/2373 symbols completed. CRBD took 25.9s. Estimated remaining: 4h 16m 4s. Rate: 7.2 symbols/min [2025-10-09T18:12:48.380594] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:48.426220] [DEBUG] [LOCAL ] CRC: Loaded 43809 existing records from primary storage. [2025-10-09T18:12:48.426522] [INFO ] [MAIN ] CRC: Loaded 43809 existing records. [2025-10-09T18:12:48.601262] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:48.601455] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-09T18:12:48.601502] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-09T18:12:48.601892] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-09T18:12:48.601948] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-09T18:12:48.807970] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-09T18:12:48.955236] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:49.596689] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-09T18:12:49.713685] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T18:12:49.822563] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T18:12:50.396741] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-09T18:12:50.559303] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T18:12:50.561431] [INFO ] [REMOTE ] CR: Full fetch complete (34670 records). [2025-10-09T18:12:50.561509] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-09T18:12:50.946922] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-09T18:12:50.947029] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-09T18:12:50.947633] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-09T18:12:50.947718] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-09T18:12:50.948635] [DEBUG] [LOCAL ] CR: Trimmed 34670 records to 24272 (keeping 200 days of data) [2025-10-09T18:12:51.054549] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T18:12:51.117864] [DEBUG] [LOCAL ] CR: Primary data saved (24272 records). [2025-10-09T18:12:51.118014] [INFO ] [MAIN ] CR: Full history saved. [2025-10-09T18:12:51.118101] [INFO ] [MAIN ] Update Progress: 526/2373 symbols completed. CR took 32.1s. Estimated remaining: 4h 15m 36s. Rate: 7.2 symbols/min [2025-10-09T18:12:51.201815] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-09T18:12:51.286198] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:51.286354] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-09T18:12:51.286394] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-09T18:12:51.286506] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-09T18:12:51.286549] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-09T18:12:51.286590] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-09T18:12:51.286624] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-09T18:12:51.664995] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:51.996690] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-09T18:12:52.078592] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T18:12:52.080139] [INFO ] [REMOTE ] CQP: Full fetch complete (30253 records). [2025-10-09T18:12:52.080212] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-09T18:12:52.459938] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-09T18:12:52.460084] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-09T18:12:52.460632] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-09T18:12:52.460717] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-09T18:12:52.461416] [DEBUG] [LOCAL ] CQP: Trimmed 30253 records to 19005 (keeping 200 days of data) [2025-10-09T18:12:52.579174] [DEBUG] [LOCAL ] CQP: Primary data saved (19005 records). [2025-10-09T18:12:52.579328] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-09T18:12:52.579427] [INFO ] [MAIN ] Update Progress: 527/2373 symbols completed. CQP took 38.1s. Estimated remaining: 4h 15m 4s. Rate: 7.2 symbols/min [2025-10-09T18:12:52.754523] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:52.809439] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-09T18:12:52.812306] [DEBUG] [LOCAL ] CRGY: Loaded 52481 existing records from primary storage. [2025-10-09T18:12:52.812727] [INFO ] [MAIN ] CRGY: Loaded 52481 existing records. [2025-10-09T18:12:52.993607] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:12:52.993869] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-09T18:12:52.993931] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-09T18:12:52.995186] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-09T18:12:52.995247] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-09T18:12:53.088813] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:12:53.104408] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-09T18:12:53.114885] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:12:53.139168] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-09T18:12:53.155248] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:12:53.175203] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-09T18:12:53.182443] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-09T18:12:53.182667] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-09T18:12:53.216674] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-09T18:12:53.225197] [INFO ] [MAIN ] Update Progress: 528/2373 symbols completed. CRCL took 2.1s. Estimated remaining: 4h 14m 29s. Rate: 7.2 symbols/min [2025-10-09T18:12:53.490202] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:53.551544] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:12:53.551862] [DEBUG] [LOCAL ] CRH: No existing data file found in primary storage. [2025-10-09T18:12:53.551936] [WARN ] [MAIN ] CRH: No existing data found, performing full refresh instead. [2025-10-09T18:12:53.552124] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-09T18:12:53.552327] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-09T18:12:53.552404] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-09T18:12:53.552452] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-09T18:12:53.599908] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-09T18:12:53.684171] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T18:12:53.976700] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:12:54.396722] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-09T18:12:55.196699] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-09T18:12:55.513094] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T18:12:55.811007] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T18:12:55.996734] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-09T18:12:56.796707] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-09T18:12:56.923560] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:12:57.597422] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-09T18:12:57.597347] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T18:12:58.396699] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-09T18:12:58.462599] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:12:59.196688] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-09T18:12:59.465168] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-09T18:12:59.996682] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-09T18:13:00.248480] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T18:13:00.796718] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-09T18:13:00.897497] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T18:13:01.596696] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-09T18:13:01.768474] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T18:13:02.084577] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T18:13:02.396737] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-09T18:13:02.710865] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T18:13:03.196719] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-09T18:13:03.996690] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-09T18:13:04.123710] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T18:13:04.405870] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:13:04.796742] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-09T18:13:05.596731] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-09T18:13:05.892961] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-09T18:13:06.295012] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T18:13:06.396675] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-09T18:13:07.196693] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-09T18:13:07.587562] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T18:13:07.996722] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-09T18:13:08.092496] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T18:13:08.796739] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-09T18:13:08.950530] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:13:09.596741] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-09T18:13:09.772978] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T18:13:10.390750] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:13:10.400005] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-09T18:13:11.196722] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-09T18:13:11.464385] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-09T18:13:11.996777] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-09T18:13:12.441760] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-09T18:13:12.796727] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-09T18:13:13.034373] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T18:13:13.038950] [INFO ] [REMOTE ] CRBG: Full fetch complete (75763 records). [2025-10-09T18:13:13.039091] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-09T18:13:13.441548] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-09T18:13:13.441677] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-09T18:13:13.442666] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-09T18:13:13.442736] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-09T18:13:13.444281] [DEBUG] [LOCAL ] CRBG: Trimmed 75763 records to 52836 (keeping 200 days of data) [2025-10-09T18:13:13.636702] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-09T18:13:13.779119] [DEBUG] [LOCAL ] CRBG: Primary data saved (52836 records). [2025-10-09T18:13:13.779283] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-09T18:13:13.779495] [INFO ] [MAIN ] Update Progress: 529/2373 symbols completed. CRBG took 38.2s. Estimated remaining: 4h 15m 4s. Rate: 7.2 symbols/min [2025-10-09T18:13:13.960575] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:13.996638] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T18:13:14.049082] [DEBUG] [LOCAL ] CRI: Loaded 49762 existing records from primary storage. [2025-10-09T18:13:14.049387] [INFO ] [MAIN ] CRI: Loaded 49762 existing records. [2025-10-09T18:13:14.230667] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:13:14.230926] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-09T18:13:14.230987] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-09T18:13:14.231962] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-09T18:13:14.232023] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-09T18:13:14.402733] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-09T18:13:14.602544] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T18:13:14.645339] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:15.196717] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-09T18:13:15.234358] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T18:13:15.837900] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T18:13:15.996731] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-09T18:13:16.796702] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-09T18:13:17.208472] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T18:13:17.596695] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-09T18:13:17.815200] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T18:13:18.396712] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-09T18:13:18.449414] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T18:13:19.152445] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T18:13:19.196678] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-09T18:13:19.996766] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-09T18:13:20.218366] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T18:13:20.796768] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-09T18:13:20.996431] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T18:13:21.526597] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T18:13:21.530427] [INFO ] [REMOTE ] CRC: Full fetch complete (62553 records). [2025-10-09T18:13:21.530515] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-09T18:13:21.604599] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-09T18:13:21.993708] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-09T18:13:21.993858] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-09T18:13:21.994915] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-09T18:13:21.995089] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-09T18:13:21.997100] [DEBUG] [LOCAL ] CRC: Trimmed 62553 records to 44150 (keeping 200 days of data) [2025-10-09T18:13:22.160182] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T18:13:22.397208] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-09T18:13:22.409736] [DEBUG] [LOCAL ] CRC: Primary data saved (44150 records). [2025-10-09T18:13:22.409945] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-09T18:13:22.411320] [INFO ] [MAIN ] Update Progress: 530/2373 symbols completed. CRC took 34.2s. Estimated remaining: 4h 14m 56s. Rate: 7.2 symbols/min [2025-10-09T18:13:22.649254] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:22.710617] [DEBUG] [LOCAL ] CRK: Loaded 52203 existing records from primary storage. [2025-10-09T18:13:22.711013] [INFO ] [MAIN ] CRK: Loaded 52203 existing records. [2025-10-09T18:13:22.933759] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:13:22.933992] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-09T18:13:22.934044] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-09T18:13:22.935309] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-09T18:13:22.935371] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-09T18:13:23.200038] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-09T18:13:23.312585] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:23.510481] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:13:23.996700] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-09T18:13:24.446472] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-09T18:13:24.796710] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-09T18:13:24.863439] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T18:13:25.596683] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-09T18:13:25.830072] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T18:13:25.834553] [INFO ] [REMOTE ] CRGY: Full fetch complete (75933 records). [2025-10-09T18:13:25.834715] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-09T18:13:26.237869] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-09T18:13:26.238031] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-09T18:13:26.238988] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-09T18:13:26.239052] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-09T18:13:26.240533] [DEBUG] [LOCAL ] CRGY: Trimmed 75933 records to 52852 (keeping 200 days of data) [2025-10-09T18:13:26.418343] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-09T18:13:26.568424] [DEBUG] [LOCAL ] CRGY: Primary data saved (52852 records). [2025-10-09T18:13:26.568560] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-09T18:13:26.568697] [INFO ] [MAIN ] Update Progress: 531/2373 symbols completed. CRGY took 34.0s. Estimated remaining: 4h 14m 34s. Rate: 7.2 symbols/min [2025-10-09T18:13:26.749983] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:26.782164] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-09T18:13:26.831666] [DEBUG] [LOCAL ] CRL: Loaded 42811 existing records from primary storage. [2025-10-09T18:13:26.831963] [INFO ] [MAIN ] CRL: Loaded 42811 existing records. [2025-10-09T18:13:27.015002] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:13:27.015297] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-09T18:13:27.015380] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-09T18:13:27.016590] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-09T18:13:27.016739] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-09T18:13:27.201837] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-09T18:13:27.388465] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:27.418830] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T18:13:27.996682] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-09T18:13:28.323711] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:13:28.796714] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-09T18:13:28.931457] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:13:29.596704] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-09T18:13:29.730279] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:13:30.396721] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-09T18:13:30.642356] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T18:13:30.647011] [INFO ] [REMOTE ] CRH: Full fetch complete (77296 records). [2025-10-09T18:13:30.647163] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-09T18:13:31.046163] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-09T18:13:31.046380] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-09T18:13:31.047430] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-09T18:13:31.047520] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-09T18:13:31.049404] [DEBUG] [LOCAL ] CRH: Trimmed 77296 records to 53841 (keeping 200 days of data) [2025-10-09T18:13:31.168808] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T18:13:31.196892] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-09T18:13:31.422946] [DEBUG] [LOCAL ] CRH: Primary data saved (53841 records). [2025-10-09T18:13:31.423097] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-09T18:13:31.423173] [INFO ] [MAIN ] Update Progress: 532/2373 symbols completed. CRH took 38.2s. Estimated remaining: 4h 14m 14s. Rate: 7.2 symbols/min [2025-10-09T18:13:31.590199] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:31.645039] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-09T18:13:31.645363] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-09T18:13:31.822219] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:13:31.822620] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-09T18:13:31.822718] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-09T18:13:31.823117] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-09T18:13:31.823177] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-09T18:13:31.999741] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-09T18:13:32.188577] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:32.219818] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T18:13:32.796687] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-09T18:13:32.985274] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T18:13:33.596763] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-09T18:13:33.642306] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:13:34.079942] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T18:13:34.396725] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-09T18:13:35.196719] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-09T18:13:35.991489] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T18:13:36.001844] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-09T18:13:36.113207] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-10-09T18:13:36.796737] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-09T18:13:37.110698] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T18:13:37.296974] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T18:13:37.596781] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-09T18:13:38.396743] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-09T18:13:38.982469] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-09T18:13:39.060369] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T18:13:39.196729] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-09T18:13:39.996690] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-09T18:13:40.446118] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T18:13:40.796748] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-09T18:13:41.429894] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-09T18:13:41.596782] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-09T18:13:41.664365] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T18:13:42.084442] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T18:13:42.396741] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-09T18:13:43.196769] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-09T18:13:43.624851] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-09T18:13:43.914933] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T18:13:43.996692] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-09T18:13:44.412083] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T18:13:44.796711] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-09T18:13:45.596722] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-09T18:13:45.770597] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:13:46.396771] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-09T18:13:47.022321] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-09T18:13:47.043550] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T18:13:47.048258] [INFO ] [REMOTE ] CRI: Full fetch complete (70809 records). [2025-10-09T18:13:47.048420] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-09T18:13:47.204213] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-09T18:13:47.437570] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-09T18:13:47.437673] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-09T18:13:47.438522] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-09T18:13:47.438583] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-09T18:13:47.439955] [DEBUG] [LOCAL ] CRI: Trimmed 70809 records to 50079 (keeping 200 days of data) [2025-10-09T18:13:47.761281] [DEBUG] [LOCAL ] CRI: Primary data saved (50079 records). [2025-10-09T18:13:47.761407] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-09T18:13:47.761504] [INFO ] [MAIN ] Update Progress: 533/2373 symbols completed. CRI took 34.0s. Estimated remaining: 4h 14m 33s. Rate: 7.2 symbols/min [2025-10-09T18:13:47.934977] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:47.974908] [DEBUG] [LOCAL ] CRS: Loaded 43154 existing records from primary storage. [2025-10-09T18:13:47.975222] [INFO ] [MAIN ] CRS: Loaded 43154 existing records. [2025-10-09T18:13:48.008220] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-09T18:13:48.166751] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:13:48.167123] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-09T18:13:48.167376] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-09T18:13:48.167739] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-09T18:13:48.167804] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-09T18:13:48.478895] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-09T18:13:48.568762] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:48.796710] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-09T18:13:49.596742] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-09T18:13:49.652960] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-09T18:13:49.807103] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:13:50.401788] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-09T18:13:50.415962] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:13:51.196729] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-09T18:13:51.287673] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:13:51.996703] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-09T18:13:52.550614] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-09T18:13:52.768381] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T18:13:52.796673] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-09T18:13:53.467589] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T18:13:53.472139] [INFO ] [REMOTE ] CRK: Full fetch complete (75623 records). [2025-10-09T18:13:53.472257] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-09T18:13:53.608059] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-09T18:13:53.856394] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-09T18:13:53.856480] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-09T18:13:53.857464] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-09T18:13:53.857539] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-09T18:13:53.859103] [DEBUG] [LOCAL ] CRK: Trimmed 75623 records to 52593 (keeping 200 days of data) [2025-10-09T18:13:54.192028] [DEBUG] [LOCAL ] CRK: Primary data saved (52593 records). [2025-10-09T18:13:54.192258] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-09T18:13:54.193559] [INFO ] [MAIN ] Update Progress: 534/2373 symbols completed. CRK took 31.8s. Estimated remaining: 4h 14m 18s. Rate: 7.2 symbols/min [2025-10-09T18:13:54.394594] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-09T18:13:54.403360] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:13:54.400033] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-09T18:13:54.412359] [DEBUG] [LOCAL ] CRT: No existing data file found in primary storage. [2025-10-09T18:13:54.412841] [WARN ] [MAIN ] CRT: No existing data found, performing full refresh instead. [2025-10-09T18:13:54.412968] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-09T18:13:54.413014] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-09T18:13:54.413056] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-10-09T18:13:54.413090] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-09T18:13:54.794545] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:13:55.196752] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-09T18:13:55.341817] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T18:13:55.819773] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T18:13:55.996712] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-09T18:13:56.507071] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-09T18:13:56.796736] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-09T18:13:57.395499] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T18:13:57.433072] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:13:57.596736] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-09T18:13:58.170586] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T18:13:58.396771] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-09T18:13:59.196758] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-09T18:13:59.882480] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T18:13:59.996712] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-09T18:14:00.796799] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-09T18:14:01.428934] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T18:14:01.578349] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T18:14:01.596691] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-09T18:14:01.807257] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-09T18:14:02.075030] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T18:14:02.396730] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-09T18:14:03.196766] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-09T18:14:03.825467] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T18:14:03.996689] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-09T18:14:04.598442] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T18:14:04.796726] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-09T18:14:04.939552] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-09T18:14:05.596723] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-09T18:14:06.191266] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T18:14:06.396729] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-09T18:14:06.564826] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T18:14:07.085338] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T18:14:07.090673] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-09T18:14:07.090879] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-09T18:14:07.201948] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-09T18:14:07.576719] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-09T18:14:07.576847] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-09T18:14:07.577973] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-09T18:14:07.578043] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-09T18:14:07.579824] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54160 (keeping 200 days of data) [2025-10-09T18:14:07.970819] [DEBUG] [LOCAL ] CRM: Primary data saved (54160 records). [2025-10-09T18:14:07.971036] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-09T18:14:07.971976] [INFO ] [MAIN ] Update Progress: 535/2373 symbols completed. CRM took 36.5s. Estimated remaining: 4h 14m 29s. Rate: 7.2 symbols/min [2025-10-09T18:14:08.001803] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-09T18:14:08.162361] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:08.201962] [DEBUG] [LOCAL ] CSAN: Loaded 42145 existing records from primary storage. [2025-10-09T18:14:08.202286] [INFO ] [MAIN ] CSAN: Loaded 42145 existing records. [2025-10-09T18:14:08.373799] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:08.374047] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-09T18:14:08.374097] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-09T18:14:08.374396] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-09T18:14:08.374452] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-09T18:14:08.739770] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:08.765449] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T18:14:08.796784] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-09T18:14:09.339180] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T18:14:09.596735] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-09T18:14:09.679072] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T18:14:10.304669] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T18:14:10.396701] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-09T18:14:11.196785] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-09T18:14:11.726925] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T18:14:11.996739] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-09T18:14:12.550729] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T18:14:12.796759] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-09T18:14:13.462440] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-09T18:14:13.463418] [INFO ] [REMOTE ] CRT: Full fetch complete (7470 records). [2025-10-09T18:14:13.463487] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-09T18:14:13.607871] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-09T18:14:13.753796] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T18:14:13.773618] [INFO ] [REMOTE ] CRL: Full fetch complete (63313 records). [2025-10-09T18:14:13.783995] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-09T18:14:13.955428] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-09T18:14:13.955573] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-09T18:14:13.955814] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-09T18:14:13.956134] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-09T18:14:13.972215] [DEBUG] [LOCAL ] CRT: Trimmed 7470 records to 4999 (keeping 200 days of data) [2025-10-09T18:14:14.193507] [DEBUG] [LOCAL ] CRT: Primary data saved (4999 records). [2025-10-09T18:14:14.214063] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-09T18:14:14.214927] [INFO ] [MAIN ] Update Progress: 536/2373 symbols completed. CRT took 20.0s. Estimated remaining: 4h 14m 13s. Rate: 7.2 symbols/min [2025-10-09T18:14:14.398441] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-09T18:14:14.491539] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-09T18:14:14.491851] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-09T18:14:14.492938] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-09T18:14:14.493035] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-09T18:14:14.522730] [DEBUG] [LOCAL ] CRL: Trimmed 63313 records to 43158 (keeping 200 days of data) [2025-10-09T18:14:14.752316] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:14.969911] [DEBUG] [LOCAL ] CSL: Loaded 31443 existing records from primary storage. [2025-10-09T18:14:14.972056] [INFO ] [MAIN ] CSL: Loaded 31443 existing records. [2025-10-09T18:14:15.274208] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:15.276281] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-09T18:14:15.276857] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-09T18:14:15.280364] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-09T18:14:15.280914] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-09T18:14:15.426893] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T18:14:15.498121] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-09T18:14:15.655115] [DEBUG] [LOCAL ] CRL: Primary data saved (43158 records). [2025-10-09T18:14:15.659142] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-09T18:14:15.664921] [INFO ] [MAIN ] Update Progress: 537/2373 symbols completed. CRL took 49.1s. Estimated remaining: 4h 13m 42s. Rate: 7.2 symbols/min [2025-10-09T18:14:15.786694] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:15.923514] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:15.951895] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T18:14:15.971331] [DEBUG] [LOCAL ] CSR: Loaded 12972 existing records from primary storage. [2025-10-09T18:14:15.971560] [INFO ] [MAIN ] CSR: Loaded 12972 existing records. [2025-10-09T18:14:16.003339] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-09T18:14:16.183243] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:16.183457] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-09T18:14:16.183506] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-09T18:14:16.183794] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-09T18:14:16.183853] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-09T18:14:16.540002] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:16.796746] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-09T18:14:16.915230] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:14:17.596687] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-09T18:14:17.859521] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-09T18:14:18.298185] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T18:14:18.396702] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-09T18:14:18.953838] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T18:14:19.196713] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-09T18:14:19.198251] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T18:14:19.996778] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-09T18:14:20.112265] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T18:14:20.796755] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-09T18:14:21.481635] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T18:14:21.596717] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-09T18:14:22.329038] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T18:14:22.396723] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-09T18:14:23.203062] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-09T18:14:23.221182] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T18:14:23.475674] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T18:14:23.996743] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-09T18:14:24.462859] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:14:24.796749] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-09T18:14:25.564159] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T18:14:25.596681] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-09T18:14:26.254378] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T18:14:26.396747] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-09T18:14:26.982776] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T18:14:27.196747] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-09T18:14:27.666866] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T18:14:27.670806] [INFO ] [REMOTE ] CRS: Full fetch complete (62593 records). [2025-10-09T18:14:27.670966] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-09T18:14:28.004884] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-09T18:14:28.062043] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-09T18:14:28.062122] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-09T18:14:28.062952] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-09T18:14:28.063017] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-09T18:14:28.064328] [DEBUG] [LOCAL ] CRS: Trimmed 62593 records to 43462 (keeping 200 days of data) [2025-10-09T18:14:28.352424] [DEBUG] [LOCAL ] CRS: Primary data saved (43462 records). [2025-10-09T18:14:28.352589] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-09T18:14:28.352709] [INFO ] [MAIN ] Update Progress: 538/2373 symbols completed. CRS took 40.6s. Estimated remaining: 4h 13m 48s. Rate: 7.2 symbols/min [2025-10-09T18:14:28.505739] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T18:14:28.560427] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:28.603244] [DEBUG] [LOCAL ] CSTM: Loaded 47541 existing records from primary storage. [2025-10-09T18:14:28.603534] [INFO ] [MAIN ] CSTM: Loaded 47541 existing records. [2025-10-09T18:14:28.791381] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:28.791603] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-09T18:14:28.791674] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-09T18:14:28.792019] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-09T18:14:28.792076] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-09T18:14:28.803065] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-09T18:14:29.160584] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:29.341235] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:14:29.596720] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-09T18:14:29.659439] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T18:14:30.396709] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-09T18:14:31.198082] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-09T18:14:31.203368] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T18:14:31.308391] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T18:14:31.996687] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-09T18:14:32.284330] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T18:14:32.796745] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-09T18:14:33.433809] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T18:14:33.596722] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-09T18:14:33.761771] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T18:14:34.396728] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-09T18:14:35.196726] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-09T18:14:35.283682] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:14:35.750013] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T18:14:35.996745] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-09T18:14:36.636946] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T18:14:36.796715] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-09T18:14:37.330227] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T18:14:37.333787] [INFO ] [REMOTE ] CSAN: Full fetch complete (60315 records). [2025-10-09T18:14:37.333925] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-09T18:14:37.601799] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-09T18:14:37.733940] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-09T18:14:37.734032] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-09T18:14:37.734775] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-09T18:14:37.734839] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-09T18:14:37.736105] [DEBUG] [LOCAL ] CSAN: Trimmed 60315 records to 42377 (keeping 200 days of data) [2025-10-09T18:14:37.976466] [DEBUG] [LOCAL ] CSAN: Primary data saved (42377 records). [2025-10-09T18:14:37.976637] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-09T18:14:37.977250] [INFO ] [MAIN ] Update Progress: 539/2373 symbols completed. CSAN took 30.0s. Estimated remaining: 4h 13m 45s. Rate: 7.2 symbols/min [2025-10-09T18:14:38.146847] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:38.162874] [DEBUG] [LOCAL ] CSV: Loaded 12748 existing records from primary storage. [2025-10-09T18:14:38.163155] [INFO ] [MAIN ] CSV: Loaded 12748 existing records. [2025-10-09T18:14:38.343811] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:38.344227] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-09T18:14:38.344465] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-09T18:14:38.349550] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-09T18:14:38.350978] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-09T18:14:38.362855] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T18:14:38.398518] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-09T18:14:38.538905] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T18:14:38.821945] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:39.196720] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-09T18:14:39.695774] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T18:14:39.942207] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T18:14:39.996703] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-09T18:14:40.796749] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-09T18:14:41.015480] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T18:14:41.596719] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-09T18:14:42.072308] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T18:14:42.075215] [INFO ] [REMOTE ] CSL: Full fetch complete (45301 records). [2025-10-09T18:14:42.075313] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-09T18:14:42.266050] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-09T18:14:42.401807] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-09T18:14:42.480016] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-09T18:14:42.480094] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-09T18:14:42.480725] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-09T18:14:42.480789] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-09T18:14:42.481835] [DEBUG] [LOCAL ] CSL: Trimmed 45301 records to 31693 (keeping 200 days of data) [2025-10-09T18:14:42.686433] [DEBUG] [LOCAL ] CSL: Primary data saved (31693 records). [2025-10-09T18:14:42.686578] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-09T18:14:42.687506] [INFO ] [MAIN ] Update Progress: 540/2373 symbols completed. CSL took 28.5s. Estimated remaining: 4h 13m 24s. Rate: 7.2 symbols/min [2025-10-09T18:14:42.857163] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:42.857346] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-09T18:14:42.857385] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-09T18:14:42.857499] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-09T18:14:42.857541] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-09T18:14:42.857583] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-09T18:14:42.857619] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-09T18:14:43.204825] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-09T18:14:43.209528] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:43.460349] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T18:14:43.996746] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-09T18:14:44.796759] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-09T18:14:44.943469] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T18:14:44.991433] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:14:44.992291] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T18:14:44.993789] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-09T18:14:44.996523] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:14:44.996916] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-09T18:14:44.996991] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:14:44.997088] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-09T18:14:44.997193] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-09T18:14:44.997261] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-09T18:14:44.997331] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-09T18:14:44.997401] [INFO ] [MAIN ] Update Progress: 541/2373 symbols completed. CSW took 2.3s. Estimated remaining: 4h 12m 56s. Rate: 7.2 symbols/min [2025-10-09T18:14:45.166337] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:45.177575] [DEBUG] [LOCAL ] CTBB: Loaded 7044 existing records from primary storage. [2025-10-09T18:14:45.177827] [INFO ] [MAIN ] CTBB: Loaded 7044 existing records. [2025-10-09T18:14:45.359090] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:45.359327] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-09T18:14:45.359394] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-09T18:14:45.359627] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-09T18:14:45.359737] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-09T18:14:45.604612] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-09T18:14:45.726425] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:46.396726] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-09T18:14:46.610204] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T18:14:47.196716] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-09T18:14:47.255249] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T18:14:47.996754] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-09T18:14:48.764362] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T18:14:48.788889] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T18:14:48.796670] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-09T18:14:49.359462] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-09T18:14:49.596736] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-09T18:14:50.240474] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T18:14:50.396741] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-09T18:14:51.196692] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-09T18:14:51.205952] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T18:14:51.996686] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-09T18:14:52.226453] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T18:14:52.602213] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-09T18:14:52.796786] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-09T18:14:53.596719] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-09T18:14:54.396731] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-09T18:14:54.418926] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T18:14:54.451270] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T18:14:55.139961] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:14:55.196678] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-09T18:14:55.996711] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-09T18:14:56.022639] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T18:14:56.024224] [INFO ] [REMOTE ] CSV: Full fetch complete (19308 records). [2025-10-09T18:14:56.024295] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-09T18:14:56.466508] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-09T18:14:56.466590] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-09T18:14:56.467048] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-09T18:14:56.467113] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-09T18:14:56.467687] [DEBUG] [LOCAL ] CSV: Trimmed 19308 records to 12804 (keeping 200 days of data) [2025-10-09T18:14:56.557301] [DEBUG] [LOCAL ] CSV: Primary data saved (12804 records). [2025-10-09T18:14:56.557449] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-09T18:14:56.557537] [INFO ] [MAIN ] Update Progress: 542/2373 symbols completed. CSV took 18.6s. Estimated remaining: 4h 12m 58s. Rate: 7.2 symbols/min [2025-10-09T18:14:56.723196] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:14:56.730974] [DEBUG] [LOCAL ] CTDD: Loaded 5820 existing records from primary storage. [2025-10-09T18:14:56.731142] [INFO ] [MAIN ] CTDD: Loaded 5820 existing records. [2025-10-09T18:14:56.803586] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-09T18:14:56.910772] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:14:56.911010] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-09T18:14:56.911067] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-09T18:14:56.911236] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-09T18:14:56.911294] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-09T18:14:57.272412] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:14:57.596687] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-09T18:14:57.653396] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T18:14:57.680284] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T18:14:58.097820] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-09T18:14:58.396690] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-09T18:14:59.196741] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-09T18:14:59.244418] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T18:14:59.996760] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-09T18:15:00.031773] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T18:15:00.516897] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T18:15:00.796731] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-09T18:15:01.537347] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T18:15:01.596774] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-09T18:15:02.396772] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-09T18:15:03.174611] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T18:15:03.196667] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-09T18:15:03.276046] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T18:15:03.773593] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T18:15:03.996800] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-09T18:15:04.796748] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-09T18:15:05.503889] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T18:15:05.596693] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-09T18:15:05.634265] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T18:15:06.200633] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T18:15:06.396767] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-09T18:15:07.176588] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T18:15:07.196794] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-09T18:15:07.996812] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-09T18:15:08.051399] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T18:15:08.721696] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T18:15:08.796763] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-09T18:15:09.503906] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T18:15:09.596742] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-09T18:15:10.396783] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-09T18:15:10.659162] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T18:15:10.660920] [INFO ] [REMOTE ] CSR: Full fetch complete (17717 records). [2025-10-09T18:15:10.660993] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-09T18:15:11.036044] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-09T18:15:11.036147] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-09T18:15:11.036537] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-09T18:15:11.036578] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-09T18:15:11.037428] [DEBUG] [LOCAL ] CSR: Trimmed 17717 records to 13088 (keeping 200 days of data) [2025-10-09T18:15:11.117775] [DEBUG] [LOCAL ] CSR: Primary data saved (13088 records). [2025-10-09T18:15:11.117929] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-09T18:15:11.118017] [INFO ] [MAIN ] Update Progress: 543/2373 symbols completed. CSR took 55.4s. Estimated remaining: 4h 13m 11s. Rate: 7.2 symbols/min [2025-10-09T18:15:11.197527] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-09T18:15:11.206054] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T18:15:11.224551] [INFO ] [REMOTE ] CTBB: Full fetch complete (10506 records). [2025-10-09T18:15:11.264755] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-09T18:15:11.371806] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:11.395918] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-09T18:15:11.398474] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-09T18:15:11.404439] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-09T18:15:11.409672] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-09T18:15:11.425115] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-09T18:15:11.443344] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-09T18:15:11.927959] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-09T18:15:11.938562] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-09T18:15:11.949220] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-09T18:15:11.949338] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-09T18:15:11.965721] [DEBUG] [LOCAL ] CTBB: Trimmed 10506 records to 7084 (keeping 200 days of data) [2025-10-09T18:15:11.998966] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-09T18:15:12.028254] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:12.076339] [DEBUG] [LOCAL ] CTBB: Primary data saved (7084 records). [2025-10-09T18:15:12.076485] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-09T18:15:12.076571] [INFO ] [MAIN ] Update Progress: 544/2373 symbols completed. CTBB took 27.1s. Estimated remaining: 4h 12m 38s. Rate: 7.2 symbols/min [2025-10-09T18:15:12.247564] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:12.247761] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-09T18:15:12.247807] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-09T18:15:12.247993] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-09T18:15:12.248042] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-09T18:15:12.248084] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-09T18:15:12.248141] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-09T18:15:12.612878] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:12.661952] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T18:15:12.689434] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T18:15:12.796672] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-09T18:15:13.596703] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-09T18:15:13.911158] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:15:13.911550] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-09T18:15:13.911661] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:15:13.911750] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-09T18:15:13.911814] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:15:13.911883] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-09T18:15:13.911948] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-09T18:15:13.911997] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-09T18:15:13.912065] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-09T18:15:13.912114] [INFO ] [MAIN ] Update Progress: 545/2373 symbols completed. CTEV took 1.8s. Estimated remaining: 4h 12m 8s. Rate: 7.2 symbols/min [2025-10-09T18:15:14.077617] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:14.112725] [DEBUG] [LOCAL ] CTO: Loaded 27825 existing records from primary storage. [2025-10-09T18:15:14.113017] [INFO ] [MAIN ] CTO: Loaded 27825 existing records. [2025-10-09T18:15:14.302692] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:15:14.302911] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-09T18:15:14.302959] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-09T18:15:14.303212] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-09T18:15:14.303269] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-09T18:15:14.403151] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-09T18:15:14.672173] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T18:15:14.677412] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:14.682334] [INFO ] [REMOTE ] CSTM: Full fetch complete (69339 records). [2025-10-09T18:15:14.682470] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-09T18:15:14.855361] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:15:14.889958] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-09T18:15:14.918211] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:15:14.973597] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-09T18:15:15.001216] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:15:15.008680] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-09T18:15:15.038212] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-09T18:15:15.042865] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-09T18:15:15.043248] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-09T18:15:15.053860] [INFO ] [MAIN ] Update Progress: 546/2373 symbols completed. CTEST took 3.9s. Estimated remaining: 4h 11m 36s. Rate: 7.3 symbols/min [2025-10-09T18:15:15.203355] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-09T18:15:15.272310] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-09T18:15:15.276731] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-09T18:15:15.277884] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-09T18:15:15.278368] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-09T18:15:15.335305] [DEBUG] [LOCAL ] CSTM: Trimmed 69339 records to 47875 (keeping 200 days of data) [2025-10-09T18:15:15.356714] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:15.357328] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-09T18:15:15.357402] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-09T18:15:15.357897] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-09T18:15:15.358007] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-09T18:15:15.358073] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-09T18:15:15.358108] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-09T18:15:15.980226] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:16.016362] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-09T18:15:16.099771] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T18:15:16.113061] [DEBUG] [LOCAL ] CSTM: Primary data saved (47875 records). [2025-10-09T18:15:16.113235] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-09T18:15:16.113326] [INFO ] [MAIN ] Update Progress: 547/2373 symbols completed. CSTM took 47.8s. Estimated remaining: 4h 11m 4s. Rate: 7.3 symbols/min [2025-10-09T18:15:16.278831] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:16.329630] [DEBUG] [LOCAL ] CTRA: Loaded 53646 existing records from primary storage. [2025-10-09T18:15:16.330023] [INFO ] [MAIN ] CTRA: Loaded 53646 existing records. [2025-10-09T18:15:16.506161] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:15:16.506379] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-09T18:15:16.506426] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-09T18:15:16.506850] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-09T18:15:16.506908] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-09T18:15:16.801791] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-09T18:15:16.857922] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:17.423419] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T18:15:17.551335] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:15:17.596683] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-09T18:15:18.396792] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-09T18:15:18.780274] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-09T18:15:19.196721] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-09T18:15:19.435061] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T18:15:19.821815] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T18:15:19.996772] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-09T18:15:20.796686] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-09T18:15:21.115097] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T18:15:21.596757] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-09T18:15:21.756462] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T18:15:22.396718] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-09T18:15:22.434369] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T18:15:23.196732] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-09T18:15:23.621512] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T18:15:23.705584] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T18:15:23.996738] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-09T18:15:24.351258] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T18:15:24.796762] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-09T18:15:25.596709] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-09T18:15:26.247041] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T18:15:26.396710] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-09T18:15:26.810044] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:15:26.844797] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-09T18:15:26.845593] [INFO ] [REMOTE ] CTDD: Full fetch complete (8236 records). [2025-10-09T18:15:26.845699] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-09T18:15:27.197128] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-09T18:15:27.197540] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-09T18:15:27.197673] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-09T18:15:27.198793] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-09T18:15:27.198865] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-09T18:15:27.199376] [DEBUG] [LOCAL ] CTDD: Trimmed 8236 records to 5834 (keeping 200 days of data) [2025-10-09T18:15:27.237101] [DEBUG] [LOCAL ] CTDD: Primary data saved (5834 records). [2025-10-09T18:15:27.237201] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-09T18:15:27.237280] [INFO ] [MAIN ] Update Progress: 548/2373 symbols completed. CTDD took 30.7s. Estimated remaining: 4h 11m 5s. Rate: 7.3 symbols/min [2025-10-09T18:15:27.403015] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:27.445599] [DEBUG] [LOCAL ] CTRE: Loaded 49289 existing records from primary storage. [2025-10-09T18:15:27.445923] [INFO ] [MAIN ] CTRE: Loaded 49289 existing records. [2025-10-09T18:15:27.629492] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:15:27.629746] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-09T18:15:27.629823] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-09T18:15:27.630149] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-09T18:15:27.630227] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-09T18:15:27.980776] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:27.996695] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-09T18:15:28.717560] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T18:15:28.796730] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-09T18:15:29.530308] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:15:29.596680] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-09T18:15:30.345102] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:15:30.396733] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-09T18:15:31.080408] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T18:15:31.196679] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-09T18:15:31.844328] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T18:15:31.996708] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-09T18:15:32.796782] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-09T18:15:32.946505] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:15:33.514849] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T18:15:33.596717] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-09T18:15:33.857611] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T18:15:34.396727] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-09T18:15:35.196688] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-09T18:15:35.454471] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T18:15:35.658820] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T18:15:35.996681] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-09T18:15:36.250550] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T18:15:36.796725] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-09T18:15:37.291539] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T18:15:37.596734] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-09T18:15:38.396760] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-09T18:15:38.709046] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T18:15:39.124961] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T18:15:39.196745] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-09T18:15:39.547583] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T18:15:39.996714] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-09T18:15:40.776149] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T18:15:40.796691] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-09T18:15:41.055415] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T18:15:41.596728] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-09T18:15:42.152620] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T18:15:42.396739] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-09T18:15:43.196746] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-09T18:15:43.344619] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:15:43.716082] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T18:15:43.996754] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-09T18:15:44.770050] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T18:15:44.796690] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-09T18:15:45.244851] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T18:15:45.596770] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-09T18:15:45.993418] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T18:15:46.396723] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-09T18:15:46.998936] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T18:15:47.002470] [INFO ] [REMOTE ] CTO: Full fetch complete (41682 records). [2025-10-09T18:15:47.002560] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-09T18:15:47.201879] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-09T18:15:47.385310] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-09T18:15:47.385416] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-09T18:15:47.386239] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-09T18:15:47.386361] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-09T18:15:47.387440] [DEBUG] [LOCAL ] CTO: Trimmed 41682 records to 28051 (keeping 200 days of data) [2025-10-09T18:15:47.560853] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:15:47.565223] [INFO ] [REMOTE ] CTOS: Full fetch complete (53275 records). [2025-10-09T18:15:47.565881] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-09T18:15:47.567258] [FATAL] [VALIDATOR ] CTOS: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:15:47.568365] [FATAL] [MAIN ] CTOS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:15:47.569715] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:15:47.572309] [DEBUG] [LOCAL ] CTO: Primary data saved (28051 records). [2025-10-09T18:15:47.572380] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-09T18:15:47.572517] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-09T18:15:47.573350] [INFO ] [MAIN ] Update Progress: 549/2373 symbols completed. CTO took 33.7s. Estimated remaining: 4h 11m 37s. Rate: 7.2 symbols/min [2025-10-09T18:15:47.572593] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-09T18:15:47.584801] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-10-09T18:15:47.594477] [DEBUG] [LOCAL ] CTOS: No derivative data file found to delete. [2025-10-09T18:15:47.617083] [INFO ] [MAIN ] Update Progress: 550/2373 symbols completed. CTOS took 32.6s. Estimated remaining: 4h 11m 2s. Rate: 7.3 symbols/min [2025-10-09T18:15:47.894672] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:47.912957] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:15:47.913170] [DEBUG] [LOCAL ] CTS: No existing data file found in primary storage. [2025-10-09T18:15:47.913225] [WARN ] [MAIN ] CTS: No existing data found, performing full refresh instead. [2025-10-09T18:15:47.913359] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-09T18:15:47.913410] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-09T18:15:47.913451] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-10-09T18:15:47.913504] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-09T18:15:48.004113] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-09T18:15:48.228038] [DEBUG] [LOCAL ] CTRI: Loaded 39419 existing records from primary storage. [2025-10-09T18:15:48.238981] [INFO ] [MAIN ] CTRI: Loaded 39419 existing records. [2025-10-09T18:15:48.406909] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:48.482445] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:15:48.482613] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-09T18:15:48.482686] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-09T18:15:48.482917] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-09T18:15:48.482957] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-09T18:15:48.812472] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-09T18:15:48.842067] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:15:48.882160] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T18:15:49.596706] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-09T18:15:49.732353] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T18:15:50.100888] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-09T18:15:50.396755] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-09T18:15:50.499907] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T18:15:51.196737] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-09T18:15:51.985370] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:15:51.996674] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-09T18:15:52.074569] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T18:15:52.796717] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-09T18:15:53.596703] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-09T18:15:53.887265] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T18:15:54.396687] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-09T18:15:54.428745] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T18:15:54.646753] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T18:15:55.196765] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-09T18:15:55.996702] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-09T18:15:56.322827] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T18:15:56.528734] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T18:15:56.796721] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-09T18:15:57.287436] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T18:15:57.596822] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-09T18:15:58.372216] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-09T18:15:58.396736] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-09T18:15:58.818943] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T18:15:59.196728] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-09T18:15:59.795608] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T18:15:59.996746] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-09T18:16:00.400164] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T18:16:00.796754] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-09T18:16:01.295332] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T18:16:01.299282] [INFO ] [REMOTE ] CTRE: Full fetch complete (70799 records). [2025-10-09T18:16:01.299414] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-09T18:16:01.300378] [FATAL] [VALIDATOR ] CTRE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:16:01.300470] [FATAL] [MAIN ] CTRE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:16:01.300514] [WARN ] [MAIN ] CTRE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:16:01.300576] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-09T18:16:01.300674] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-09T18:16:01.300731] [INFO ] [LOCAL ] CTRE: Starting deletion of derivative data. [2025-10-09T18:16:01.300990] [DEBUG] [LOCAL ] CTRE: Deleted derivative data file. [2025-10-09T18:16:01.301287] [INFO ] [MAIN ] Update Progress: 551/2373 symbols completed. CTRE took 34.1s. Estimated remaining: 4h 11m 11s. Rate: 7.3 symbols/min [2025-10-09T18:16:01.485590] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:01.485807] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-09T18:16:01.485851] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-09T18:16:01.485962] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-09T18:16:01.486003] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-09T18:16:01.486046] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-09T18:16:01.486080] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-09T18:16:01.596702] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-09T18:16:01.882677] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:01.934700] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T18:16:02.396783] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-09T18:16:03.096870] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T18:16:03.101511] [INFO ] [REMOTE ] CTRA: Full fetch complete (77661 records). [2025-10-09T18:16:03.101638] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-09T18:16:03.202395] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-09T18:16:03.505859] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-09T18:16:03.505964] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-09T18:16:03.506902] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-09T18:16:03.506968] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-09T18:16:03.508593] [DEBUG] [LOCAL ] CTRA: Trimmed 77661 records to 54036 (keeping 200 days of data) [2025-10-09T18:16:03.856831] [DEBUG] [LOCAL ] CTRA: Primary data saved (54036 records). [2025-10-09T18:16:03.857096] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-09T18:16:03.857259] [INFO ] [MAIN ] Update Progress: 552/2373 symbols completed. CTRA took 47.7s. Estimated remaining: 4h 10m 44s. Rate: 7.3 symbols/min [2025-10-09T18:16:04.012479] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-09T18:16:04.034152] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:04.034927] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-09T18:16:04.034974] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-09T18:16:04.035084] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-09T18:16:04.035125] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-09T18:16:04.035174] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-09T18:16:04.064620] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-09T18:16:04.143170] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T18:16:04.356558] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T18:16:04.494503] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:04.796746] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-09T18:16:05.275100] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-09T18:16:05.391419] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-09T18:16:05.596780] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-09T18:16:05.910456] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-09T18:16:06.396714] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-09T18:16:06.719787] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T18:16:07.196801] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-09T18:16:07.996730] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-09T18:16:08.237533] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T18:16:08.358882] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-09T18:16:08.796795] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-09T18:16:09.596725] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-09T18:16:09.924870] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-09T18:16:10.049796] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T18:16:10.396738] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-09T18:16:11.196745] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-09T18:16:11.733021] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T18:16:11.759047] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T18:16:11.996744] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-09T18:16:12.796736] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-09T18:16:13.596709] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-09T18:16:13.793211] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T18:16:14.050400] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T18:16:14.396775] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-09T18:16:14.652854] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-09T18:16:15.196762] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-09T18:16:15.273162] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T18:16:15.685846] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-09T18:16:15.996765] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-09T18:16:16.796734] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-09T18:16:17.395509] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T18:16:17.596715] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-09T18:16:18.396753] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-09T18:16:18.560306] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T18:16:18.654178] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-09T18:16:19.196768] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-09T18:16:19.276784] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T18:16:19.996696] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-09T18:16:20.130437] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T18:16:20.796730] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-09T18:16:21.596727] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-09T18:16:21.877873] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-09T18:16:21.937032] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-09T18:16:22.396693] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-09T18:16:22.424246] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T18:16:22.430919] [INFO ] [REMOTE ] CTRI: Full fetch complete (52299 records). [2025-10-09T18:16:22.431062] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-09T18:16:22.431771] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:16:22.431855] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:16:22.431898] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:16:22.431938] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-09T18:16:22.431995] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-09T18:16:22.432031] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-09T18:16:22.432269] [DEBUG] [LOCAL ] CTRI: Deleted derivative data file. [2025-10-09T18:16:22.432368] [INFO ] [MAIN ] Update Progress: 553/2373 symbols completed. CTRI took 34.9s. Estimated remaining: 4h 11m 10s. Rate: 7.2 symbols/min [2025-10-09T18:16:22.601089] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:22.654384] [DEBUG] [LOCAL ] CUBE: Loaded 50778 existing records from primary storage. [2025-10-09T18:16:22.654758] [INFO ] [MAIN ] CUBE: Loaded 50778 existing records. [2025-10-09T18:16:22.754891] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T18:16:22.766137] [INFO ] [REMOTE ] CUBB: Full fetch complete (924 records). [2025-10-09T18:16:22.794750] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-09T18:16:22.908632] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:16:22.924512] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-09T18:16:22.936392] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-09T18:16:22.936769] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-09T18:16:22.942181] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-09T18:16:23.128398] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-09T18:16:23.128685] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:16:23.128999] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:16:23.134408] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-09T18:16:23.144737] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-09T18:16:23.155073] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-09T18:16:23.182517] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-09T18:16:23.190805] [INFO ] [MAIN ] Update Progress: 554/2373 symbols completed. CUBB took 19.3s. Estimated remaining: 4h 10m 37s. Rate: 7.3 symbols/min [2025-10-09T18:16:23.205540] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-09T18:16:23.560573] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:23.597725] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:23.620894] [DEBUG] [LOCAL ] CUBI: Loaded 26977 existing records from primary storage. [2025-10-09T18:16:23.621206] [INFO ] [MAIN ] CUBI: Loaded 26977 existing records. [2025-10-09T18:16:23.814959] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:16:23.815192] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-09T18:16:23.815242] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-09T18:16:23.815530] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-09T18:16:23.815588] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-09T18:16:24.005531] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-09T18:16:24.174983] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:24.601792] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T18:16:24.796746] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-09T18:16:25.596700] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-09T18:16:25.643160] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T18:16:25.771991] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:16:26.396821] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-09T18:16:27.196743] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-09T18:16:27.355318] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T18:16:27.620526] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T18:16:27.930021] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T18:16:27.996734] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-09T18:16:28.796732] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-09T18:16:29.360269] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T18:16:29.596738] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-09T18:16:30.099622] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T18:16:30.396697] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-09T18:16:30.487454] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T18:16:30.489635] [INFO ] [REMOTE ] CTS: Full fetch complete (26737 records). [2025-10-09T18:16:30.489882] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-09T18:16:30.883183] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-09T18:16:30.883296] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-09T18:16:30.883807] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-09T18:16:30.883871] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-09T18:16:30.884553] [DEBUG] [LOCAL ] CTS: Trimmed 26737 records to 19505 (keeping 200 days of data) [2025-10-09T18:16:31.002869] [DEBUG] [LOCAL ] CTS: Primary data saved (19505 records). [2025-10-09T18:16:31.003010] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-09T18:16:31.003084] [INFO ] [MAIN ] Update Progress: 555/2373 symbols completed. CTS took 43.4s. Estimated remaining: 4h 10m 27s. Rate: 7.3 symbols/min [2025-10-09T18:16:31.172980] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:31.202982] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-09T18:16:31.225042] [DEBUG] [LOCAL ] CUK: Loaded 50970 existing records from primary storage. [2025-10-09T18:16:31.225362] [INFO ] [MAIN ] CUK: Loaded 50970 existing records. [2025-10-09T18:16:31.408536] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:16:31.408807] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-09T18:16:31.408863] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-09T18:16:31.409116] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-09T18:16:31.409174] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-09T18:16:31.771027] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:31.996691] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-09T18:16:32.104263] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T18:16:32.796717] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-09T18:16:32.963696] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T18:16:33.596766] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-09T18:16:33.901380] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T18:16:34.078794] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T18:16:34.396711] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-09T18:16:35.196698] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-09T18:16:35.440347] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T18:16:35.996742] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-09T18:16:36.063457] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T18:16:36.796784] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-09T18:16:37.167460] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-09T18:16:37.596745] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-09T18:16:37.856853] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T18:16:37.886915] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T18:16:38.396715] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-09T18:16:39.200551] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-09T18:16:39.205969] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T18:16:39.910842] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T18:16:39.915276] [INFO ] [REMOTE ] CTVA: Full fetch complete (76998 records). [2025-10-09T18:16:39.915423] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-09T18:16:40.001891] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-09T18:16:40.331964] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-09T18:16:40.337240] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-09T18:16:40.346400] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-09T18:16:40.347312] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-09T18:16:40.348329] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T18:16:40.356138] [DEBUG] [LOCAL ] CTVA: Trimmed 76998 records to 53653 (keeping 200 days of data) [2025-10-09T18:16:40.684552] [DEBUG] [LOCAL ] CTVA: Primary data saved (53653 records). [2025-10-09T18:16:40.684725] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-09T18:16:40.684811] [INFO ] [MAIN ] Update Progress: 556/2373 symbols completed. CTVA took 39.4s. Estimated remaining: 4h 10m 23s. Rate: 7.3 symbols/min [2025-10-09T18:16:40.801848] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-09T18:16:40.870404] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:16:40.875281] [DEBUG] [LOCAL ] CULP: Loaded 2885 existing records from primary storage. [2025-10-09T18:16:40.875444] [INFO ] [MAIN ] CULP: Loaded 2885 existing records. [2025-10-09T18:16:41.055696] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:16:41.055893] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-09T18:16:41.055949] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-09T18:16:41.056085] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-09T18:16:41.056141] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-09T18:16:41.408698] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:16:41.593410] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T18:16:41.603053] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-09T18:16:42.284000] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T18:16:42.396683] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-09T18:16:42.470374] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:16:43.196728] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-09T18:16:43.996725] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-09T18:16:44.155466] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T18:16:44.216365] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T18:16:44.796768] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-09T18:16:45.596736] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-09T18:16:46.060426] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T18:16:46.076234] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T18:16:46.262569] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T18:16:46.396735] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-09T18:16:46.878467] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T18:16:47.196705] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-09T18:16:47.996805] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-09T18:16:48.796688] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-09T18:16:49.150313] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T18:16:49.596691] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-09T18:16:49.739718] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:16:49.763083] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:16:50.194242] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T18:16:50.396718] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-09T18:16:51.196758] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-09T18:16:51.996765] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-09T18:16:52.158465] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T18:16:52.721580] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T18:16:52.796680] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-09T18:16:52.895521] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T18:16:53.596767] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-09T18:16:53.927766] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T18:16:54.103038] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-09T18:16:54.396765] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-09T18:16:55.196721] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-09T18:16:55.996766] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-09T18:16:56.252843] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T18:16:56.463410] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T18:16:56.796694] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-09T18:16:56.867257] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T18:16:56.871522] [INFO ] [REMOTE ] CUBE: Full fetch complete (73042 records). [2025-10-09T18:16:56.871682] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-09T18:16:57.286486] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-09T18:16:57.286836] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-09T18:16:57.287872] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-09T18:16:57.287940] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-09T18:16:57.289480] [DEBUG] [LOCAL ] CUBE: Trimmed 73042 records to 51139 (keeping 200 days of data) [2025-10-09T18:16:57.596856] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-09T18:16:57.611115] [DEBUG] [LOCAL ] CUBE: Primary data saved (51139 records). [2025-10-09T18:16:57.611261] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-09T18:16:57.612549] [INFO ] [MAIN ] Update Progress: 557/2373 symbols completed. CUBE took 35.2s. Estimated remaining: 4h 10m 43s. Rate: 7.2 symbols/min [2025-10-09T18:16:57.923274] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T18:16:58.396731] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-09T18:16:59.046005] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-09T18:16:59.196692] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-09T18:16:59.402638] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T18:16:59.762844] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T18:16:59.996815] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-09T18:17:00.541907] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T18:17:00.796684] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-09T18:17:01.596718] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-09T18:17:02.041682] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T18:17:02.231240] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T18:17:02.396699] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-09T18:17:03.196764] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-09T18:17:03.807601] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T18:17:03.996673] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-09T18:17:04.367484] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T18:17:04.370021] [INFO ] [REMOTE ] CUBI: Full fetch complete (39034 records). [2025-10-09T18:17:04.370116] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-09T18:17:04.736210] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-09T18:17:04.736290] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-09T18:17:04.736856] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-09T18:17:04.736919] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-09T18:17:04.738719] [DEBUG] [LOCAL ] CUBI: Trimmed 39034 records to 27184 (keeping 200 days of data) [2025-10-09T18:17:04.821727] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-09T18:17:04.899482] [DEBUG] [LOCAL ] CUBI: Primary data saved (27184 records). [2025-10-09T18:17:04.899611] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-09T18:17:04.899719] [INFO ] [MAIN ] Update Progress: 558/2373 symbols completed. CUBI took 41.7s. Estimated remaining: 4h 10m 32s. Rate: 7.2 symbols/min [2025-10-09T18:17:05.441483] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T18:17:05.442262] [INFO ] [REMOTE ] CULP: Full fetch complete (4616 records). [2025-10-09T18:17:05.442332] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-09T18:17:05.821786] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-09T18:17:05.821969] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-09T18:17:05.822159] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-09T18:17:05.822238] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-09T18:17:05.822814] [DEBUG] [LOCAL ] CULP: Trimmed 4616 records to 2897 (keeping 200 days of data) [2025-10-09T18:17:05.870175] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T18:17:05.884627] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-09T18:17:05.887084] [DEBUG] [LOCAL ] CULP: Primary data saved (2897 records). [2025-10-09T18:17:05.887280] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-09T18:17:05.887443] [INFO ] [MAIN ] Update Progress: 559/2373 symbols completed. CULP took 25.2s. Estimated remaining: 4h 9m 60s. Rate: 7.3 symbols/min [2025-10-09T18:17:07.620578] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:17:07.626267] [INFO ] [REMOTE ] CUK: Full fetch complete (73704 records). [2025-10-09T18:17:07.626543] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-09T18:17:07.628000] [FATAL] [VALIDATOR ] CUK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:17:07.628223] [FATAL] [MAIN ] CUK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:17:07.628283] [WARN ] [MAIN ] CUK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:17:07.628363] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-09T18:17:07.628449] [DEBUG] [LOCAL ] CUK: No primary data file found to delete. [2025-10-09T18:17:07.628573] [INFO ] [LOCAL ] CUK: Starting deletion of derivative data. [2025-10-09T18:17:07.628948] [DEBUG] [LOCAL ] CUK: Deleted derivative data file. [2025-10-09T18:17:07.629102] [INFO ] [MAIN ] Update Progress: 560/2373 symbols completed. CUK took 36.6s. Estimated remaining: 4h 9m 30s. Rate: 7.3 symbols/min [2025-10-09T18:17:08.609137] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:08.646616] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:08.614688] [DEBUG] [LOCAL ] CVE: No existing data file found in primary storage. [2025-10-09T18:17:08.657739] [WARN ] [MAIN ] CVE: No existing data found, performing full refresh instead. [2025-10-09T18:17:08.657477] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:08.658749] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-09T18:17:08.658849] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-09T18:17:08.658964] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-09T18:17:08.659053] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-09T18:17:08.691102] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:08.942934] [DEBUG] [LOCAL ] CURV: Loaded 26786 existing records from primary storage. [2025-10-09T18:17:08.959001] [INFO ] [MAIN ] CURV: Loaded 26786 existing records. [2025-10-09T18:17:09.047238] [DEBUG] [LOCAL ] CURB: Loaded 32646 existing records from primary storage. [2025-10-09T18:17:09.111794] [INFO ] [MAIN ] CURB: Loaded 32646 existing records. [2025-10-09T18:17:09.367489] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:09.359159] [DEBUG] [LOCAL ] CUZ: Loaded 49428 existing records from primary storage. [2025-10-09T18:17:09.373123] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-09T18:17:09.383560] [INFO ] [MAIN ] CUZ: Loaded 49428 existing records. [2025-10-09T18:17:09.498187] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:09.556446] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-09T18:17:09.593689] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-09T18:17:09.622015] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-09T18:17:09.610937] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:09.632765] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-09T18:17:09.632711] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-09T18:17:09.632882] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-09T18:17:09.685798] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-09T18:17:09.711427] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-09T18:17:09.879599] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:09.943468] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-09T18:17:09.962016] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-09T18:17:10.052150] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-09T18:17:10.080639] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-09T18:17:10.490827] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:10.502452] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-09T18:17:10.814446] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:10.848098] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-09T18:17:10.891003] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:10.891631] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-09T18:17:10.956272] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T18:17:10.967597] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-09T18:17:11.885374] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:17:11.893243] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-09T18:17:12.251802] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T18:17:12.259444] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-09T18:17:12.512183] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T18:17:12.522786] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-09T18:17:12.698462] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T18:17:12.796705] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-09T18:17:12.996062] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T18:17:13.596746] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-09T18:17:13.641214] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T18:17:13.851377] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T18:17:14.110521] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T18:17:14.396690] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-09T18:17:14.716612] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:17:15.196723] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-09T18:17:15.996677] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-09T18:17:16.401610] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-09T18:17:16.799307] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-09T18:17:16.804387] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T18:17:16.867144] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T18:17:17.596777] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-09T18:17:18.396693] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-09T18:17:18.414688] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T18:17:18.474743] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T18:17:19.196805] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-09T18:17:19.996732] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-09T18:17:20.046750] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:17:20.169343] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:17:20.796777] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-09T18:17:21.596785] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-09T18:17:21.918028] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T18:17:22.088914] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T18:17:22.396718] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-09T18:17:22.884437] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T18:17:23.196724] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-09T18:17:23.638628] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T18:17:23.996741] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-09T18:17:24.796726] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-09T18:17:24.825601] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T18:17:25.596683] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-09T18:17:25.660514] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T18:17:26.301719] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T18:17:26.396745] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-09T18:17:26.996916] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T18:17:27.196736] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-09T18:17:27.364568] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T18:17:27.996729] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-09T18:17:28.796745] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-09T18:17:29.596758] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-09T18:17:29.882462] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-09T18:17:30.320762] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-09T18:17:30.396669] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-09T18:17:30.578812] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T18:17:30.818497] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T18:17:31.196711] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-09T18:17:31.996771] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-09T18:17:32.796701] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-09T18:17:33.004506] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-09T18:17:33.040475] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T18:17:33.043638] [INFO ] [REMOTE ] CURV: Full fetch complete (38915 records). [2025-10-09T18:17:33.043755] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-09T18:17:33.423555] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-09T18:17:33.474528] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-09T18:17:33.474607] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-09T18:17:33.475167] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-09T18:17:33.475231] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-09T18:17:33.476124] [DEBUG] [LOCAL ] CURV: Trimmed 38915 records to 27028 (keeping 200 days of data) [2025-10-09T18:17:33.601395] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-09T18:17:33.627154] [DEBUG] [LOCAL ] CURV: Primary data saved (27028 records). [2025-10-09T18:17:33.627568] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-09T18:17:33.627696] [INFO ] [MAIN ] Update Progress: 561/2373 symbols completed. CURV took 26.0s. Estimated remaining: 4h 10m 19s. Rate: 7.2 symbols/min [2025-10-09T18:17:33.798506] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:33.814779] [DEBUG] [LOCAL ] CVEO: Loaded 15261 existing records from primary storage. [2025-10-09T18:17:33.814999] [INFO ] [MAIN ] CVEO: Loaded 15261 existing records. [2025-10-09T18:17:33.996279] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:33.996527] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-09T18:17:33.996596] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-09T18:17:33.996897] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-09T18:17:33.996972] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-09T18:17:34.323475] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:17:34.387316] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:34.396667] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-09T18:17:35.170602] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T18:17:35.196666] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-09T18:17:35.704848] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:17:35.996741] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-09T18:17:36.796729] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-09T18:17:37.116940] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-09T18:17:37.123456] [INFO ] [REMOTE ] CVE: Full fetch complete (77561 records). [2025-10-09T18:17:37.123634] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-09T18:17:37.570137] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-09T18:17:37.571998] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T18:17:37.579274] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-09T18:17:37.580734] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-09T18:17:37.581157] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-09T18:17:37.583051] [DEBUG] [LOCAL ] CVE: Trimmed 77561 records to 53949 (keeping 200 days of data) [2025-10-09T18:17:37.641101] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-09T18:17:37.691300] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T18:17:37.937688] [DEBUG] [LOCAL ] CVE: Primary data saved (53949 records). [2025-10-09T18:17:37.937886] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-09T18:17:37.937981] [INFO ] [MAIN ] Update Progress: 562/2373 symbols completed. CVE took 30.3s. Estimated remaining: 4h 9m 58s. Rate: 7.2 symbols/min [2025-10-09T18:17:38.111258] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:38.154300] [DEBUG] [LOCAL ] CVI: Loaded 46541 existing records from primary storage. [2025-10-09T18:17:38.154603] [INFO ] [MAIN ] CVI: Loaded 46541 existing records. [2025-10-09T18:17:38.340619] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:38.340867] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-09T18:17:38.340915] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-09T18:17:38.341228] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-09T18:17:38.341286] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-09T18:17:38.403865] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-09T18:17:38.759853] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:38.779878] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T18:17:39.151638] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T18:17:39.196728] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-09T18:17:39.996765] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-09T18:17:40.796707] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-09T18:17:40.893607] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T18:17:41.349501] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T18:17:41.596715] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-09T18:17:41.628303] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-09T18:17:42.396738] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-09T18:17:43.152449] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T18:17:43.196670] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-09T18:17:43.339216] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T18:17:43.996758] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-09T18:17:44.500304] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T18:17:44.796687] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-09T18:17:45.015296] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T18:17:45.312263] [DEBUG] [REMOTE ] CURB: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-09T18:17:45.312585] [WARN ] [REMOTE ] CURB: No data returned for month 2025-10 [2025-10-09T18:17:45.312702] [FATAL] [REMOTE ] CURB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:17:45.312789] [FATAL] [MAIN ] CURB: Failed to fetch primary data. [2025-10-09T18:17:45.312851] [WARN ] [MAIN ] CURB: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:17:45.312922] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-09T18:17:45.312984] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-09T18:17:45.313032] [INFO ] [LOCAL ] CURB: Starting deletion of derivative data. [2025-10-09T18:17:45.313251] [DEBUG] [LOCAL ] CURB: Deleted derivative data file. [2025-10-09T18:17:45.313338] [INFO ] [MAIN ] Update Progress: 563/2373 symbols completed. CURB took 37.7s. Estimated remaining: 4h 9m 47s. Rate: 7.2 symbols/min [2025-10-09T18:17:45.478293] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:17:45.498888] [DEBUG] [LOCAL ] CVLG: Loaded 15513 existing records from primary storage. [2025-10-09T18:17:45.499154] [INFO ] [MAIN ] CVLG: Loaded 15513 existing records. [2025-10-09T18:17:45.599115] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-09T18:17:45.678292] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:17:45.678515] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-09T18:17:45.678563] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-09T18:17:45.678798] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-09T18:17:45.678857] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-09T18:17:46.037766] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:17:46.396764] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-09T18:17:47.196818] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-09T18:17:47.253082] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:17:47.379312] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T18:17:47.996735] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-09T18:17:48.036911] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-09T18:17:48.796730] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-09T18:17:49.132076] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T18:17:49.596735] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-09T18:17:50.396745] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-09T18:17:50.496088] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T18:17:51.096571] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:17:51.196668] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-09T18:17:51.311540] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T18:17:51.996706] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-09T18:17:52.784948] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:17:52.796677] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-09T18:17:52.846030] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T18:17:53.596706] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-09T18:17:53.614815] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T18:17:54.396730] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-09T18:17:54.504528] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T18:17:55.175410] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:17:55.196662] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-09T18:17:55.996727] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-09T18:17:56.019719] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T18:17:56.796736] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-09T18:17:57.169411] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T18:17:57.596776] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-09T18:17:58.118536] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T18:17:58.396693] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-09T18:17:58.804092] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T18:17:59.196715] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-09T18:17:59.726725] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T18:17:59.731025] [INFO ] [REMOTE ] CUZ: Full fetch complete (70731 records). [2025-10-09T18:17:59.731113] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-09T18:18:00.005672] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-09T18:18:00.133879] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-09T18:18:00.133967] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-09T18:18:00.135498] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-09T18:18:00.135578] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-09T18:18:00.137166] [DEBUG] [LOCAL ] CUZ: Trimmed 70731 records to 49781 (keeping 200 days of data) [2025-10-09T18:18:00.446418] [DEBUG] [LOCAL ] CUZ: Primary data saved (49781 records). [2025-10-09T18:18:00.446804] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-09T18:18:00.446903] [INFO ] [MAIN ] Update Progress: 564/2373 symbols completed. CUZ took 52.8s. Estimated remaining: 4h 10m 1s. Rate: 7.2 symbols/min [2025-10-09T18:18:00.633757] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:00.740529] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T18:18:00.752461] [DEBUG] [LOCAL ] CVNA: Loaded 52896 existing records from primary storage. [2025-10-09T18:18:00.753949] [INFO ] [MAIN ] CVNA: Loaded 52896 existing records. [2025-10-09T18:18:00.803874] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-09T18:18:01.014508] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:01.014858] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-09T18:18:01.014934] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-09T18:18:01.015190] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-09T18:18:01.015255] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-09T18:18:01.400524] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T18:18:01.416181] [INFO ] [REMOTE ] CVEO: Full fetch complete (20437 records). [2025-10-09T18:18:01.437273] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-09T18:18:01.448633] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:18:01.501899] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:18:01.565290] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:01.560625] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:18:01.565783] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-09T18:18:01.565876] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-09T18:18:01.565918] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-10-09T18:18:01.566138] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-10-09T18:18:01.566240] [INFO ] [MAIN ] Update Progress: 565/2373 symbols completed. CVEO took 27.9s. Estimated remaining: 4h 9m 30s. Rate: 7.2 symbols/min [2025-10-09T18:18:01.601845] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-09T18:18:01.755097] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:01.825916] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-09T18:18:01.826270] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-09T18:18:01.993553] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:18:02.049745] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:02.049948] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-09T18:18:02.049997] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-09T18:18:02.050238] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-09T18:18:02.050296] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-09T18:18:02.405781] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-09T18:18:02.405707] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:03.196751] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-09T18:18:03.441213] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:18:03.440886] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T18:18:03.996758] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-09T18:18:04.796780] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-09T18:18:05.236028] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T18:18:05.596694] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-09T18:18:05.889126] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T18:18:06.026960] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T18:18:06.396789] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-09T18:18:07.196683] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-09T18:18:07.675092] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T18:18:07.737800] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T18:18:07.741487] [INFO ] [REMOTE ] CVI: Full fetch complete (66961 records). [2025-10-09T18:18:07.741585] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-09T18:18:07.742253] [FATAL] [VALIDATOR ] CVI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:18:07.742343] [FATAL] [MAIN ] CVI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:18:07.742386] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:18:07.742449] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-09T18:18:07.742539] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-09T18:18:07.742597] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-09T18:18:07.742838] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-10-09T18:18:07.742930] [INFO ] [MAIN ] Update Progress: 566/2373 symbols completed. CVI took 29.8s. Estimated remaining: 4h 9m 15s. Rate: 7.2 symbols/min [2025-10-09T18:18:07.917863] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:07.927891] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T18:18:07.985076] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-09T18:18:07.985444] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-09T18:18:08.001879] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-09T18:18:08.170382] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:08.170635] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-09T18:18:08.170721] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-09T18:18:08.170985] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-09T18:18:08.171043] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-09T18:18:08.519131] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:08.796702] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-09T18:18:09.596725] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-09T18:18:09.807454] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T18:18:10.396738] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-09T18:18:10.618636] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T18:18:10.869704] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-09T18:18:11.196746] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-09T18:18:11.996757] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-09T18:18:12.088166] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T18:18:12.796795] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-09T18:18:13.411948] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-09T18:18:13.596800] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-09T18:18:14.300167] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T18:18:14.403211] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-09T18:18:14.408805] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-09T18:18:14.783332] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-09T18:18:15.196716] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-09T18:18:15.244708] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T18:18:15.246366] [INFO ] [REMOTE ] CVLG: Full fetch complete (21179 records). [2025-10-09T18:18:15.246437] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-09T18:18:15.604712] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-09T18:18:15.604796] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-09T18:18:15.605208] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-09T18:18:15.605248] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-09T18:18:15.605883] [DEBUG] [LOCAL ] CVLG: Trimmed 21179 records to 15601 (keeping 200 days of data) [2025-10-09T18:18:15.703232] [DEBUG] [LOCAL ] CVLG: Primary data saved (15601 records). [2025-10-09T18:18:15.703384] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-09T18:18:15.703471] [INFO ] [MAIN ] Update Progress: 567/2373 symbols completed. CVLG took 30.4s. Estimated remaining: 4h 9m 5s. Rate: 7.3 symbols/min [2025-10-09T18:18:15.867959] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:15.890806] [DEBUG] [LOCAL ] CW: Loaded 22225 existing records from primary storage. [2025-10-09T18:18:15.891057] [INFO ] [MAIN ] CW: Loaded 22225 existing records. [2025-10-09T18:18:16.001852] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-09T18:18:16.070400] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:16.070681] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-09T18:18:16.070741] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-09T18:18:16.070928] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-09T18:18:16.070985] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-09T18:18:16.427820] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:16.796760] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-09T18:18:17.097229] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T18:18:17.596741] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-09T18:18:17.740624] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T18:18:18.396735] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-09T18:18:18.464327] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T18:18:18.807729] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T18:18:19.196738] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-09T18:18:19.996713] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-09T18:18:20.318131] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T18:18:20.458755] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T18:18:20.796794] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-09T18:18:21.596684] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-09T18:18:21.900889] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-09T18:18:22.396718] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-09T18:18:23.028167] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-09T18:18:23.196727] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-09T18:18:23.434019] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T18:18:23.828615] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-09T18:18:23.996724] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-09T18:18:24.796701] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-09T18:18:24.851421] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T18:18:25.596790] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-09T18:18:26.259784] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-09T18:18:26.396736] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-09T18:18:26.638229] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T18:18:27.196775] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-09T18:18:27.275426] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-09T18:18:27.996685] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-09T18:18:28.438263] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T18:18:28.796730] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-09T18:18:29.030596] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T18:18:29.596763] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-09T18:18:29.934827] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T18:18:30.396723] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-09T18:18:31.085713] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-09T18:18:31.196695] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-09T18:18:31.659403] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-09T18:18:31.996695] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-09T18:18:32.308025] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-09T18:18:32.516841] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T18:18:32.796712] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-09T18:18:33.596726] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-09T18:18:33.777019] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T18:18:33.781479] [INFO ] [REMOTE ] CVNA: Full fetch complete (76652 records). [2025-10-09T18:18:33.781594] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-09T18:18:34.121050] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:18:34.205190] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-09T18:18:34.205321] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-09T18:18:34.206216] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-09T18:18:34.206283] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-09T18:18:34.207690] [DEBUG] [LOCAL ] CVNA: Trimmed 76652 records to 53280 (keeping 200 days of data) [2025-10-09T18:18:34.416299] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-09T18:18:34.533606] [DEBUG] [LOCAL ] CVNA: Primary data saved (53280 records). [2025-10-09T18:18:34.533774] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-09T18:18:34.534410] [INFO ] [MAIN ] Update Progress: 568/2373 symbols completed. CVNA took 34.1s. Estimated remaining: 4h 9m 31s. Rate: 7.2 symbols/min [2025-10-09T18:18:34.698960] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:34.748840] [DEBUG] [LOCAL ] CWAN: Loaded 52465 existing records from primary storage. [2025-10-09T18:18:34.749158] [INFO ] [MAIN ] CWAN: Loaded 52465 existing records. [2025-10-09T18:18:34.920576] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:34.920788] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-09T18:18:34.920837] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-09T18:18:34.921084] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-09T18:18:34.921147] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-09T18:18:35.201786] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-09T18:18:35.274020] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:35.581821] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T18:18:35.934732] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-09T18:18:35.996687] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-09T18:18:36.796716] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-09T18:18:37.432322] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-09T18:18:37.596722] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-09T18:18:38.057291] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T18:18:38.396730] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-09T18:18:38.594495] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T18:18:39.196685] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-09T18:18:39.290977] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:18:39.996736] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-09T18:18:40.358981] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T18:18:40.637503] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-09T18:18:40.678242] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T18:18:40.682736] [INFO ] [REMOTE ] CVS: Full fetch complete (77811 records). [2025-10-09T18:18:40.682862] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-09T18:18:40.801782] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-09T18:18:41.069341] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-09T18:18:41.069423] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-09T18:18:41.070289] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-09T18:18:41.070355] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-09T18:18:41.071884] [DEBUG] [LOCAL ] CVS: Trimmed 77811 records to 54084 (keeping 200 days of data) [2025-10-09T18:18:41.397793] [DEBUG] [LOCAL ] CVS: Primary data saved (54084 records). [2025-10-09T18:18:41.397954] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-09T18:18:41.398040] [INFO ] [MAIN ] Update Progress: 569/2373 symbols completed. CVS took 39.8s. Estimated remaining: 4h 9m 18s. Rate: 7.2 symbols/min [2025-10-09T18:18:41.563860] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:41.564042] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-10-09T18:18:41.564098] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-10-09T18:18:41.564209] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-09T18:18:41.564254] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-09T18:18:41.564295] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-09T18:18:41.564327] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-09T18:18:41.606221] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-09T18:18:41.926135] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:42.396699] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-09T18:18:42.444062] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:18:43.196719] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-09T18:18:43.540064] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T18:18:43.885251] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-09T18:18:43.890196] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-10-09T18:18:43.890363] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-09T18:18:44.005904] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-09T18:18:44.378897] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-09T18:18:44.379035] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-09T18:18:44.380125] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-09T18:18:44.380207] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-09T18:18:44.382025] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54150 (keeping 200 days of data) [2025-10-09T18:18:44.512040] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:18:44.766948] [DEBUG] [LOCAL ] CVX: Primary data saved (54150 records). [2025-10-09T18:18:44.767088] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-09T18:18:44.767974] [INFO ] [MAIN ] Update Progress: 570/2373 symbols completed. CVX took 37.0s. Estimated remaining: 4h 8m 54s. Rate: 7.2 symbols/min [2025-10-09T18:18:44.799212] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-09T18:18:44.936871] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:44.937019] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-09T18:18:44.937055] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-09T18:18:44.937162] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-09T18:18:44.937204] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-09T18:18:44.937243] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-09T18:18:44.937276] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-09T18:18:45.280207] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:45.596748] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-09T18:18:45.621059] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:18:46.097290] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T18:18:46.396689] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-09T18:18:47.196697] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-09T18:18:47.298144] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T18:18:47.300318] [INFO ] [REMOTE ] CW: Full fetch complete (33057 records). [2025-10-09T18:18:47.300415] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-09T18:18:47.615462] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T18:18:47.719702] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-09T18:18:47.719789] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-09T18:18:47.720316] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-09T18:18:47.720355] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-09T18:18:47.721148] [DEBUG] [LOCAL ] CW: Trimmed 33057 records to 22352 (keeping 200 days of data) [2025-10-09T18:18:47.861764] [DEBUG] [LOCAL ] CW: Primary data saved (22352 records). [2025-10-09T18:18:47.861931] [INFO ] [MAIN ] CW: Full history saved. [2025-10-09T18:18:47.862041] [INFO ] [MAIN ] Update Progress: 571/2373 symbols completed. CW took 32.2s. Estimated remaining: 4h 8m 29s. Rate: 7.3 symbols/min [2025-10-09T18:18:48.001837] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-09T18:18:48.032493] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:18:48.080406] [DEBUG] [LOCAL ] CWK: Loaded 49460 existing records from primary storage. [2025-10-09T18:18:48.080760] [INFO ] [MAIN ] CWK: Loaded 49460 existing records. [2025-10-09T18:18:48.255268] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:18:48.255450] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-09T18:18:48.255497] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-09T18:18:48.255733] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-09T18:18:48.255790] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-09T18:18:48.608254] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:18:48.645389] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T18:18:48.796721] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-09T18:18:49.531040] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T18:18:49.596765] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-09T18:18:50.039454] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T18:18:50.396792] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-09T18:18:51.196728] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-09T18:18:51.451084] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T18:18:51.973791] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T18:18:51.996723] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-09T18:18:52.796698] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-09T18:18:52.913221] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T18:18:53.576997] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T18:18:53.596737] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-09T18:18:54.396712] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-09T18:18:54.450699] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:18:55.201036] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-09T18:18:55.206782] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T18:18:55.904343] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T18:18:55.996709] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-09T18:18:56.796695] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-09T18:18:56.916962] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T18:18:57.476842] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T18:18:57.596767] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-09T18:18:58.396719] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-09T18:18:58.656516] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T18:18:58.784511] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T18:18:59.196770] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-09T18:18:59.860044] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T18:18:59.996689] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-09T18:19:00.725382] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T18:19:00.796746] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-09T18:19:01.606205] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-09T18:19:01.611702] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:19:02.396711] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-09T18:19:02.821019] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-09T18:19:03.196714] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-09T18:19:03.445921] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T18:19:03.797764] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T18:19:03.996720] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-09T18:19:04.796745] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-09T18:19:04.940101] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:19:05.596699] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-09T18:19:05.718790] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:19:06.396769] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-09T18:19:06.567366] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T18:19:07.162891] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T18:19:07.196683] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-09T18:19:07.881455] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T18:19:07.996706] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-09T18:19:08.781349] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T18:19:08.796678] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-09T18:19:09.602080] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-09T18:19:09.608785] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T18:19:10.401833] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-09T18:19:10.427221] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:19:11.196740] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-09T18:19:11.307392] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T18:19:11.996738] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-09T18:19:12.172387] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:19:12.732393] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T18:19:12.796719] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-09T18:19:13.596732] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-09T18:19:13.726771] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T18:19:14.396717] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-09T18:19:14.672440] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T18:19:14.676978] [INFO ] [REMOTE ] CWH: Full fetch complete (73033 records). [2025-10-09T18:19:14.677110] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-09T18:19:15.072110] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-09T18:19:15.072242] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-09T18:19:15.073460] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-09T18:19:15.073548] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-09T18:19:15.075414] [DEBUG] [LOCAL ] CWH: Trimmed 73033 records to 51673 (keeping 200 days of data) [2025-10-09T18:19:15.196689] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-09T18:19:15.407204] [DEBUG] [LOCAL ] CWH: Primary data saved (51673 records). [2025-10-09T18:19:15.407361] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-09T18:19:15.407439] [INFO ] [MAIN ] Update Progress: 572/2373 symbols completed. CWH took 30.6s. Estimated remaining: 4h 9m 22s. Rate: 7.2 symbols/min [2025-10-09T18:19:15.551823] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T18:19:15.603187] [INFO ] [REMOTE ] CWAN: Full fetch complete (75185 records). [2025-10-09T18:19:15.603072] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:15.603666] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-09T18:19:15.603768] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-09T18:19:15.604066] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-09T18:19:15.603865] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-09T18:19:15.604231] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-09T18:19:15.604341] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-09T18:19:15.604426] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-09T18:19:16.365172] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:16.412773] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-09T18:19:16.412975] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-09T18:19:16.413834] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-09T18:19:16.414755] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-09T18:19:16.429497] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-09T18:19:16.440972] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T18:19:16.451600] [DEBUG] [LOCAL ] CWAN: Trimmed 75185 records to 52841 (keeping 200 days of data) [2025-10-09T18:19:16.766021] [DEBUG] [LOCAL ] CWAN: Primary data saved (52841 records). [2025-10-09T18:19:16.766161] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-09T18:19:16.766633] [INFO ] [MAIN ] Update Progress: 573/2373 symbols completed. CWAN took 42.2s. Estimated remaining: 4h 8m 52s. Rate: 7.2 symbols/min [2025-10-09T18:19:16.798818] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-09T18:19:16.945166] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:16.996044] [DEBUG] [LOCAL ] CX: Loaded 52821 existing records from primary storage. [2025-10-09T18:19:16.996448] [INFO ] [MAIN ] CX: Loaded 52821 existing records. [2025-10-09T18:19:17.210046] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:17.211042] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-09T18:19:17.213064] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-09T18:19:17.212905] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-09T18:19:17.223671] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-09T18:19:17.224183] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-09T18:19:17.600442] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-09T18:19:17.604974] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:17.608139] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T18:19:18.077333] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T18:19:18.396714] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-09T18:19:19.186966] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T18:19:19.191275] [INFO ] [REMOTE ] CWK: Full fetch complete (71021 records). [2025-10-09T18:19:19.191391] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-09T18:19:19.203358] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-09T18:19:19.586279] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-09T18:19:19.586361] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-09T18:19:19.587190] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-09T18:19:19.587254] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-09T18:19:19.588616] [DEBUG] [LOCAL ] CWK: Trimmed 71021 records to 49798 (keeping 200 days of data) [2025-10-09T18:19:19.877469] [DEBUG] [LOCAL ] CWK: Primary data saved (49798 records). [2025-10-09T18:19:19.877727] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-09T18:19:19.878745] [INFO ] [MAIN ] Update Progress: 574/2373 symbols completed. CWK took 32.0s. Estimated remaining: 4h 8m 27s. Rate: 7.2 symbols/min [2025-10-09T18:19:20.001806] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-09T18:19:20.054365] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:20.064239] [DEBUG] [LOCAL ] CXE: Loaded 6197 existing records from primary storage. [2025-10-09T18:19:20.064526] [INFO ] [MAIN ] CXE: Loaded 6197 existing records. [2025-10-09T18:19:20.263699] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:20.264251] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-09T18:19:20.264318] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-09T18:19:20.264517] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-09T18:19:20.264591] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-09T18:19:20.447272] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-09T18:19:20.682091] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:20.683269] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T18:19:20.796670] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-09T18:19:21.596741] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-09T18:19:21.614371] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T18:19:21.618226] [INFO ] [REMOTE ] CWEN: Full fetch complete (64663 records). [2025-10-09T18:19:21.618337] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-09T18:19:21.619055] [FATAL] [VALIDATOR ] CWEN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:19:21.619161] [FATAL] [MAIN ] CWEN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:19:21.619208] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:19:21.619246] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-09T18:19:21.619302] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-09T18:19:21.619336] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-10-09T18:19:21.619376] [DEBUG] [LOCAL ] CWEN: No derivative data file found to delete. [2025-10-09T18:19:21.619442] [INFO ] [MAIN ] Update Progress: 575/2373 symbols completed. CWEN took 40.2s. Estimated remaining: 4h 7m 58s. Rate: 7.3 symbols/min [2025-10-09T18:19:21.788715] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:21.796245] [DEBUG] [LOCAL ] CXH: Loaded 4425 existing records from primary storage. [2025-10-09T18:19:21.796455] [INFO ] [MAIN ] CXH: Loaded 4425 existing records. [2025-10-09T18:19:21.974386] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:21.974631] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-09T18:19:21.974712] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-09T18:19:21.974950] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-09T18:19:21.975008] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-09T18:19:22.146426] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T18:19:22.361377] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:22.396662] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-09T18:19:23.056292] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T18:19:23.196675] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-09T18:19:23.439086] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-09T18:19:23.647463] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T18:19:23.996775] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-09T18:19:24.438197] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T18:19:24.796743] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-09T18:19:25.596768] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-09T18:19:26.078053] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T18:19:26.396750] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-09T18:19:26.442483] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T18:19:27.196760] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-09T18:19:27.894507] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T18:19:27.996671] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-09T18:19:28.668770] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T18:19:28.796695] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-09T18:19:29.462964] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T18:19:29.535200] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T18:19:29.596682] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-09T18:19:30.396699] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-09T18:19:31.180185] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:19:31.196666] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-09T18:19:31.522892] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T18:19:31.996686] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-09T18:19:32.078765] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T18:19:32.437483] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-09T18:19:32.796717] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-09T18:19:33.596709] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-09T18:19:34.298737] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T18:19:34.396681] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-09T18:19:34.551380] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T18:19:34.979340] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T18:19:35.196708] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-09T18:19:35.551358] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T18:19:35.996732] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-09T18:19:36.796740] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-09T18:19:37.548885] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T18:19:37.599531] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-09T18:19:37.602229] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T18:19:38.182749] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T18:19:38.396758] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-09T18:19:39.196783] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-09T18:19:39.776612] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T18:19:39.996726] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-09T18:19:40.231950] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T18:19:40.611935] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T18:19:40.612767] [INFO ] [REMOTE ] CXH: Full fetch complete (5386 records). [2025-10-09T18:19:40.612843] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-09T18:19:40.805439] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-09T18:19:40.973027] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-09T18:19:40.973105] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-09T18:19:40.973255] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-09T18:19:40.973294] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-09T18:19:40.973736] [DEBUG] [LOCAL ] CXH: Trimmed 5386 records to 4438 (keeping 200 days of data) [2025-10-09T18:19:40.999545] [DEBUG] [LOCAL ] CXH: Primary data saved (4438 records). [2025-10-09T18:19:40.999631] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-09T18:19:40.999755] [INFO ] [MAIN ] Update Progress: 576/2373 symbols completed. CXH took 19.4s. Estimated remaining: 4h 8m 25s. Rate: 7.2 symbols/min [2025-10-09T18:19:41.162935] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:41.206113] [DEBUG] [LOCAL ] CXM: Loaded 47580 existing records from primary storage. [2025-10-09T18:19:41.206416] [INFO ] [MAIN ] CXM: Loaded 47580 existing records. [2025-10-09T18:19:41.378108] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:41.378323] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-09T18:19:41.378370] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-09T18:19:41.378682] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-09T18:19:41.378741] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-09T18:19:41.601814] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-09T18:19:41.736283] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-09T18:19:41.740532] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:42.396760] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-09T18:19:42.821724] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T18:19:43.164411] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T18:19:43.196669] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-09T18:19:43.807354] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-09T18:19:43.996697] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-09T18:19:44.796708] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-09T18:19:44.845918] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T18:19:45.596696] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-09T18:19:46.182660] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:19:46.410067] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-09T18:19:46.412715] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:19:47.196730] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-09T18:19:47.996759] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-09T18:19:48.736839] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T18:19:48.796721] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-09T18:19:49.222888] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T18:19:49.489106] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (3.08 seconds). [2025-10-09T18:19:49.539680] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:19:49.596670] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-09T18:19:50.182348] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:19:50.183373] [INFO ] [REMOTE ] CXE: Full fetch complete (11609 records). [2025-10-09T18:19:50.183440] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-09T18:19:50.401890] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-09T18:19:50.548263] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-09T18:19:50.548357] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-09T18:19:50.548620] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-09T18:19:50.548689] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-09T18:19:50.549116] [DEBUG] [LOCAL ] CXE: Trimmed 11609 records to 6217 (keeping 200 days of data) [2025-10-09T18:19:50.586091] [DEBUG] [LOCAL ] CXE: Primary data saved (6217 records). [2025-10-09T18:19:50.586192] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-09T18:19:50.586266] [INFO ] [MAIN ] Update Progress: 577/2373 symbols completed. CXE took 30.7s. Estimated remaining: 4h 8m 20s. Rate: 7.2 symbols/min [2025-10-09T18:19:50.752870] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:50.789538] [DEBUG] [LOCAL ] CXT: Loaded 30997 existing records from primary storage. [2025-10-09T18:19:50.789864] [INFO ] [MAIN ] CXT: Loaded 30997 existing records. [2025-10-09T18:19:50.963961] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:50.964231] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-09T18:19:50.964303] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-09T18:19:50.964679] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-09T18:19:50.964751] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-09T18:19:51.201952] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-09T18:19:51.346027] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:51.688964] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T18:19:51.996752] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-09T18:19:52.609043] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:19:52.796745] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-09T18:19:53.596692] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-09T18:19:53.797595] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T18:19:54.042534] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T18:19:54.396716] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-09T18:19:54.834984] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:19:55.196728] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-09T18:19:55.996708] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-09T18:19:56.239508] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T18:19:56.243968] [INFO ] [REMOTE ] CX: Full fetch complete (76382 records). [2025-10-09T18:19:56.244086] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-09T18:19:56.663497] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-09T18:19:56.663677] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-09T18:19:56.664772] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-09T18:19:56.664858] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-09T18:19:56.675729] [DEBUG] [LOCAL ] CX: Trimmed 76382 records to 53201 (keeping 200 days of data) [2025-10-09T18:19:56.694017] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T18:19:56.796838] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-09T18:19:57.026930] [DEBUG] [LOCAL ] CX: Primary data saved (53201 records). [2025-10-09T18:19:57.027072] [INFO ] [MAIN ] CX: Full history saved. [2025-10-09T18:19:57.027560] [INFO ] [MAIN ] Update Progress: 578/2373 symbols completed. CX took 40.3s. Estimated remaining: 4h 8m 6s. Rate: 7.2 symbols/min [2025-10-09T18:19:57.196108] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:19:57.236980] [DEBUG] [LOCAL ] CXW: Loaded 43976 existing records from primary storage. [2025-10-09T18:19:57.237302] [INFO ] [MAIN ] CXW: Loaded 43976 existing records. [2025-10-09T18:19:57.440037] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:19:57.440531] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-09T18:19:57.441924] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T18:19:57.441070] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-09T18:19:57.449377] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-09T18:19:57.449438] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-09T18:19:57.602564] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-09T18:19:57.809675] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:19:58.098141] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T18:19:58.396737] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-09T18:19:58.784157] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T18:19:59.196719] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-09T18:19:59.758942] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T18:19:59.996729] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-09T18:20:00.104660] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T18:20:00.107343] [INFO ] [REMOTE ] CWT: Full fetch complete (40743 records). [2025-10-09T18:20:00.107417] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-09T18:20:00.502171] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-09T18:20:00.502262] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-09T18:20:00.502985] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-09T18:20:00.503049] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-09T18:20:00.504057] [DEBUG] [LOCAL ] CWT: Trimmed 40743 records to 28221 (keeping 200 days of data) [2025-10-09T18:20:00.694785] [DEBUG] [LOCAL ] CWT: Primary data saved (28221 records). [2025-10-09T18:20:00.694927] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-09T18:20:00.695005] [INFO ] [MAIN ] Update Progress: 579/2373 symbols completed. CWT took 45.3s. Estimated remaining: 4h 7m 44s. Rate: 7.2 symbols/min [2025-10-09T18:20:00.801863] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-09T18:20:00.862125] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:00.888363] [DEBUG] [LOCAL ] CYD: Loaded 26383 existing records from primary storage. [2025-10-09T18:20:00.888616] [INFO ] [MAIN ] CYD: Loaded 26383 existing records. [2025-10-09T18:20:01.063516] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:01.063728] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-09T18:20:01.063781] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-09T18:20:01.064030] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-09T18:20:01.064090] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-09T18:20:01.436876] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:01.469857] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T18:20:01.596758] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-09T18:20:02.409817] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-09T18:20:02.444109] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T18:20:02.459337] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T18:20:03.196760] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-09T18:20:03.863536] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T18:20:03.909716] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:20:03.996693] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-09T18:20:04.796801] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-09T18:20:05.205151] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:20:05.596768] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-09T18:20:05.920066] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T18:20:06.396724] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-09T18:20:06.976170] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T18:20:07.196756] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-09T18:20:07.996685] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-09T18:20:08.112272] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:20:08.513975] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:20:08.796718] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-09T18:20:09.596709] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-09T18:20:09.627420] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:20:10.064341] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T18:20:10.396802] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-09T18:20:10.963331] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T18:20:11.196751] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-09T18:20:12.002075] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-09T18:20:12.021736] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T18:20:12.675096] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T18:20:12.796669] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-09T18:20:13.596757] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-09T18:20:13.816406] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T18:20:14.396742] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-09T18:20:14.467617] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T18:20:14.975621] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T18:20:15.196717] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-09T18:20:15.745756] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T18:20:15.996779] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-09T18:20:16.796716] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-09T18:20:16.901341] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T18:20:17.139004] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T18:20:17.596735] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-09T18:20:18.379132] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T18:20:18.383154] [INFO ] [REMOTE ] CXM: Full fetch complete (68620 records). [2025-10-09T18:20:18.383270] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-09T18:20:18.404982] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-09T18:20:18.841639] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-09T18:20:18.841778] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-09T18:20:18.842579] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-09T18:20:18.842621] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-09T18:20:18.844001] [DEBUG] [LOCAL ] CXM: Trimmed 68620 records to 47926 (keeping 200 days of data) [2025-10-09T18:20:19.079580] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T18:20:19.155703] [DEBUG] [LOCAL ] CXM: Primary data saved (47926 records). [2025-10-09T18:20:19.155872] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-09T18:20:19.155980] [INFO ] [MAIN ] Update Progress: 580/2373 symbols completed. CXM took 38.2s. Estimated remaining: 4h 8m 7s. Rate: 7.2 symbols/min [2025-10-09T18:20:19.201802] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-09T18:20:19.340242] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:19.377360] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T18:20:19.399089] [DEBUG] [LOCAL ] CYH: Loaded 47641 existing records from primary storage. [2025-10-09T18:20:19.399376] [INFO ] [MAIN ] CYH: Loaded 47641 existing records. [2025-10-09T18:20:19.575685] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:19.575870] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-09T18:20:19.575916] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-09T18:20:19.576129] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-09T18:20:19.576186] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-09T18:20:19.938573] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:19.996676] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-09T18:20:20.704627] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T18:20:20.796712] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-09T18:20:21.322023] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T18:20:21.596737] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-09T18:20:22.396714] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-09T18:20:22.438396] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T18:20:22.587476] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T18:20:23.196743] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-09T18:20:23.607499] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T18:20:23.996726] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-09T18:20:24.782612] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T18:20:24.796675] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-09T18:20:25.519796] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T18:20:25.596675] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-09T18:20:26.239166] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T18:20:26.396689] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-09T18:20:26.840722] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:20:26.843082] [INFO ] [REMOTE ] CYD: Full fetch complete (33955 records). [2025-10-09T18:20:26.843164] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-09T18:20:26.843800] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:20:26.843880] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:20:26.843949] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:20:26.844019] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-09T18:20:26.844084] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-09T18:20:26.844122] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-09T18:20:26.844381] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-10-09T18:20:26.844475] [INFO ] [MAIN ] Update Progress: 581/2373 symbols completed. CYD took 26.1s. Estimated remaining: 4h 7m 57s. Rate: 7.2 symbols/min [2025-10-09T18:20:27.011814] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:27.061680] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-10-09T18:20:27.061992] [INFO ] [MAIN ] D: Loaded 53647 existing records. [2025-10-09T18:20:27.206406] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-09T18:20:27.246766] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:27.247090] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-09T18:20:27.247141] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-09T18:20:27.247363] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-09T18:20:27.247419] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-09T18:20:27.607463] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:27.944463] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T18:20:27.996675] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-09T18:20:28.295799] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T18:20:28.796706] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-09T18:20:29.596764] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-09T18:20:30.087840] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T18:20:30.118455] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T18:20:30.121554] [INFO ] [REMOTE ] CXT: Full fetch complete (45469 records). [2025-10-09T18:20:30.121637] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-09T18:20:30.401788] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-09T18:20:30.518271] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-09T18:20:30.518376] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-09T18:20:30.519144] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-09T18:20:30.519212] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-09T18:20:30.520345] [DEBUG] [LOCAL ] CXT: Trimmed 45469 records to 31255 (keeping 200 days of data) [2025-10-09T18:20:30.716380] [DEBUG] [LOCAL ] CXT: Primary data saved (31255 records). [2025-10-09T18:20:30.716519] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-09T18:20:30.716637] [INFO ] [MAIN ] Update Progress: 582/2373 symbols completed. CXT took 40.1s. Estimated remaining: 4h 7m 35s. Rate: 7.2 symbols/min [2025-10-09T18:20:30.892972] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:30.906722] [DEBUG] [LOCAL ] DAC: Loaded 12578 existing records from primary storage. [2025-10-09T18:20:30.906955] [INFO ] [MAIN ] DAC: Loaded 12578 existing records. [2025-10-09T18:20:31.093843] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:31.094268] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-09T18:20:31.094452] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-09T18:20:31.094824] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-09T18:20:31.094999] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-09T18:20:31.197934] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-09T18:20:31.375673] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T18:20:31.507764] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:31.996684] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-09T18:20:32.613291] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-09T18:20:32.798457] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-09T18:20:32.801008] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T18:20:33.197496] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T18:20:33.564282] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T18:20:33.596666] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-09T18:20:34.284747] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T18:20:34.396698] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-09T18:20:35.196725] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-09T18:20:35.582855] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T18:20:35.996764] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-09T18:20:36.796688] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-09T18:20:36.956760] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T18:20:37.366178] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T18:20:37.596755] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-09T18:20:37.647275] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T18:20:38.397259] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-09T18:20:38.789374] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T18:20:39.196733] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-09T18:20:39.996708] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-09T18:20:40.314240] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T18:20:40.512884] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T18:20:40.518035] [INFO ] [REMOTE ] CXW: Full fetch complete (64948 records). [2025-10-09T18:20:40.518186] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-09T18:20:40.801823] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-09T18:20:40.940984] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-09T18:20:40.941093] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-09T18:20:40.941951] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-09T18:20:40.942018] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-09T18:20:40.943325] [DEBUG] [LOCAL ] CXW: Trimmed 64948 records to 44278 (keeping 200 days of data) [2025-10-09T18:20:41.202759] [DEBUG] [LOCAL ] CXW: Primary data saved (44278 records). [2025-10-09T18:20:41.202899] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-09T18:20:41.203468] [INFO ] [MAIN ] Update Progress: 583/2373 symbols completed. CXW took 44.2s. Estimated remaining: 4h 7m 33s. Rate: 7.2 symbols/min [2025-10-09T18:20:41.380374] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:41.432483] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-09T18:20:41.432881] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-09T18:20:41.599730] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-09T18:20:41.621772] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:41.623321] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-09T18:20:41.623503] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-09T18:20:41.631534] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-09T18:20:41.631876] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-09T18:20:41.645910] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T18:20:41.768595] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T18:20:42.026823] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:42.396738] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-09T18:20:43.196738] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-09T18:20:43.666528] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-09T18:20:43.996680] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-09T18:20:44.796779] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-09T18:20:45.139038] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T18:20:45.596736] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-09T18:20:45.874896] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T18:20:45.930241] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T18:20:46.351843] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (3.96 seconds). [2025-10-09T18:20:46.396771] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-09T18:20:47.057895] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T18:20:47.196694] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-09T18:20:47.352013] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T18:20:47.996726] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-09T18:20:48.796720] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-09T18:20:49.475267] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T18:20:49.510770] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-09T18:20:49.596677] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-09T18:20:49.731243] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T18:20:50.396728] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-09T18:20:50.831308] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T18:20:51.196717] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-09T18:20:51.960623] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T18:20:51.996676] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-09T18:20:52.321364] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-09T18:20:52.796728] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-09T18:20:52.844578] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T18:20:52.846184] [INFO ] [REMOTE ] DAC: Full fetch complete (19360 records). [2025-10-09T18:20:52.846255] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-09T18:20:53.215909] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-09T18:20:53.215986] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-09T18:20:53.216370] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-09T18:20:53.216410] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-09T18:20:53.216981] [DEBUG] [LOCAL ] DAC: Trimmed 19360 records to 12658 (keeping 200 days of data) [2025-10-09T18:20:53.293452] [DEBUG] [LOCAL ] DAC: Primary data saved (12658 records). [2025-10-09T18:20:53.293585] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-09T18:20:53.293704] [INFO ] [MAIN ] Update Progress: 584/2373 symbols completed. DAC took 22.6s. Estimated remaining: 4h 7m 36s. Rate: 7.2 symbols/min [2025-10-09T18:20:53.461562] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:53.511949] [DEBUG] [LOCAL ] DAN: Loaded 49113 existing records from primary storage. [2025-10-09T18:20:53.512274] [INFO ] [MAIN ] DAN: Loaded 49113 existing records. [2025-10-09T18:20:53.601901] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-09T18:20:53.691409] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:53.691588] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-09T18:20:53.691636] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-09T18:20:53.692020] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-09T18:20:53.692076] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-09T18:20:54.051037] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:54.288859] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T18:20:54.396718] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-09T18:20:55.196811] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-09T18:20:55.806626] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-09T18:20:55.996778] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-09T18:20:56.125303] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:20:56.796698] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-09T18:20:56.838678] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T18:20:56.842781] [INFO ] [REMOTE ] CYH: Full fetch complete (69793 records). [2025-10-09T18:20:56.842897] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-09T18:20:57.232903] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-09T18:20:57.232980] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-09T18:20:57.233783] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-09T18:20:57.233845] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-09T18:20:57.235198] [DEBUG] [LOCAL ] CYH: Trimmed 69793 records to 47995 (keeping 200 days of data) [2025-10-09T18:20:57.498928] [DEBUG] [LOCAL ] CYH: Primary data saved (47995 records). [2025-10-09T18:20:57.499063] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-09T18:20:57.499142] [INFO ] [MAIN ] Update Progress: 585/2373 symbols completed. CYH took 38.3s. Estimated remaining: 4h 7m 16s. Rate: 7.2 symbols/min [2025-10-09T18:20:57.599105] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-09T18:20:57.675181] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:20:57.695073] [DEBUG] [LOCAL ] DAO: Loaded 20100 existing records from primary storage. [2025-10-09T18:20:57.695306] [INFO ] [MAIN ] DAO: Loaded 20100 existing records. [2025-10-09T18:20:57.874492] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:20:57.874715] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-09T18:20:57.874771] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-09T18:20:57.874982] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-09T18:20:57.875038] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-09T18:20:58.238330] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:20:58.367880] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T18:20:58.396672] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-09T18:20:59.171389] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T18:20:59.196687] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-09T18:20:59.996711] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-09T18:21:00.065140] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:21:00.089826] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (4.09 seconds). [2025-10-09T18:21:00.796688] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-09T18:21:01.140852] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T18:21:01.445511] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T18:21:01.596783] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-09T18:21:02.364061] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T18:21:02.396675] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-09T18:21:03.169629] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-09T18:21:03.196673] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-09T18:21:03.633889] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:21:03.996696] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-09T18:21:04.796801] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-09T18:21:05.445550] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-09T18:21:05.596691] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-09T18:21:05.651882] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T18:21:06.352280] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:21:06.357478] [INFO ] [REMOTE ] D: Full fetch complete (77657 records). [2025-10-09T18:21:06.357681] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-09T18:21:06.401826] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-09T18:21:06.790198] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-09T18:21:06.790352] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-09T18:21:06.791263] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-09T18:21:06.791327] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-09T18:21:06.792747] [DEBUG] [LOCAL ] D: Trimmed 77657 records to 54037 (keeping 200 days of data) [2025-10-09T18:21:07.124507] [DEBUG] [LOCAL ] D: Primary data saved (54037 records). [2025-10-09T18:21:07.124666] [INFO ] [MAIN ] D: Full history saved. [2025-10-09T18:21:07.124782] [INFO ] [MAIN ] Update Progress: 586/2373 symbols completed. D took 40.3s. Estimated remaining: 4h 7m 11s. Rate: 7.2 symbols/min [2025-10-09T18:21:07.201904] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-09T18:21:07.295952] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:07.345122] [DEBUG] [LOCAL ] DAR: Loaded 51876 existing records from primary storage. [2025-10-09T18:21:07.345439] [INFO ] [MAIN ] DAR: Loaded 51876 existing records. [2025-10-09T18:21:07.526430] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:21:07.526779] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-09T18:21:07.526850] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-09T18:21:07.527275] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-09T18:21:07.527385] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-09T18:21:07.864429] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-09T18:21:07.940966] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:07.960462] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T18:21:07.996666] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-09T18:21:08.796690] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-09T18:21:08.831163] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T18:21:09.001542] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:21:09.596725] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-09T18:21:10.261190] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T18:21:10.396714] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-09T18:21:11.196742] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-09T18:21:11.285207] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T18:21:11.725608] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (2.93 seconds). [2025-10-09T18:21:11.996750] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-09T18:21:12.801805] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-09T18:21:12.818546] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:21:13.070900] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T18:21:13.596714] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-09T18:21:14.255039] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-09T18:21:14.396714] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-09T18:21:14.725229] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T18:21:15.196733] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-09T18:21:15.996742] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-09T18:21:16.070432] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:21:16.796689] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-09T18:21:16.839491] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:21:17.596720] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-09T18:21:18.147382] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T18:21:18.188527] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-09T18:21:18.396686] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-09T18:21:18.681071] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T18:21:19.196715] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-09T18:21:19.996744] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-09T18:21:20.146235] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T18:21:20.292757] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:21:20.295231] [INFO ] [REMOTE ] DAO: Full fetch complete (32177 records). [2025-10-09T18:21:20.295342] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-09T18:21:20.704862] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-09T18:21:20.704968] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-09T18:21:20.705554] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-09T18:21:20.705619] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-09T18:21:20.706467] [DEBUG] [LOCAL ] DAO: Trimmed 32177 records to 20161 (keeping 200 days of data) [2025-10-09T18:21:20.796771] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-09T18:21:20.820342] [DEBUG] [LOCAL ] DAO: Primary data saved (20161 records). [2025-10-09T18:21:20.820462] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-09T18:21:20.820541] [INFO ] [MAIN ] Update Progress: 587/2373 symbols completed. DAO took 23.3s. Estimated remaining: 4h 7m 20s. Rate: 7.2 symbols/min [2025-10-09T18:21:21.000265] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:21.046977] [DEBUG] [LOCAL ] DAVA: Loaded 41417 existing records from primary storage. [2025-10-09T18:21:21.047298] [INFO ] [MAIN ] DAVA: Loaded 41417 existing records. [2025-10-09T18:21:21.254885] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:21:21.255112] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-09T18:21:21.255159] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-09T18:21:21.255787] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-09T18:21:21.255846] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-09T18:21:21.605436] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-09T18:21:21.611763] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:21.780014] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T18:21:22.396702] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-09T18:21:22.536726] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T18:21:23.196734] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-09T18:21:23.591501] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-09T18:21:23.597049] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-09T18:21:23.597239] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-09T18:21:24.018021] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-09T18:21:24.048682] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T18:21:24.046622] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-09T18:21:24.059588] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-09T18:21:24.060739] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-09T18:21:24.060826] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-09T18:21:24.062758] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54143 (keeping 200 days of data) [2025-10-09T18:21:24.371583] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T18:21:24.427145] [DEBUG] [LOCAL ] DAL: Primary data saved (54143 records). [2025-10-09T18:21:24.427290] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-09T18:21:24.427924] [INFO ] [MAIN ] Update Progress: 588/2373 symbols completed. DAL took 43.2s. Estimated remaining: 4h 6m 57s. Rate: 7.2 symbols/min [2025-10-09T18:21:24.630352] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:24.630581] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-10-09T18:21:24.630669] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-10-09T18:21:24.630794] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-09T18:21:24.630838] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-09T18:21:24.630880] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-10-09T18:21:24.630913] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-09T18:21:24.801880] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-09T18:21:25.053844] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:25.596689] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-09T18:21:25.689991] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:21:25.761337] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T18:21:26.396779] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-09T18:21:26.718016] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T18:21:27.196718] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-09T18:21:27.996690] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-09T18:21:28.259740] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T18:21:28.655798] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T18:21:28.660206] [INFO ] [REMOTE ] DAN: Full fetch complete (70894 records). [2025-10-09T18:21:28.660348] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-09T18:21:28.807594] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-09T18:21:29.096063] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-09T18:21:29.096185] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-09T18:21:29.097335] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-09T18:21:29.097406] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-09T18:21:29.099076] [DEBUG] [LOCAL ] DAN: Trimmed 70894 records to 49495 (keeping 200 days of data) [2025-10-09T18:21:29.420373] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T18:21:29.443903] [DEBUG] [LOCAL ] DAN: Primary data saved (49495 records). [2025-10-09T18:21:29.444052] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-09T18:21:29.444932] [INFO ] [MAIN ] Update Progress: 589/2373 symbols completed. DAN took 36.2s. Estimated remaining: 4h 6m 39s. Rate: 7.2 symbols/min [2025-10-09T18:21:29.600518] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-09T18:21:29.626097] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:29.686466] [DEBUG] [LOCAL ] DB: Loaded 52514 existing records from primary storage. [2025-10-09T18:21:29.686880] [INFO ] [MAIN ] DB: Loaded 52514 existing records. [2025-10-09T18:21:29.888001] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:21:29.888282] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-09T18:21:29.888344] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-09T18:21:29.888590] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-09T18:21:29.888687] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-09T18:21:30.287047] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:30.396736] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-09T18:21:30.794749] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T18:21:31.196719] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-09T18:21:31.713522] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T18:21:31.740941] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-09T18:21:31.996713] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-09T18:21:32.796712] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-09T18:21:33.596746] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-09T18:21:33.946152] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-09T18:21:34.141332] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:21:34.396691] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-09T18:21:35.080242] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T18:21:35.196695] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-09T18:21:35.346807] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (3.35 seconds). [2025-10-09T18:21:35.996723] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-09T18:21:36.070054] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T18:21:36.328099] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T18:21:36.796767] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-09T18:21:37.596690] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-09T18:21:37.807256] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:21:38.024433] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T18:21:38.396733] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-09T18:21:38.813618] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T18:21:39.196720] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-09T18:21:39.996770] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-09T18:21:40.328691] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T18:21:40.804010] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-09T18:21:40.825995] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:21:41.248489] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T18:21:41.596849] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-09T18:21:42.396746] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-09T18:21:42.547702] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:21:43.196698] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-09T18:21:43.322723] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T18:21:43.398912] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T18:21:43.996788] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-09T18:21:44.796763] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-09T18:21:45.122679] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T18:21:45.487531] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T18:21:45.596680] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-09T18:21:46.396695] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-09T18:21:46.677751] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T18:21:47.131930] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T18:21:47.196754] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-09T18:21:47.687528] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T18:21:47.996761] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-09T18:21:48.796807] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-09T18:21:48.969560] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T18:21:49.596761] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-09T18:21:49.745399] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:21:49.749824] [INFO ] [REMOTE ] DAVA: Full fetch complete (56507 records). [2025-10-09T18:21:49.749972] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-09T18:21:50.138383] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-09T18:21:50.138473] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-09T18:21:50.139210] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-09T18:21:50.139277] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-09T18:21:50.140569] [DEBUG] [LOCAL ] DAVA: Trimmed 56507 records to 41762 (keeping 200 days of data) [2025-10-09T18:21:50.392225] [DEBUG] [LOCAL ] DAVA: Primary data saved (41762 records). [2025-10-09T18:21:50.392357] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-09T18:21:50.392435] [INFO ] [MAIN ] Update Progress: 590/2373 symbols completed. DAVA took 29.6s. Estimated remaining: 4h 7m 9s. Rate: 7.2 symbols/min [2025-10-09T18:21:50.423899] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-09T18:21:50.564127] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:50.564332] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-09T18:21:50.564390] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-09T18:21:50.564535] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-09T18:21:50.564578] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-09T18:21:50.564622] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-09T18:21:50.564694] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-09T18:21:50.954603] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:50.977691] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-09T18:21:51.183208] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T18:21:51.189453] [INFO ] [REMOTE ] DAR: Full fetch complete (74631 records). [2025-10-09T18:21:51.189673] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-09T18:21:51.202492] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-09T18:21:51.589718] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-09T18:21:51.589899] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-09T18:21:51.590890] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-09T18:21:51.590974] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-09T18:21:51.592737] [DEBUG] [LOCAL ] DAR: Trimmed 74631 records to 52249 (keeping 200 days of data) [2025-10-09T18:21:51.797194] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T18:21:51.937272] [DEBUG] [LOCAL ] DAR: Primary data saved (52249 records). [2025-10-09T18:21:51.937420] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-09T18:21:51.937507] [INFO ] [MAIN ] Update Progress: 591/2373 symbols completed. DAR took 44.8s. Estimated remaining: 4h 6m 40s. Rate: 7.2 symbols/min [2025-10-09T18:21:52.001815] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-09T18:21:52.106187] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:21:52.146785] [DEBUG] [LOCAL ] DBI: Loaded 44280 existing records from primary storage. [2025-10-09T18:21:52.147081] [INFO ] [MAIN ] DBI: Loaded 44280 existing records. [2025-10-09T18:21:52.324811] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:21:52.325087] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-09T18:21:52.325165] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-09T18:21:52.325713] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-09T18:21:52.325798] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-09T18:21:52.698863] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:21:52.796679] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-09T18:21:52.939690] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:21:53.312537] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T18:21:53.596745] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-09T18:21:54.405138] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-09T18:21:54.410228] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T18:21:55.196769] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-09T18:21:55.333549] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:21:55.996706] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-09T18:21:56.796737] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-09T18:21:56.925728] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:21:57.132921] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-09T18:21:57.397315] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:21:57.596735] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-09T18:21:58.396710] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-09T18:21:58.719021] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-10-09T18:21:58.857212] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T18:21:59.196703] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-09T18:21:59.996706] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-09T18:22:00.262148] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T18:22:00.266602] [INFO ] [REMOTE ] DB: Full fetch complete (74827 records). [2025-10-09T18:22:00.266766] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-09T18:22:00.682129] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-09T18:22:00.682267] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-09T18:22:00.684473] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-09T18:22:00.683395] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T18:22:00.687750] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-09T18:22:00.690393] [DEBUG] [LOCAL ] DB: Trimmed 74827 records to 52889 (keeping 200 days of data) [2025-10-09T18:22:00.796926] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-09T18:22:01.024136] [DEBUG] [LOCAL ] DB: Primary data saved (52889 records). [2025-10-09T18:22:01.024280] [INFO ] [MAIN ] DB: Full history saved. [2025-10-09T18:22:01.025320] [INFO ] [MAIN ] Update Progress: 592/2373 symbols completed. DB took 31.6s. Estimated remaining: 4h 6m 34s. Rate: 7.2 symbols/min [2025-10-09T18:22:01.221489] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-09T18:22:01.220184] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:22:01.231176] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-09T18:22:01.231441] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-09T18:22:01.231678] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-09T18:22:01.231733] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-09T18:22:01.231781] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-09T18:22:01.231814] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-09T18:22:01.581116] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:22:01.596752] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-09T18:22:02.396688] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-09T18:22:02.469202] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T18:22:02.472947] [INFO ] [REMOTE ] DAY: Full fetch complete (71477 records). [2025-10-09T18:22:02.473051] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-09T18:22:02.882465] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-09T18:22:02.882553] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-09T18:22:02.883408] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-09T18:22:02.883474] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-09T18:22:02.884933] [DEBUG] [LOCAL ] DAY: Trimmed 71477 records to 49556 (keeping 200 days of data) [2025-10-09T18:22:03.185670] [DEBUG] [LOCAL ] DAY: Primary data saved (49556 records). [2025-10-09T18:22:03.185835] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-09T18:22:03.185982] [INFO ] [MAIN ] Update Progress: 593/2373 symbols completed. DAY took 38.8s. Estimated remaining: 4h 6m 7s. Rate: 7.2 symbols/min [2025-10-09T18:22:03.217700] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-09T18:22:03.367194] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:22:03.397726] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:22:03.418093] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T18:22:03.465028] [DEBUG] [LOCAL ] DBRG: Loaded 49813 existing records from primary storage. [2025-10-09T18:22:03.465369] [INFO ] [MAIN ] DBRG: Loaded 49813 existing records. [2025-10-09T18:22:03.637439] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:22:03.637683] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-09T18:22:03.637755] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-09T18:22:03.639190] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-09T18:22:03.639252] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-09T18:22:03.995770] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:22:03.996671] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-09T18:22:04.011602] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T18:22:04.796708] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-09T18:22:05.501849] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T18:22:05.591119] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T18:22:05.604134] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-09T18:22:06.315811] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T18:22:06.396751] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-09T18:22:07.120454] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T18:22:07.196772] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-09T18:22:07.996730] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-09T18:22:08.091305] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T18:22:08.670971] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T18:22:08.796735] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-09T18:22:09.290049] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T18:22:09.596727] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-09T18:22:10.396750] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-09T18:22:10.684239] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T18:22:11.196741] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-09T18:22:11.930478] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T18:22:11.945951] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T18:22:11.996696] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-09T18:22:12.594845] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T18:22:12.796733] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-09T18:22:13.596695] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-09T18:22:14.396741] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-09T18:22:14.546091] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T18:22:14.919079] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:22:15.196754] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-09T18:22:15.390843] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T18:22:15.996769] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-09T18:22:16.541304] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:22:16.796779] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-09T18:22:16.919181] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T18:22:17.596761] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-09T18:22:18.396701] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-09T18:22:18.452706] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T18:22:19.196762] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-09T18:22:19.218012] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T18:22:19.578316] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T18:22:19.996699] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-09T18:22:20.796841] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-09T18:22:20.888827] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T18:22:21.520903] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T18:22:21.578797] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T18:22:21.596672] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-09T18:22:22.396717] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-09T18:22:22.814093] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T18:22:23.196682] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-09T18:22:23.525015] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T18:22:23.715905] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-09T18:22:23.996738] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-09T18:22:24.796714] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-09T18:22:25.596681] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-09T18:22:25.776048] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T18:22:26.226864] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T18:22:26.228194] [INFO ] [REMOTE ] DBL: Full fetch complete (12461 records). [2025-10-09T18:22:26.228277] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-09T18:22:26.228825] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:22:26.228953] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:22:26.229011] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:22:26.229087] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-09T18:22:26.229158] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-09T18:22:26.229213] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-10-09T18:22:26.229302] [DEBUG] [LOCAL ] DBL: No derivative data file found to delete. [2025-10-09T18:22:26.229394] [INFO ] [MAIN ] Update Progress: 594/2373 symbols completed. DBL took 25.2s. Estimated remaining: 4h 6m 43s. Rate: 7.2 symbols/min [2025-10-09T18:22:26.401490] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-09T18:22:26.429451] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:22:26.431553] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T18:22:26.436139] [INFO ] [REMOTE ] DBI: Full fetch complete (65470 records). [2025-10-09T18:22:26.436281] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-09T18:22:26.743556] [DEBUG] [LOCAL ] DCI: Loaded 37056 existing records from primary storage. [2025-10-09T18:22:26.760751] [INFO ] [MAIN ] DCI: Loaded 37056 existing records. [2025-10-09T18:22:27.068683] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-09T18:22:27.069961] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-09T18:22:27.071420] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-09T18:22:27.078068] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-09T18:22:27.091064] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:22:27.091372] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-09T18:22:27.091440] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-09T18:22:27.091834] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-09T18:22:27.091900] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-09T18:22:27.091978] [DEBUG] [LOCAL ] DBI: Trimmed 65470 records to 44574 (keeping 200 days of data) [2025-10-09T18:22:27.229801] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-09T18:22:27.580395] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:22:27.758578] [DEBUG] [LOCAL ] DBI: Primary data saved (44574 records). [2025-10-09T18:22:27.759238] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-09T18:22:27.760206] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:22:27.760310] [INFO ] [MAIN ] Update Progress: 595/2373 symbols completed. DBI took 35.8s. Estimated remaining: 4h 6m 14s. Rate: 7.2 symbols/min [2025-10-09T18:22:27.941519] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:22:27.941747] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-09T18:22:27.941793] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-09T18:22:27.941912] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-09T18:22:27.941953] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-09T18:22:27.941994] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-09T18:22:27.942025] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-09T18:22:28.002471] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-09T18:22:28.279993] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T18:22:28.324897] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:22:28.796712] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-09T18:22:29.596677] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-09T18:22:29.615798] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T18:22:29.733322] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:22:30.328506] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T18:22:30.330629] [INFO ] [REMOTE ] DBD: Full fetch complete (31021 records). [2025-10-09T18:22:30.330856] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-09T18:22:30.331382] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:22:30.331468] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:22:30.331520] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:22:30.331600] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-09T18:22:30.331759] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-09T18:22:30.331825] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-09T18:22:30.331902] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-09T18:22:30.331998] [INFO ] [MAIN ] Update Progress: 596/2373 symbols completed. DBD took 39.9s. Estimated remaining: 4h 5m 49s. Rate: 7.2 symbols/min [2025-10-09T18:22:30.401902] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-09T18:22:30.507514] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:22:30.555578] [DEBUG] [LOCAL ] DD: Loaded 52853 existing records from primary storage. [2025-10-09T18:22:30.555911] [INFO ] [MAIN ] DD: Loaded 52853 existing records. [2025-10-09T18:22:30.729198] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:22:30.729385] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-09T18:22:30.729431] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-09T18:22:30.730719] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-09T18:22:30.730781] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-09T18:22:31.075258] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:22:31.196732] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-09T18:22:31.996743] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-09T18:22:32.319055] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T18:22:32.577449] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T18:22:32.796691] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-09T18:22:32.886405] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T18:22:33.596713] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-09T18:22:34.396694] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-09T18:22:34.649048] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T18:22:35.197741] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-09T18:22:35.200549] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T18:22:35.307589] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T18:22:35.996756] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-09T18:22:36.608898] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T18:22:36.796687] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-09T18:22:36.888772] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:22:37.596770] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-09T18:22:38.364505] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T18:22:38.396680] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-09T18:22:39.196696] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-09T18:22:39.212906] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T18:22:39.217017] [INFO ] [REMOTE ] DBRG: Full fetch complete (72312 records). [2025-10-09T18:22:39.217118] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-09T18:22:39.653037] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-09T18:22:39.653130] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-09T18:22:39.654696] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-09T18:22:39.654794] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-09T18:22:39.656208] [DEBUG] [LOCAL ] DBRG: Trimmed 72312 records to 50140 (keeping 200 days of data) [2025-10-09T18:22:39.987234] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T18:22:39.998493] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-09T18:22:40.015340] [DEBUG] [LOCAL ] DBRG: Primary data saved (50140 records). [2025-10-09T18:22:40.015459] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-09T18:22:40.016049] [INFO ] [MAIN ] Update Progress: 597/2373 symbols completed. DBRG took 36.8s. Estimated remaining: 4h 5m 45s. Rate: 7.2 symbols/min [2025-10-09T18:22:40.377813] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:22:40.796805] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-09T18:22:40.894683] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T18:22:41.596793] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-09T18:22:42.156636] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T18:22:42.396726] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-09T18:22:42.407964] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T18:22:43.196775] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-09T18:22:43.996705] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-09T18:22:44.134195] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:22:44.640336] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:22:44.796701] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-09T18:22:44.959678] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T18:22:45.596757] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-09T18:22:46.396702] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-09T18:22:46.669744] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:22:46.753570] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T18:22:47.196682] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-09T18:22:47.294286] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T18:22:47.996782] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-09T18:22:48.619961] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T18:22:48.796716] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-09T18:22:49.001734] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T18:22:49.596790] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-09T18:22:49.998290] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T18:22:50.328418] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T18:22:50.396683] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-09T18:22:51.196799] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-09T18:22:51.241045] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T18:22:51.242509] [INFO ] [REMOTE ] DCO: Full fetch complete (19006 records). [2025-10-09T18:22:51.242580] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-09T18:22:51.615127] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-09T18:22:51.615243] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-09T18:22:51.615749] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-09T18:22:51.615814] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-09T18:22:51.616484] [DEBUG] [LOCAL ] DCO: Trimmed 19006 records to 14031 (keeping 200 days of data) [2025-10-09T18:22:51.701064] [DEBUG] [LOCAL ] DCO: Primary data saved (14031 records). [2025-10-09T18:22:51.701220] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-09T18:22:51.701339] [INFO ] [MAIN ] Update Progress: 598/2373 symbols completed. DCO took 23.9s. Estimated remaining: 4h 5m 47s. Rate: 7.2 symbols/min [2025-10-09T18:22:51.996774] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-09T18:23:07.254989] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (16.06 seconds). [2025-10-09T18:23:07.263258] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-09T18:23:07.591911] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (15.60 seconds). [2025-10-09T18:23:07.603532] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-09T18:23:08.411949] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T18:23:08.420066] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-09T18:23:09.526377] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-09T18:23:09.539094] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-09T18:23:09.647152] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T18:23:09.656117] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-09T18:23:11.083559] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T18:23:11.092490] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-09T18:23:11.181827] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T18:23:11.193157] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-09T18:23:12.401186] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:23:12.405365] [INFO ] [REMOTE ] DCI: Full fetch complete (53639 records). [2025-10-09T18:23:12.405503] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-09T18:23:12.797513] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-09T18:23:12.797593] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-09T18:23:12.798316] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-09T18:23:12.798381] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-09T18:23:12.799461] [DEBUG] [LOCAL ] DCI: Trimmed 53639 records to 37295 (keeping 200 days of data) [2025-10-09T18:23:13.025528] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T18:23:13.032759] [INFO ] [REMOTE ] DD: Full fetch complete (76369 records). [2025-10-09T18:23:13.033756] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-09T18:23:13.170499] [DEBUG] [LOCAL ] DCI: Primary data saved (37295 records). [2025-10-09T18:23:13.199012] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-09T18:23:13.229416] [INFO ] [MAIN ] Update Progress: 599/2373 symbols completed. DCI took 47.0s. Estimated remaining: 4h 6m 17s. Rate: 7.2 symbols/min [2025-10-09T18:23:13.441377] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-09T18:23:13.441458] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-09T18:23:13.442353] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-09T18:23:13.442417] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-09T18:23:13.443892] [DEBUG] [LOCAL ] DD: Trimmed 76369 records to 53236 (keeping 200 days of data) [2025-10-09T18:23:13.769202] [DEBUG] [LOCAL ] DD: Primary data saved (53236 records). [2025-10-09T18:23:13.769342] [INFO ] [MAIN ] DD: Full history saved. [2025-10-09T18:23:13.769458] [INFO ] [MAIN ] Update Progress: 600/2373 symbols completed. DD took 43.4s. Estimated remaining: 4h 5m 46s. Rate: 7.2 symbols/min [2025-10-09T18:23:14.340208] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:14.428821] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:14.505834] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:14.502424] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:14.506549] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-10-09T18:23:14.506605] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-10-09T18:23:14.506756] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-09T18:23:14.506829] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-09T18:23:14.506898] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-10-09T18:23:14.506933] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-09T18:23:14.552705] [DEBUG] [LOCAL ] DDT: Loaded 2086 existing records from primary storage. [2025-10-09T18:23:14.559982] [INFO ] [MAIN ] DDT: Loaded 2086 existing records. [2025-10-09T18:23:14.756265] [DEBUG] [LOCAL ] DDS: Loaded 12832 existing records from primary storage. [2025-10-09T18:23:14.813490] [INFO ] [MAIN ] DDS: Loaded 12832 existing records. [2025-10-09T18:23:14.848686] [DEBUG] [LOCAL ] DDL: Loaded 36794 existing records from primary storage. [2025-10-09T18:23:14.958288] [INFO ] [MAIN ] DDL: Loaded 36794 existing records. [2025-10-09T18:23:15.004297] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:15.076230] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-09T18:23:15.125997] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-09T18:23:15.190301] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-09T18:23:15.190711] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-09T18:23:15.525213] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:15.544143] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:15.614330] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:15.591329] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-09T18:23:15.614707] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-09T18:23:15.630454] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-09T18:23:15.630213] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-09T18:23:15.630582] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-09T18:23:15.642869] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-09T18:23:15.643182] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-09T18:23:15.658772] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-09T18:23:15.707556] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-09T18:23:16.523894] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:16.574258] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-09T18:23:16.731868] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:16.754934] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-09T18:23:16.761368] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:16.761828] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-09T18:23:17.040145] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-09T18:23:17.041419] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-09T18:23:17.558589] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-09T18:23:17.570399] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-09T18:23:17.688016] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T18:23:17.689396] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-09T18:23:17.932691] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T18:23:17.936390] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-09T18:23:17.991581] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-09T18:23:17.992859] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-09T18:23:18.099068] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T18:23:18.108032] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-09T18:23:18.508771] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T18:23:18.512604] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-09T18:23:18.790219] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T18:23:18.791381] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-09T18:23:19.033887] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T18:23:19.043948] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-09T18:23:19.132764] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T18:23:19.136106] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-09T18:23:19.422299] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T18:23:19.424218] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-09T18:23:19.571623] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T18:23:19.578708] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-09T18:23:19.787256] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-09T18:23:19.788407] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-09T18:23:20.131970] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T18:23:20.133438] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-09T18:23:20.144059] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T18:23:20.147920] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-09T18:23:20.483064] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-09T18:23:20.485194] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-09T18:23:20.514835] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T18:23:20.525074] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-09T18:23:20.657553] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T18:23:20.665356] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-09T18:23:20.792484] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-09T18:23:20.794066] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-09T18:23:21.140757] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T18:23:21.141875] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-09T18:23:21.256517] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T18:23:21.260337] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-09T18:23:21.629819] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T18:23:21.630514] [INFO ] [REMOTE ] DDT: Full fetch complete (2843 records). [2025-10-09T18:23:21.630584] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-09T18:23:21.989625] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-09T18:23:21.989779] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-09T18:23:21.989910] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-09T18:23:21.989987] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-09T18:23:22.003020] [DEBUG] [LOCAL ] DDT: Trimmed 2843 records to 2096 (keeping 200 days of data) [2025-10-09T18:23:22.011996] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T18:23:22.030052] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-09T18:23:22.034625] [DEBUG] [LOCAL ] DDT: Primary data saved (2096 records). [2025-10-09T18:23:22.034732] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-09T18:23:22.034825] [INFO ] [MAIN ] Update Progress: 601/2373 symbols completed. DDT took 8.3s. Estimated remaining: 4h 5m 38s. Rate: 7.2 symbols/min [2025-10-09T18:23:22.213248] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:22.225738] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:23:22.230399] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-09T18:23:22.271452] [DEBUG] [LOCAL ] DE: Loaded 47554 existing records from primary storage. [2025-10-09T18:23:22.271789] [INFO ] [MAIN ] DE: Loaded 47554 existing records. [2025-10-09T18:23:22.461023] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T18:23:22.495526] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:22.496146] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-09T18:23:22.497139] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-09T18:23:22.497206] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-09T18:23:22.497454] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-09T18:23:22.497511] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-09T18:23:22.854612] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:22.854957] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-09T18:23:23.177601] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T18:23:23.181396] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-09T18:23:23.418921] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T18:23:23.429393] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-09T18:23:23.954636] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T18:23:23.959902] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-09T18:23:24.264757] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T18:23:24.281945] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-09T18:23:24.344934] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T18:23:24.750175] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T18:23:24.796667] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-09T18:23:24.926716] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T18:23:25.479169] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T18:23:25.596732] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-09T18:23:26.259000] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-09T18:23:26.396732] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-09T18:23:27.196722] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-09T18:23:27.996720] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-09T18:23:28.428545] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-10-09T18:23:28.514097] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T18:23:28.562174] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-09T18:23:28.796734] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-09T18:23:29.054509] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T18:23:29.055775] [INFO ] [REMOTE ] DDS: Full fetch complete (18807 records). [2025-10-09T18:23:29.055852] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-09T18:23:29.443626] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-09T18:23:29.443737] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-09T18:23:29.444125] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-09T18:23:29.444164] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-09T18:23:29.444704] [DEBUG] [LOCAL ] DDS: Trimmed 18807 records to 12885 (keeping 200 days of data) [2025-10-09T18:23:29.530356] [DEBUG] [LOCAL ] DDS: Primary data saved (12885 records). [2025-10-09T18:23:29.530494] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-09T18:23:29.530577] [INFO ] [MAIN ] Update Progress: 602/2373 symbols completed. DDS took 15.8s. Estimated remaining: 4h 5m 27s. Rate: 7.2 symbols/min [2025-10-09T18:23:29.604299] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-09T18:23:29.705992] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:29.729827] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T18:23:29.767284] [DEBUG] [LOCAL ] DEA: Loaded 40555 existing records from primary storage. [2025-10-09T18:23:29.767562] [INFO ] [MAIN ] DEA: Loaded 40555 existing records. [2025-10-09T18:23:29.948288] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:29.948514] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-09T18:23:29.948564] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-09T18:23:29.948825] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-09T18:23:29.948892] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-09T18:23:30.325026] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:30.396732] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-09T18:23:31.196686] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-09T18:23:31.280280] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T18:23:31.663315] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T18:23:31.996685] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-09T18:23:32.796790] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-09T18:23:33.106154] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T18:23:33.251848] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T18:23:33.596773] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-09T18:23:34.286822] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T18:23:34.396745] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-09T18:23:35.156856] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:23:35.160538] [INFO ] [REMOTE ] DDL: Full fetch complete (53163 records). [2025-10-09T18:23:35.160627] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-09T18:23:35.204167] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-09T18:23:35.546069] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-09T18:23:35.546153] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-09T18:23:35.546891] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-09T18:23:35.546955] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-09T18:23:35.548121] [DEBUG] [LOCAL ] DDL: Trimmed 53163 records to 37060 (keeping 200 days of data) [2025-10-09T18:23:35.757106] [DEBUG] [LOCAL ] DDL: Primary data saved (37060 records). [2025-10-09T18:23:35.757253] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-09T18:23:35.757362] [INFO ] [MAIN ] Update Progress: 603/2373 symbols completed. DDL took 22.0s. Estimated remaining: 4h 5m 12s. Rate: 7.2 symbols/min [2025-10-09T18:23:35.929109] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:35.960202] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:23:35.995700] [DEBUG] [LOCAL ] DEC: Loaded 30453 existing records from primary storage. [2025-10-09T18:23:35.995964] [INFO ] [MAIN ] DEC: Loaded 30453 existing records. [2025-10-09T18:23:36.006990] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-09T18:23:36.177121] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:36.177341] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-09T18:23:36.177389] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-09T18:23:36.177611] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-09T18:23:36.177697] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-09T18:23:36.539947] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:36.796687] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-09T18:23:36.855766] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:23:37.596720] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-09T18:23:38.028348] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-09T18:23:38.171775] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:23:38.396792] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-09T18:23:39.196686] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-09T18:23:39.464541] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T18:23:39.831228] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T18:23:39.996732] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-09T18:23:40.372783] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:23:40.796759] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-09T18:23:41.596698] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-09T18:23:41.775035] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T18:23:42.396682] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-09T18:23:42.427967] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T18:23:42.433900] [INFO ] [REMOTE ] DDD: Full fetch complete (73740 records). [2025-10-09T18:23:42.434067] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-09T18:23:42.598739] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T18:23:42.848066] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-09T18:23:42.848142] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-09T18:23:42.849025] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-09T18:23:42.849099] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-09T18:23:42.850423] [DEBUG] [LOCAL ] DDD: Trimmed 73740 records to 51305 (keeping 200 days of data) [2025-10-09T18:23:43.140920] [DEBUG] [LOCAL ] DDD: Primary data saved (51305 records). [2025-10-09T18:23:43.141054] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-09T18:23:43.141130] [INFO ] [MAIN ] Update Progress: 604/2373 symbols completed. DDD took 29.4s. Estimated remaining: 4h 5m 1s. Rate: 7.2 symbols/min [2025-10-09T18:23:43.203625] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-09T18:23:43.316388] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:43.367208] [DEBUG] [LOCAL ] DECK: Loaded 53291 existing records from primary storage. [2025-10-09T18:23:43.367525] [INFO ] [MAIN ] DECK: Loaded 53291 existing records. [2025-10-09T18:23:43.545600] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:23:43.546038] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-09T18:23:43.546100] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-09T18:23:43.546465] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-09T18:23:43.546525] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-09T18:23:43.911200] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:43.927446] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T18:23:43.996671] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-09T18:23:44.714327] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T18:23:44.796714] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-09T18:23:45.596716] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-09T18:23:45.917451] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T18:23:46.396743] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-09T18:23:46.564777] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:23:46.604385] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T18:23:47.196749] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-09T18:23:47.996796] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-09T18:23:48.247279] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-09T18:23:48.800324] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-09T18:23:48.802710] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T18:23:49.521409] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T18:23:49.596800] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-09T18:23:50.396779] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-09T18:23:50.626261] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-09T18:23:50.997849] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T18:23:51.196766] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-09T18:23:51.780365] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:23:51.996753] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-09T18:23:52.514015] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:23:52.796722] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-09T18:23:53.564738] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T18:23:53.596673] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-09T18:23:53.759331] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T18:23:54.396715] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-09T18:23:55.196729] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-09T18:23:55.275584] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T18:23:55.280226] [INFO ] [REMOTE ] DE: Full fetch complete (69462 records). [2025-10-09T18:23:55.280384] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-09T18:23:55.679792] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-09T18:23:55.679878] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-09T18:23:55.680794] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-09T18:23:55.680860] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-09T18:23:55.682218] [DEBUG] [LOCAL ] DE: Trimmed 69462 records to 47889 (keeping 200 days of data) [2025-10-09T18:23:55.937229] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T18:23:56.003026] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-09T18:23:56.033818] [DEBUG] [LOCAL ] DE: Primary data saved (47889 records). [2025-10-09T18:23:56.033929] [INFO ] [MAIN ] DE: Full history saved. [2025-10-09T18:23:56.034009] [INFO ] [MAIN ] Update Progress: 605/2373 symbols completed. DE took 34.0s. Estimated remaining: 4h 5m 6s. Rate: 7.2 symbols/min [2025-10-09T18:23:56.209020] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:23:56.209176] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-10-09T18:23:56.209212] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-10-09T18:23:56.209394] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-09T18:23:56.209472] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-09T18:23:56.209536] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-09T18:23:56.209571] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-09T18:23:56.567992] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:23:56.796724] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-09T18:23:56.928188] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T18:23:57.166775] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-09T18:23:57.596729] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-09T18:23:58.299399] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T18:23:58.396739] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-09T18:23:59.196691] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-09T18:23:59.295566] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T18:23:59.996770] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-09T18:24:00.491608] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-09T18:24:00.796689] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-09T18:24:01.096718] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T18:24:01.596711] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-09T18:24:01.722792] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:24:02.044883] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T18:24:02.396701] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-09T18:24:02.929128] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T18:24:03.196730] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-09T18:24:03.525450] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T18:24:03.996730] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-09T18:24:04.505729] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T18:24:04.796721] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-09T18:24:05.279550] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T18:24:05.596726] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-09T18:24:06.396763] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-09T18:24:06.645693] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T18:24:06.729386] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:24:06.732675] [INFO ] [REMOTE ] DEA: Full fetch complete (61871 records). [2025-10-09T18:24:06.732780] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-09T18:24:06.734259] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:24:06.734350] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:24:06.734393] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:24:06.734461] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-09T18:24:06.734525] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-09T18:24:06.734560] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-09T18:24:06.735013] [DEBUG] [LOCAL ] DEA: Deleted derivative data file. [2025-10-09T18:24:06.735951] [INFO ] [MAIN ] Update Progress: 606/2373 symbols completed. DEA took 37.2s. Estimated remaining: 4h 5m 5s. Rate: 7.2 symbols/min [2025-10-09T18:24:06.903620] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:06.957966] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-09T18:24:06.958324] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-09T18:24:07.132895] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:24:07.133111] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-09T18:24:07.133156] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-09T18:24:07.134493] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-09T18:24:07.134551] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-09T18:24:07.201932] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-09T18:24:07.493686] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:07.630514] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T18:24:07.996744] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-09T18:24:08.518399] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T18:24:08.521677] [INFO ] [REMOTE ] DEC: Full fetch complete (43834 records). [2025-10-09T18:24:08.521781] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-09T18:24:08.806210] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-09T18:24:08.898854] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-09T18:24:08.898931] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-09T18:24:08.899636] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-09T18:24:08.899721] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-09T18:24:08.900633] [DEBUG] [LOCAL ] DEC: Trimmed 43834 records to 30645 (keeping 200 days of data) [2025-10-09T18:24:09.087460] [DEBUG] [LOCAL ] DEC: Primary data saved (30645 records). [2025-10-09T18:24:09.087610] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-09T18:24:09.087730] [INFO ] [MAIN ] Update Progress: 607/2373 symbols completed. DEC took 33.3s. Estimated remaining: 4h 4m 39s. Rate: 7.2 symbols/min [2025-10-09T18:24:09.258456] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:09.258661] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-09T18:24:09.258719] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-09T18:24:09.258830] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-09T18:24:09.258871] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-09T18:24:09.258912] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-09T18:24:09.258944] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-09T18:24:09.612199] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-09T18:24:09.617738] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:09.649030] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T18:24:10.396737] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-09T18:24:10.683404] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T18:24:11.196772] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-09T18:24:11.996751] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-09T18:24:12.109079] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T18:24:12.189330] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-09T18:24:12.796742] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-09T18:24:13.075408] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T18:24:13.547882] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:24:13.596689] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-09T18:24:14.364062] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T18:24:14.396696] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-09T18:24:15.203335] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-09T18:24:15.206576] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T18:24:15.854220] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T18:24:15.996712] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-09T18:24:16.796791] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-09T18:24:17.333616] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-09T18:24:17.543425] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T18:24:17.596700] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-09T18:24:18.306614] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-09T18:24:18.396682] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-09T18:24:19.196714] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-09T18:24:19.873797] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-09T18:24:19.996679] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-09T18:24:20.059757] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:24:20.796711] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-09T18:24:21.096235] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-09T18:24:21.596719] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-09T18:24:22.054455] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T18:24:22.257357] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T18:24:22.396683] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-09T18:24:23.196731] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-09T18:24:23.569636] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-09T18:24:23.573605] [INFO ] [REMOTE ] DECK: Full fetch complete (76405 records). [2025-10-09T18:24:23.573760] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-09T18:24:23.574605] [FATAL] [VALIDATOR ] DECK: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:24:23.574715] [FATAL] [MAIN ] DECK: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:24:23.574783] [WARN ] [MAIN ] DECK: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:24:23.574861] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-09T18:24:23.574943] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-09T18:24:23.575001] [INFO ] [LOCAL ] DECK: Starting deletion of derivative data. [2025-10-09T18:24:23.575199] [DEBUG] [LOCAL ] DECK: Deleted derivative data file. [2025-10-09T18:24:23.575867] [INFO ] [MAIN ] Update Progress: 608/2373 symbols completed. DECK took 40.4s. Estimated remaining: 4h 4m 49s. Rate: 7.2 symbols/min [2025-10-09T18:24:23.742738] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:23.776717] [DEBUG] [LOCAL ] DFH: Loaded 32083 existing records from primary storage. [2025-10-09T18:24:23.777063] [INFO ] [MAIN ] DFH: Loaded 32083 existing records. [2025-10-09T18:24:23.965512] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:24:23.965810] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-09T18:24:23.965889] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-09T18:24:23.966734] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-09T18:24:23.966795] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-09T18:24:23.997889] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-09T18:24:24.289174] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T18:24:24.377533] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:24.796744] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-09T18:24:25.289022] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-09T18:24:25.569048] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T18:24:25.573058] [INFO ] [REMOTE ] DEI: Full fetch complete (69384 records). [2025-10-09T18:24:25.573159] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-09T18:24:25.575638] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:24:25.575756] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:24:25.575800] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:24:25.575847] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-09T18:24:25.575948] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-10-09T18:24:25.575999] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-10-09T18:24:25.576055] [DEBUG] [LOCAL ] DEI: No derivative data file found to delete. [2025-10-09T18:24:25.576131] [INFO ] [MAIN ] Update Progress: 609/2373 symbols completed. DEI took 29.5s. Estimated remaining: 4h 4m 22s. Rate: 7.2 symbols/min [2025-10-09T18:24:25.605842] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-09T18:24:25.754025] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:25.775353] [DEBUG] [LOCAL ] DFIN: Loaded 22871 existing records from primary storage. [2025-10-09T18:24:25.775597] [INFO ] [MAIN ] DFIN: Loaded 22871 existing records. [2025-10-09T18:24:25.955044] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:24:25.955298] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-09T18:24:25.955371] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-09T18:24:25.956014] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-09T18:24:25.956074] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-09T18:24:26.284311] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T18:24:26.344432] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:26.396665] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-09T18:24:27.196762] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-09T18:24:27.446340] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T18:24:27.633949] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:24:27.996745] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-09T18:24:28.540192] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T18:24:28.796734] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-09T18:24:28.861466] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T18:24:29.596723] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-09T18:24:30.396738] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-09T18:24:30.817946] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-09T18:24:31.196709] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-09T18:24:31.291023] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T18:24:31.390337] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T18:24:31.996759] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-09T18:24:32.199204] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T18:24:32.796780] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-09T18:24:33.596792] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-09T18:24:34.320406] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-09T18:24:34.396703] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-09T18:24:34.591968] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T18:24:35.036548] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:24:35.196738] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-09T18:24:35.981378] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T18:24:35.996677] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-09T18:24:36.152849] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T18:24:36.796783] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-09T18:24:37.268407] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T18:24:37.596773] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-09T18:24:37.873339] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T18:24:38.396718] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-09T18:24:39.196685] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-09T18:24:39.224117] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T18:24:39.288955] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T18:24:39.996684] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-09T18:24:40.189924] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T18:24:40.796721] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-09T18:24:41.596756] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-09T18:24:41.724530] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T18:24:41.864823] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T18:24:42.396837] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-09T18:24:42.687688] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T18:24:43.196730] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-09T18:24:43.847552] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T18:24:43.996677] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-09T18:24:44.469383] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T18:24:44.796760] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-09T18:24:45.596686] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-09T18:24:45.719877] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T18:24:45.721204] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T18:24:46.364204] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T18:24:46.396665] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-09T18:24:47.196736] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-09T18:24:47.373360] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:24:47.996704] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-09T18:24:48.451842] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T18:24:48.598869] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T18:24:48.796736] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-09T18:24:49.596719] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-09T18:24:49.928994] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:24:49.931068] [INFO ] [REMOTE ] DFIN: Full fetch complete (33347 records). [2025-10-09T18:24:49.931158] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-09T18:24:49.931713] [FATAL] [VALIDATOR ] DFIN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:24:49.931813] [FATAL] [MAIN ] DFIN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:24:49.931889] [WARN ] [MAIN ] DFIN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:24:49.931987] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-09T18:24:49.932066] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-09T18:24:49.932121] [INFO ] [LOCAL ] DFIN: Starting deletion of derivative data. [2025-10-09T18:24:49.932362] [DEBUG] [LOCAL ] DFIN: Deleted derivative data file. [2025-10-09T18:24:49.932454] [INFO ] [MAIN ] Update Progress: 610/2373 symbols completed. DFIN took 24.4s. Estimated remaining: 4h 5m 0s. Rate: 7.2 symbols/min [2025-10-09T18:24:50.112133] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:50.124138] [DEBUG] [LOCAL ] DFP: Loaded 11313 existing records from primary storage. [2025-10-09T18:24:50.124369] [INFO ] [MAIN ] DFP: Loaded 11313 existing records. [2025-10-09T18:24:50.299422] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:24:50.299629] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-09T18:24:50.299711] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-09T18:24:50.300244] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-09T18:24:50.300303] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-09T18:24:50.398795] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-09T18:24:50.690961] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:51.196807] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-09T18:24:51.372678] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T18:24:51.377029] [INFO ] [REMOTE ] DEO: Full fetch complete (71521 records). [2025-10-09T18:24:51.377141] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-09T18:24:51.686598] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T18:24:51.715552] [INFO ] [REMOTE ] DFH: Full fetch complete (47961 records). [2025-10-09T18:24:51.738982] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-09T18:24:51.766035] [FATAL] [VALIDATOR ] DFH: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:24:51.787236] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-09T18:24:51.787348] [FATAL] [MAIN ] DFH: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:24:51.787511] [WARN ] [MAIN ] DFH: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:24:51.787453] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-09T18:24:51.787631] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-09T18:24:51.788527] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-09T18:24:51.788604] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-09T18:24:51.788862] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-09T18:24:51.788917] [INFO ] [LOCAL ] DFH: Starting deletion of derivative data. [2025-10-09T18:24:51.789085] [DEBUG] [LOCAL ] DFH: Deleted derivative data file. [2025-10-09T18:24:51.789697] [INFO ] [MAIN ] Update Progress: 611/2373 symbols completed. DFH took 28.2s. Estimated remaining: 4h 4m 33s. Rate: 7.2 symbols/min [2025-10-09T18:24:51.885461] [DEBUG] [LOCAL ] DEO: Trimmed 71521 records to 49498 (keeping 200 days of data) [2025-10-09T18:24:51.997277] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-09T18:24:52.058351] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:52.059179] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-10-09T18:24:52.062630] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-10-09T18:24:52.066988] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-09T18:24:52.067902] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-09T18:24:52.072764] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-10-09T18:24:52.075179] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-09T18:24:52.571460] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:52.671247] [DEBUG] [LOCAL ] DEO: Primary data saved (49498 records). [2025-10-09T18:24:52.671398] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-09T18:24:52.671536] [INFO ] [MAIN ] Update Progress: 612/2373 symbols completed. DEO took 43.6s. Estimated remaining: 4h 4m 4s. Rate: 7.2 symbols/min [2025-10-09T18:24:52.799982] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-09T18:24:52.852110] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:24:52.861598] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T18:24:52.909065] [DEBUG] [LOCAL ] DGX: Loaded 44756 existing records from primary storage. [2025-10-09T18:24:52.909357] [INFO ] [MAIN ] DGX: Loaded 44756 existing records. [2025-10-09T18:24:53.094820] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:24:53.095087] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-09T18:24:53.095205] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-09T18:24:53.095616] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-09T18:24:53.095901] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-09T18:24:53.521301] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:24:53.523384] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-09T18:24:53.596796] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-09T18:24:54.345946] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T18:24:54.396739] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-09T18:24:54.862200] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-09T18:24:55.196729] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-09T18:24:55.656869] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T18:24:55.843492] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T18:24:55.996692] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-09T18:24:56.796747] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-09T18:24:57.589373] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T18:24:57.600763] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-09T18:24:57.613329] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T18:24:58.396735] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-09T18:24:59.175410] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T18:24:59.196756] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-09T18:24:59.996709] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-09T18:25:00.522036] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-09T18:25:00.527163] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-09T18:25:00.527467] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-09T18:25:00.605814] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T18:25:00.805082] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-09T18:25:00.958392] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-09T18:25:00.958485] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-09T18:25:00.959452] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-09T18:25:00.959524] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-09T18:25:00.961050] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54126 (keeping 200 days of data) [2025-10-09T18:25:01.218746] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-09T18:25:01.379072] [DEBUG] [LOCAL ] DELL: Primary data saved (54126 records). [2025-10-09T18:25:01.379231] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-09T18:25:01.380313] [INFO ] [MAIN ] Update Progress: 613/2373 symbols completed. DELL took 54.6s. Estimated remaining: 4h 3m 57s. Rate: 7.2 symbols/min [2025-10-09T18:25:01.549084] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:01.549243] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-09T18:25:01.549279] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-09T18:25:01.549389] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-09T18:25:01.549430] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-09T18:25:01.549471] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-09T18:25:01.549506] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-09T18:25:01.602740] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-09T18:25:01.908141] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:02.327352] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T18:25:02.396726] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-09T18:25:02.790009] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-09T18:25:03.138281] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T18:25:03.196717] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-09T18:25:03.996704] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-09T18:25:04.034415] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T18:25:04.796719] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-09T18:25:05.248678] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T18:25:05.596706] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-09T18:25:06.396732] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-09T18:25:06.608728] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:25:06.642398] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T18:25:07.196734] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-09T18:25:07.996788] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-09T18:25:08.530117] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-09T18:25:08.717862] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:25:08.796687] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-09T18:25:08.981621] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T18:25:09.596741] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-09T18:25:10.396718] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-09T18:25:10.647218] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T18:25:10.681748] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T18:25:11.196739] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-09T18:25:11.996751] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-09T18:25:12.110823] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T18:25:12.675180] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T18:25:12.677149] [INFO ] [REMOTE ] DFP: Full fetch complete (15933 records). [2025-10-09T18:25:12.677440] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-09T18:25:12.801952] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-09T18:25:13.060294] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-09T18:25:13.060403] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-09T18:25:13.060986] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-09T18:25:13.061069] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-09T18:25:13.062008] [DEBUG] [LOCAL ] DFP: Trimmed 15933 records to 11365 (keeping 200 days of data) [2025-10-09T18:25:13.132377] [DEBUG] [LOCAL ] DFP: Primary data saved (11365 records). [2025-10-09T18:25:13.132695] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-09T18:25:13.132987] [INFO ] [MAIN ] Update Progress: 614/2373 symbols completed. DFP took 23.2s. Estimated remaining: 4h 3m 58s. Rate: 7.2 symbols/min [2025-10-09T18:25:13.336707] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-09T18:25:13.334990] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:13.412553] [DEBUG] [LOCAL ] DHI: Loaded 53342 existing records from primary storage. [2025-10-09T18:25:13.412911] [INFO ] [MAIN ] DHI: Loaded 53342 existing records. [2025-10-09T18:25:13.587570] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:13.587805] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-09T18:25:13.587888] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-09T18:25:13.588147] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-09T18:25:13.588220] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-09T18:25:13.601893] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-09T18:25:13.944937] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:14.125114] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T18:25:14.396691] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-09T18:25:14.739864] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T18:25:15.196731] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-09T18:25:16.004553] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-09T18:25:16.009953] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T18:25:16.211022] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T18:25:16.796732] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-09T18:25:17.596727] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-09T18:25:17.890023] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T18:25:18.396683] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-09T18:25:18.517843] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T18:25:18.726368] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T18:25:19.196742] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-09T18:25:20.006586] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-09T18:25:20.031038] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:25:20.796702] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-09T18:25:20.889440] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T18:25:21.051787] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T18:25:21.596780] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-09T18:25:22.396733] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-09T18:25:22.617581] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:25:22.861404] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T18:25:23.111569] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T18:25:23.196732] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-09T18:25:23.935155] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T18:25:23.996710] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-09T18:25:24.796811] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-09T18:25:25.096428] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T18:25:25.596722] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-09T18:25:26.396721] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-09T18:25:26.777368] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-09T18:25:27.154345] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T18:25:27.196738] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-09T18:25:27.570368] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:25:27.996713] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-09T18:25:28.796711] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-09T18:25:29.214880] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T18:25:29.596703] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-09T18:25:29.692496] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T18:25:30.041205] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:25:30.045443] [INFO ] [REMOTE ] DGX: Full fetch complete (64815 records). [2025-10-09T18:25:30.045555] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-09T18:25:30.046509] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:25:30.046607] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:25:30.046705] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:25:30.046778] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-09T18:25:30.046871] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-09T18:25:30.046935] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-10-09T18:25:30.047156] [DEBUG] [LOCAL ] DGX: Deleted derivative data file. [2025-10-09T18:25:30.047277] [INFO ] [MAIN ] Update Progress: 615/2373 symbols completed. DGX took 37.4s. Estimated remaining: 4h 4m 14s. Rate: 7.2 symbols/min [2025-10-09T18:25:30.248391] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:30.310144] [DEBUG] [LOCAL ] DHR: Loaded 53383 existing records from primary storage. [2025-10-09T18:25:30.310551] [INFO ] [MAIN ] DHR: Loaded 53383 existing records. [2025-10-09T18:25:30.401845] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-09T18:25:30.516153] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:30.516384] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-09T18:25:30.516435] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-09T18:25:30.516724] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-09T18:25:30.516785] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-09T18:25:30.888226] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:31.196720] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-09T18:25:31.684433] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-09T18:25:31.996695] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-09T18:25:32.273578] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:25:32.797866] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-09T18:25:32.801010] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T18:25:33.070847] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T18:25:33.073308] [INFO ] [REMOTE ] DHF: Full fetch complete (30092 records). [2025-10-09T18:25:33.073382] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-09T18:25:33.440847] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-09T18:25:33.440950] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-09T18:25:33.441468] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-09T18:25:33.441509] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-09T18:25:33.442391] [DEBUG] [LOCAL ] DHF: Trimmed 30092 records to 21395 (keeping 200 days of data) [2025-10-09T18:25:33.577750] [DEBUG] [LOCAL ] DHF: Primary data saved (21395 records). [2025-10-09T18:25:33.578020] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-09T18:25:33.578122] [INFO ] [MAIN ] Update Progress: 616/2373 symbols completed. DHF took 32.2s. Estimated remaining: 4h 3m 52s. Rate: 7.2 symbols/min [2025-10-09T18:25:33.607030] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-09T18:25:33.751582] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:33.813566] [DEBUG] [LOCAL ] DHT: Loaded 47880 existing records from primary storage. [2025-10-09T18:25:33.814014] [INFO ] [MAIN ] DHT: Loaded 47880 existing records. [2025-10-09T18:25:34.076936] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:34.077208] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-09T18:25:34.077267] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-09T18:25:34.077593] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-09T18:25:34.077696] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-09T18:25:34.404802] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-09T18:25:34.549788] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:25:34.591733] [INFO ] [REMOTE ] DG: Full fetch complete (77207 records). [2025-10-09T18:25:34.607699] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-09T18:25:34.693565] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:35.104420] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-09T18:25:35.104709] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-09T18:25:35.105790] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-09T18:25:35.105880] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-09T18:25:35.107721] [DEBUG] [LOCAL ] DG: Trimmed 77207 records to 53670 (keeping 200 days of data) [2025-10-09T18:25:35.203895] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-09T18:25:35.245562] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:25:35.503723] [DEBUG] [LOCAL ] DG: Primary data saved (53670 records). [2025-10-09T18:25:35.503873] [INFO ] [MAIN ] DG: Full history saved. [2025-10-09T18:25:35.503948] [INFO ] [MAIN ] Update Progress: 617/2373 symbols completed. DG took 43.7s. Estimated remaining: 4h 3m 26s. Rate: 7.2 symbols/min [2025-10-09T18:25:35.669469] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:35.683350] [DEBUG] [LOCAL ] DHX: Loaded 12939 existing records from primary storage. [2025-10-09T18:25:35.683537] [INFO ] [MAIN ] DHX: Loaded 12939 existing records. [2025-10-09T18:25:35.857021] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:35.857289] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-09T18:25:35.857339] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-09T18:25:35.857570] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-09T18:25:35.857634] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-09T18:25:36.001778] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-09T18:25:36.219518] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:36.270003] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T18:25:36.649834] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T18:25:36.796732] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-09T18:25:37.543139] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T18:25:37.596704] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-09T18:25:37.842057] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T18:25:38.396738] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-09T18:25:39.196684] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-09T18:25:39.661463] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-09T18:25:39.825191] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T18:25:39.849982] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T18:25:39.996700] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-09T18:25:40.796772] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-09T18:25:41.351357] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T18:25:41.596716] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-09T18:25:42.404346] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-09T18:25:42.410729] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T18:25:42.443480] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T18:25:43.196774] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-09T18:25:43.989277] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T18:25:43.996668] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-09T18:25:44.602782] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T18:25:44.796683] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-09T18:25:44.955522] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T18:25:45.596755] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-09T18:25:46.396746] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-09T18:25:46.440069] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T18:25:46.696341] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T18:25:47.196732] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-09T18:25:47.933739] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T18:25:47.996707] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-09T18:25:48.796727] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-09T18:25:49.431588] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-09T18:25:49.558196] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T18:25:49.596668] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-09T18:25:49.651665] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T18:25:50.208758] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T18:25:50.396717] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-09T18:25:51.186382] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T18:25:51.196669] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-09T18:25:51.996715] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-09T18:25:52.796748] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-09T18:25:53.185843] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-09T18:25:53.596753] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-09T18:25:53.738846] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T18:25:54.396691] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-09T18:25:54.510043] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T18:25:54.514840] [INFO ] [REMOTE ] DHI: Full fetch complete (76817 records). [2025-10-09T18:25:54.514996] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-09T18:25:54.516116] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:25:54.516217] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:25:54.516285] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:25:54.516369] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-09T18:25:54.516470] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-09T18:25:54.516530] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-09T18:25:54.516787] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-09T18:25:54.516922] [INFO ] [MAIN ] Update Progress: 618/2373 symbols completed. DHI took 41.4s. Estimated remaining: 4h 3m 48s. Rate: 7.2 symbols/min [2025-10-09T18:25:54.704581] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:54.720314] [DEBUG] [LOCAL ] DIAX: Loaded 13144 existing records from primary storage. [2025-10-09T18:25:54.720541] [INFO ] [MAIN ] DIAX: Loaded 13144 existing records. [2025-10-09T18:25:54.894293] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:54.894574] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-09T18:25:54.894630] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-09T18:25:54.894966] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-09T18:25:54.895024] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-09T18:25:55.209538] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-09T18:25:55.249612] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:55.385408] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T18:25:55.786028] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T18:25:55.996716] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-09T18:25:56.203520] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T18:25:56.796714] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-09T18:25:57.422917] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T18:25:57.424596] [INFO ] [REMOTE ] DHX: Full fetch complete (20833 records). [2025-10-09T18:25:57.424722] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-09T18:25:57.598528] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-09T18:25:57.807301] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T18:25:57.844111] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-09T18:25:57.844210] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-09T18:25:57.844880] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-09T18:25:57.844964] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-09T18:25:57.846181] [DEBUG] [LOCAL ] DHX: Trimmed 20833 records to 13158 (keeping 200 days of data) [2025-10-09T18:25:57.919315] [DEBUG] [LOCAL ] DHX: Primary data saved (13158 records). [2025-10-09T18:25:57.919463] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-09T18:25:57.919574] [INFO ] [MAIN ] Update Progress: 619/2373 symbols completed. DHX took 22.4s. Estimated remaining: 4h 3m 25s. Rate: 7.2 symbols/min [2025-10-09T18:25:58.090985] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:25:58.126978] [DEBUG] [LOCAL ] DIN: Loaded 37280 existing records from primary storage. [2025-10-09T18:25:58.127352] [INFO ] [MAIN ] DIN: Loaded 37280 existing records. [2025-10-09T18:25:58.336549] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:25:58.336911] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-09T18:25:58.336964] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-09T18:25:58.338056] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-09T18:25:58.338117] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-09T18:25:58.406336] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-09T18:25:58.639032] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T18:25:58.702519] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:25:59.196791] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-09T18:25:59.711854] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-09T18:25:59.744826] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T18:25:59.996726] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-09T18:26:00.792430] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T18:26:00.796667] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-09T18:26:01.299076] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-09T18:26:01.596755] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-09T18:26:02.396753] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-09T18:26:03.076251] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-09T18:26:03.196692] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-09T18:26:03.237471] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T18:26:03.926764] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T18:26:03.996723] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-09T18:26:04.783070] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T18:26:04.796667] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-09T18:26:05.508147] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T18:26:05.596692] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-09T18:26:06.396728] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-09T18:26:07.196751] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-09T18:26:07.210430] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T18:26:07.215001] [INFO ] [REMOTE ] DHT: Full fetch complete (69929 records). [2025-10-09T18:26:07.215105] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-09T18:26:07.622563] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-09T18:26:07.622701] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-09T18:26:07.623695] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-09T18:26:07.623766] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-09T18:26:07.625302] [DEBUG] [LOCAL ] DHT: Trimmed 69929 records to 48239 (keeping 200 days of data) [2025-10-09T18:26:07.862848] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-09T18:26:07.941262] [DEBUG] [LOCAL ] DHT: Primary data saved (48239 records). [2025-10-09T18:26:07.941406] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-09T18:26:07.942251] [INFO ] [MAIN ] Update Progress: 620/2373 symbols completed. DHT took 34.4s. Estimated remaining: 4h 3m 22s. Rate: 7.2 symbols/min [2025-10-09T18:26:08.006521] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-09T18:26:08.129095] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:08.163130] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:26:08.228346] [DEBUG] [LOCAL ] DINO: Loaded 52894 existing records from primary storage. [2025-10-09T18:26:08.228692] [INFO ] [MAIN ] DINO: Loaded 52894 existing records. [2025-10-09T18:26:08.409281] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:26:08.409611] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-09T18:26:08.409689] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-09T18:26:08.411077] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-09T18:26:08.411137] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-09T18:26:08.790973] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:08.796677] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-09T18:26:09.585898] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T18:26:09.596672] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-09T18:26:10.396748] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-09T18:26:10.559610] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T18:26:11.070899] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T18:26:11.196689] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-09T18:26:11.956915] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T18:26:11.996688] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-09T18:26:12.675223] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T18:26:12.796671] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-09T18:26:12.881532] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T18:26:13.596762] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-09T18:26:14.346446] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T18:26:14.396670] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-09T18:26:15.196694] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-09T18:26:15.345449] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T18:26:15.347387] [INFO ] [REMOTE ] DIAX: Full fetch complete (17805 records). [2025-10-09T18:26:15.347500] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-09T18:26:15.693760] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-09T18:26:15.789345] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-09T18:26:15.789429] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-09T18:26:15.789842] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-09T18:26:15.789905] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-09T18:26:15.790554] [DEBUG] [LOCAL ] DIAX: Trimmed 17805 records to 13228 (keeping 200 days of data) [2025-10-09T18:26:15.871019] [DEBUG] [LOCAL ] DIAX: Primary data saved (13228 records). [2025-10-09T18:26:15.871167] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-09T18:26:15.871250] [INFO ] [MAIN ] Update Progress: 621/2373 symbols completed. DIAX took 21.4s. Estimated remaining: 4h 3m 12s. Rate: 7.2 symbols/min [2025-10-09T18:26:16.001851] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-09T18:26:16.063628] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:16.063822] [DEBUG] [LOCAL ] DIS: No existing data file found in primary storage. [2025-10-09T18:26:16.063864] [WARN ] [MAIN ] DIS: No existing data found, performing full refresh instead. [2025-10-09T18:26:16.063991] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-09T18:26:16.064069] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-09T18:26:16.064145] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-09T18:26:16.064186] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-09T18:26:16.495717] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:16.637513] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T18:26:16.796707] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-09T18:26:17.596701] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-09T18:26:17.733313] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T18:26:18.396768] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-09T18:26:19.041345] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T18:26:19.177155] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-09T18:26:19.196666] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-09T18:26:19.996736] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-09T18:26:20.252467] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-09T18:26:20.583618] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:26:20.588584] [INFO ] [REMOTE ] DHR: Full fetch complete (77267 records). [2025-10-09T18:26:20.588730] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-09T18:26:20.803474] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-09T18:26:20.991315] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-09T18:26:20.991455] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-09T18:26:20.992424] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-09T18:26:20.992492] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-09T18:26:20.994390] [DEBUG] [LOCAL ] DHR: Trimmed 77267 records to 53763 (keeping 200 days of data) [2025-10-09T18:26:21.257329] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-09T18:26:21.389138] [DEBUG] [LOCAL ] DHR: Primary data saved (53763 records). [2025-10-09T18:26:21.389288] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-09T18:26:21.390400] [INFO ] [MAIN ] Update Progress: 622/2373 symbols completed. DHR took 51.3s. Estimated remaining: 4h 2m 56s. Rate: 7.2 symbols/min [2025-10-09T18:26:21.582333] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:21.582512] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-09T18:26:21.582552] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-09T18:26:21.582699] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-09T18:26:21.582774] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-09T18:26:21.582819] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-09T18:26:21.582855] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-09T18:26:21.604558] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-09T18:26:21.974248] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:22.152140] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T18:26:22.396745] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-09T18:26:22.860405] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-09T18:26:23.196737] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-09T18:26:23.938906] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-09T18:26:23.996675] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-09T18:26:24.803790] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-09T18:26:24.825998] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T18:26:25.596808] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-09T18:26:26.089615] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-09T18:26:26.179246] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T18:26:26.396767] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-09T18:26:27.008263] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T18:26:27.196759] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-09T18:26:27.524214] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-09T18:26:27.949115] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T18:26:27.996693] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-09T18:26:28.796779] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-09T18:26:29.125595] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T18:26:29.596768] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-09T18:26:30.396699] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-09T18:26:31.066400] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T18:26:31.196675] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-09T18:26:31.390180] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-09T18:26:31.799633] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T18:26:31.803879] [INFO ] [REMOTE ] DIN: Full fetch complete (54959 records). [2025-10-09T18:26:31.804005] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-09T18:26:31.804730] [FATAL] [VALIDATOR ] DIN: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:26:31.804825] [FATAL] [MAIN ] DIN: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:26:31.804875] [WARN ] [MAIN ] DIN: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:26:31.804953] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-09T18:26:31.805026] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-10-09T18:26:31.805068] [INFO ] [LOCAL ] DIN: Starting deletion of derivative data. [2025-10-09T18:26:31.805383] [DEBUG] [LOCAL ] DIN: Deleted derivative data file. [2025-10-09T18:26:31.806008] [INFO ] [MAIN ] Update Progress: 623/2373 symbols completed. DIN took 33.9s. Estimated remaining: 4h 2m 54s. Rate: 7.2 symbols/min [2025-10-09T18:26:31.983623] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:31.996722] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-09T18:26:32.038041] [DEBUG] [LOCAL ] DK: Loaded 49326 existing records from primary storage. [2025-10-09T18:26:32.038447] [INFO ] [MAIN ] DK: Loaded 49326 existing records. [2025-10-09T18:26:32.217830] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:26:32.218045] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-09T18:26:32.218093] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-09T18:26:32.218355] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-09T18:26:32.218412] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-09T18:26:32.396368] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-09T18:26:32.578200] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:32.796755] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-09T18:26:32.947856] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T18:26:33.596797] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-09T18:26:34.018185] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:26:34.396706] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-09T18:26:34.529758] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:26:35.196815] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-09T18:26:35.609888] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-09T18:26:35.996720] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-09T18:26:36.330883] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-09T18:26:36.483736] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-09T18:26:36.796822] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-09T18:26:37.596782] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-09T18:26:38.020159] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T18:26:38.396736] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-09T18:26:39.196744] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-09T18:26:39.782208] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-09T18:26:39.858696] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:26:39.996717] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-09T18:26:40.796769] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-09T18:26:40.968888] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:26:41.083927] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-09T18:26:41.369544] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T18:26:41.596829] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-09T18:26:42.396713] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-09T18:26:42.695064] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-09T18:26:42.949775] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T18:26:43.196754] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-09T18:26:43.555008] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-09T18:26:43.996721] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-09T18:26:44.426545] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T18:26:44.796730] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-09T18:26:45.596720] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-09T18:26:45.992694] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T18:26:45.993352] [INFO ] [REMOTE ] DIVY: Full fetch complete (1705 records). [2025-10-09T18:26:45.993416] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-09T18:26:46.174300] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T18:26:46.174486] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:26:46.174552] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:26:46.174603] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-09T18:26:46.174691] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-09T18:26:46.174751] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-09T18:26:46.174795] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-09T18:26:46.174853] [INFO ] [MAIN ] Update Progress: 624/2373 symbols completed. DIVY took 24.8s. Estimated remaining: 4h 3m 2s. Rate: 7.2 symbols/min [2025-10-09T18:26:46.344333] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:46.366700] [DEBUG] [LOCAL ] DKL: Loaded 17900 existing records from primary storage. [2025-10-09T18:26:46.366961] [INFO ] [MAIN ] DKL: Loaded 17900 existing records. [2025-10-09T18:26:46.400151] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-09T18:26:46.559120] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:26:46.559544] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-09T18:26:46.559607] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-09T18:26:46.559941] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-09T18:26:46.560003] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-09T18:26:46.958913] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-09T18:26:46.964491] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:47.196722] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-09T18:26:47.996689] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-09T18:26:48.327309] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T18:26:48.796685] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-09T18:26:49.010411] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T18:26:49.172404] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T18:26:49.596717] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-09T18:26:50.396707] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-09T18:26:50.483421] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T18:26:51.196691] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-09T18:26:51.322509] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T18:26:51.504005] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:26:51.996735] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-09T18:26:52.468594] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T18:26:52.796690] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-09T18:26:52.902057] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T18:26:53.596718] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-09T18:26:54.396749] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-09T18:26:54.738028] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T18:26:54.778961] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T18:26:55.196785] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-09T18:26:55.756622] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T18:26:55.996723] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-09T18:26:56.796727] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-09T18:26:57.232729] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-09T18:26:57.237561] [INFO ] [REMOTE ] DIS: Full fetch complete (77945 records). [2025-10-09T18:26:57.237760] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-09T18:26:57.477889] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T18:26:57.601771] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-09T18:26:57.699634] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-09T18:26:57.699753] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-09T18:26:57.700700] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-09T18:26:57.700767] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-09T18:26:57.702536] [DEBUG] [LOCAL ] DIS: Trimmed 77945 records to 54178 (keeping 200 days of data) [2025-10-09T18:26:58.063232] [DEBUG] [LOCAL ] DIS: Primary data saved (54178 records). [2025-10-09T18:26:58.063367] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-09T18:26:58.063443] [INFO ] [MAIN ] Update Progress: 625/2373 symbols completed. DIS took 42.2s. Estimated remaining: 4h 3m 4s. Rate: 7.2 symbols/min [2025-10-09T18:26:58.237030] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:58.248151] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T18:26:58.253270] [INFO ] [REMOTE ] DINO: Full fetch complete (76621 records). [2025-10-09T18:26:58.253427] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-09T18:26:58.401598] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-09T18:26:58.603994] [DEBUG] [LOCAL ] DKS: Loaded 49707 existing records from primary storage. [2025-10-09T18:26:58.615286] [INFO ] [MAIN ] DKS: Loaded 49707 existing records. [2025-10-09T18:26:58.810596] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-09T18:26:58.821555] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-09T18:26:58.827622] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-09T18:26:58.832940] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-09T18:26:58.890566] [DEBUG] [LOCAL ] DINO: Trimmed 76621 records to 53271 (keeping 200 days of data) [2025-10-09T18:26:58.896411] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:26:58.896941] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-09T18:26:58.897000] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-09T18:26:58.897419] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-09T18:26:58.897494] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-09T18:26:59.389612] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:26:59.395550] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-09T18:26:59.432034] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T18:26:59.634676] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T18:26:59.683119] [DEBUG] [LOCAL ] DINO: Primary data saved (53271 records). [2025-10-09T18:26:59.683286] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-09T18:26:59.684441] [INFO ] [MAIN ] Update Progress: 626/2373 symbols completed. DINO took 51.7s. Estimated remaining: 4h 2m 37s. Rate: 7.2 symbols/min [2025-10-09T18:26:59.848898] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:26:59.882275] [DEBUG] [LOCAL ] DLB: Loaded 32096 existing records from primary storage. [2025-10-09T18:26:59.882549] [INFO ] [MAIN ] DLB: Loaded 32096 existing records. [2025-10-09T18:27:00.001832] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-09T18:27:00.060474] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:00.060716] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-09T18:27:00.060773] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-09T18:27:00.061042] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-09T18:27:00.061099] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-09T18:27:00.407053] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:00.796781] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-09T18:27:01.304484] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T18:27:01.423725] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T18:27:01.596732] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-09T18:27:02.122240] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-09T18:27:02.396742] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-09T18:27:02.978401] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T18:27:03.196731] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-09T18:27:03.851045] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T18:27:03.855528] [INFO ] [REMOTE ] DK: Full fetch complete (70857 records). [2025-10-09T18:27:03.855701] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-09T18:27:04.006692] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-09T18:27:04.289507] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-09T18:27:04.293819] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-09T18:27:04.295668] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-09T18:27:04.296205] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-09T18:27:04.296070] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T18:27:04.301919] [DEBUG] [LOCAL ] DK: Trimmed 70857 records to 49695 (keeping 200 days of data) [2025-10-09T18:27:04.611753] [DEBUG] [LOCAL ] DK: Primary data saved (49695 records). [2025-10-09T18:27:04.611895] [INFO ] [MAIN ] DK: Full history saved. [2025-10-09T18:27:04.612424] [INFO ] [MAIN ] Update Progress: 627/2373 symbols completed. DK took 32.8s. Estimated remaining: 4h 2m 19s. Rate: 7.2 symbols/min [2025-10-09T18:27:04.813158] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-09T18:27:04.815790] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:04.817034] [DEBUG] [LOCAL ] DLNG: No existing data file found in primary storage. [2025-10-09T18:27:04.817096] [WARN ] [MAIN ] DLNG: No existing data found, performing full refresh instead. [2025-10-09T18:27:04.817210] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-09T18:27:04.817251] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-09T18:27:04.817294] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-09T18:27:04.817326] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-09T18:27:05.190727] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:05.594862] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T18:27:05.604029] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-09T18:27:05.785512] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T18:27:06.396704] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-09T18:27:06.455533] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T18:27:07.196746] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-09T18:27:07.783950] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:27:07.996690] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-09T18:27:08.209209] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:27:08.735975] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T18:27:08.796694] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-09T18:27:09.596725] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-09T18:27:09.644335] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T18:27:10.396769] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-09T18:27:11.196696] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-09T18:27:11.313203] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T18:27:11.314758] [INFO ] [REMOTE ] DKL: Full fetch complete (28007 records). [2025-10-09T18:27:11.314834] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-09T18:27:11.708371] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-09T18:27:11.708558] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-09T18:27:11.709326] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-09T18:27:11.709446] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-09T18:27:11.744956] [DEBUG] [LOCAL ] DKL: Trimmed 28007 records to 18052 (keeping 200 days of data) [2025-10-09T18:27:11.734910] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T18:27:11.753435] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-09T18:27:11.875013] [DEBUG] [LOCAL ] DKL: Primary data saved (18052 records). [2025-10-09T18:27:11.875171] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-09T18:27:11.875285] [INFO ] [MAIN ] Update Progress: 628/2373 symbols completed. DKL took 25.7s. Estimated remaining: 4h 2m 8s. Rate: 7.2 symbols/min [2025-10-09T18:27:12.001799] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-09T18:27:12.053439] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:12.110907] [DEBUG] [LOCAL ] DLR: Loaded 50850 existing records from primary storage. [2025-10-09T18:27:12.111272] [INFO ] [MAIN ] DLR: Loaded 50850 existing records. [2025-10-09T18:27:12.292613] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:12.292865] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-09T18:27:12.292941] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-09T18:27:12.293226] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-09T18:27:12.293293] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-09T18:27:12.669496] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:12.796683] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-09T18:27:12.848841] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T18:27:13.596783] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-09T18:27:14.396693] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-09T18:27:14.431595] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T18:27:15.196753] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-09T18:27:15.498347] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-09T18:27:15.551618] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T18:27:15.996774] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-09T18:27:16.796687] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-09T18:27:16.995627] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T18:27:17.072748] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T18:27:17.596787] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-09T18:27:17.657070] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T18:27:18.396737] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-09T18:27:19.196704] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-09T18:27:19.390156] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T18:27:19.784353] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T18:27:19.928709] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T18:27:19.996712] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-09T18:27:20.796773] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-09T18:27:21.543943] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T18:27:21.596777] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-09T18:27:22.338630] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T18:27:22.396670] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-09T18:27:23.196746] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-09T18:27:23.341396] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:27:23.626757] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-09T18:27:23.996726] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-09T18:27:24.046002] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T18:27:24.796712] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-09T18:27:25.593366] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T18:27:25.597037] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-09T18:27:25.599099] [INFO ] [REMOTE ] DKS: Full fetch complete (71628 records). [2025-10-09T18:27:25.599241] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-09T18:27:25.983568] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-09T18:27:25.983675] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-09T18:27:25.984608] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-09T18:27:25.984690] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-09T18:27:25.986077] [DEBUG] [LOCAL ] DKS: Trimmed 71628 records to 50059 (keeping 200 days of data) [2025-10-09T18:27:26.296526] [DEBUG] [LOCAL ] DKS: Primary data saved (50059 records). [2025-10-09T18:27:26.296701] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-09T18:27:26.296798] [INFO ] [MAIN ] Update Progress: 629/2373 symbols completed. DKS took 28.2s. Estimated remaining: 4h 2m 16s. Rate: 7.2 symbols/min [2025-10-09T18:27:26.399708] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-09T18:27:26.473054] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:26.501687] [DEBUG] [LOCAL ] DLX: Loaded 28454 existing records from primary storage. [2025-10-09T18:27:26.501952] [INFO ] [MAIN ] DLX: Loaded 28454 existing records. [2025-10-09T18:27:26.682576] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:26.682919] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-09T18:27:26.682996] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-09T18:27:26.683299] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-09T18:27:26.683373] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-09T18:27:26.944514] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-09T18:27:27.115220] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:27.118233] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T18:27:27.121407] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:27:27.196665] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-09T18:27:27.667043] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-09T18:27:27.996774] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-09T18:27:28.796765] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-09T18:27:29.288971] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T18:27:29.596754] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-09T18:27:29.765813] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T18:27:30.396742] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-09T18:27:30.464742] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T18:27:31.056055] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-09T18:27:31.196758] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-09T18:27:31.808028] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T18:27:31.808996] [INFO ] [REMOTE ] DLNG: Full fetch complete (11823 records). [2025-10-09T18:27:31.809065] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-09T18:27:31.809439] [FATAL] [VALIDATOR ] DLNG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:27:31.809534] [FATAL] [MAIN ] DLNG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:27:31.809625] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:27:31.809735] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-09T18:27:31.809808] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-10-09T18:27:31.809846] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-10-09T18:27:31.809904] [DEBUG] [LOCAL ] DLNG: No derivative data file found to delete. [2025-10-09T18:27:31.809982] [INFO ] [MAIN ] Update Progress: 630/2373 symbols completed. DLNG took 27.2s. Estimated remaining: 4h 2m 0s. Rate: 7.2 symbols/min [2025-10-09T18:27:31.976673] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:31.998012] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-09T18:27:31.999101] [DEBUG] [LOCAL ] DLY: Loaded 20261 existing records from primary storage. [2025-10-09T18:27:32.000077] [INFO ] [MAIN ] DLY: Loaded 20261 existing records. [2025-10-09T18:27:32.178631] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:32.178889] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-09T18:27:32.178943] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-09T18:27:32.179150] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-09T18:27:32.179206] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-09T18:27:32.534158] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:32.796732] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-09T18:27:33.225476] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:27:33.596687] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-09T18:27:33.633603] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T18:27:34.396732] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-09T18:27:35.082560] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T18:27:35.196703] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-09T18:27:35.304571] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T18:27:35.996747] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-09T18:27:36.436816] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:27:36.796807] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-09T18:27:37.428381] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T18:27:37.563563] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T18:27:37.596672] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-09T18:27:38.396801] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-09T18:27:38.522308] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T18:27:39.196700] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-09T18:27:39.259073] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T18:27:39.996715] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-09T18:27:40.198131] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T18:27:40.796767] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-09T18:27:41.596746] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-09T18:27:41.687128] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T18:27:41.816251] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T18:27:42.396728] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-09T18:27:43.007493] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T18:27:43.196780] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-09T18:27:43.996703] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-09T18:27:44.207312] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T18:27:44.245630] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T18:27:44.796765] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-09T18:27:45.196464] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T18:27:45.596740] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-09T18:27:46.396744] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-09T18:27:46.605705] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T18:27:46.898956] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T18:27:47.106060] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T18:27:47.196738] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-09T18:27:47.996690] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-09T18:27:48.228529] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T18:27:48.796718] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-09T18:27:49.144209] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T18:27:49.596768] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-09T18:27:50.396716] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-09T18:27:50.599233] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T18:27:50.940493] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T18:27:51.196696] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-09T18:27:51.232770] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T18:27:51.996707] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-09T18:27:52.504388] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T18:27:52.796758] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-09T18:27:53.427615] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T18:27:53.431860] [INFO ] [REMOTE ] DLR: Full fetch complete (73994 records). [2025-10-09T18:27:53.431975] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-09T18:27:53.607111] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-09T18:27:53.826230] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-09T18:27:53.826339] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-09T18:27:53.827337] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-09T18:27:53.827406] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-09T18:27:53.828966] [DEBUG] [LOCAL ] DLR: Trimmed 73994 records to 51205 (keeping 200 days of data) [2025-10-09T18:27:54.101623] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T18:27:54.198030] [DEBUG] [LOCAL ] DLR: Primary data saved (51205 records). [2025-10-09T18:27:54.198177] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-09T18:27:54.199384] [INFO ] [MAIN ] Update Progress: 631/2373 symbols completed. DLR took 42.3s. Estimated remaining: 4h 2m 31s. Rate: 7.2 symbols/min [2025-10-09T18:27:54.376052] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:54.384704] [DEBUG] [LOCAL ] DMA: Loaded 4615 existing records from primary storage. [2025-10-09T18:27:54.384992] [INFO ] [MAIN ] DMA: Loaded 4615 existing records. [2025-10-09T18:27:54.405479] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-09T18:27:54.563372] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:54.563570] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-09T18:27:54.563617] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-09T18:27:54.563819] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-09T18:27:54.563876] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-09T18:27:54.903316] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T18:27:54.947104] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:55.196716] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-09T18:27:55.373022] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-09T18:27:55.996757] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-09T18:27:56.277780] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:27:56.280437] [INFO ] [REMOTE ] DLY: Full fetch complete (28336 records). [2025-10-09T18:27:56.280526] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-09T18:27:56.651704] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-09T18:27:56.651826] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-09T18:27:56.652349] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-09T18:27:56.652388] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-09T18:27:56.653244] [DEBUG] [LOCAL ] DLY: Trimmed 28336 records to 20448 (keeping 200 days of data) [2025-10-09T18:27:56.777969] [DEBUG] [LOCAL ] DLY: Primary data saved (20448 records). [2025-10-09T18:27:56.778112] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-09T18:27:56.778197] [INFO ] [MAIN ] Update Progress: 632/2373 symbols completed. DLY took 25.0s. Estimated remaining: 4h 2m 6s. Rate: 7.2 symbols/min [2025-10-09T18:27:56.801808] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-09T18:27:56.953584] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:56.965405] [DEBUG] [LOCAL ] DMB: Loaded 10262 existing records from primary storage. [2025-10-09T18:27:56.965824] [INFO ] [MAIN ] DMB: Loaded 10262 existing records. [2025-10-09T18:27:57.106690] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T18:27:57.151273] [INFO ] [REMOTE ] DLX: Full fetch complete (41228 records). [2025-10-09T18:27:57.175919] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-09T18:27:57.175782] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:57.176325] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-09T18:27:57.176767] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-09T18:27:57.177120] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-09T18:27:57.177182] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-09T18:27:57.628008] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-09T18:27:57.970762] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:57.988728] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-09T18:27:57.988860] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-09T18:27:57.989573] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-09T18:27:57.989668] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-09T18:27:57.990757] [DEBUG] [LOCAL ] DLX: Trimmed 41228 records to 28604 (keeping 200 days of data) [2025-10-09T18:27:58.104480] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T18:27:58.109526] [INFO ] [REMOTE ] DLB: Full fetch complete (47101 records). [2025-10-09T18:27:58.112190] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-09T18:27:58.402405] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-09T18:27:58.494924] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T18:27:58.502031] [DEBUG] [LOCAL ] DLX: Primary data saved (28604 records). [2025-10-09T18:27:58.514166] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-09T18:27:58.514283] [INFO ] [MAIN ] Update Progress: 633/2373 symbols completed. DLX took 32.2s. Estimated remaining: 4h 1m 40s. Rate: 7.2 symbols/min [2025-10-09T18:27:58.713811] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-09T18:27:58.719030] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-09T18:27:58.732709] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-09T18:27:58.732788] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-09T18:27:58.764478] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:58.764771] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-10-09T18:27:58.764842] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-10-09T18:27:58.764962] [DEBUG] [LOCAL ] DLB: Trimmed 47101 records to 32314 (keeping 200 days of data) [2025-10-09T18:27:58.765119] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-09T18:27:58.765317] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-09T18:27:58.765692] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-09T18:27:58.765775] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-09T18:27:59.208136] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-09T18:27:59.232218] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:27:59.247177] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-09T18:27:59.346423] [DEBUG] [LOCAL ] DLB: Primary data saved (32314 records). [2025-10-09T18:27:59.346571] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-09T18:27:59.347723] [INFO ] [MAIN ] Update Progress: 634/2373 symbols completed. DLB took 59.7s. Estimated remaining: 4h 1m 11s. Rate: 7.2 symbols/min [2025-10-09T18:27:59.517434] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:27:59.564797] [DEBUG] [LOCAL ] DNA: Loaded 48491 existing records from primary storage. [2025-10-09T18:27:59.565156] [INFO ] [MAIN ] DNA: Loaded 48491 existing records. [2025-10-09T18:27:59.742547] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:27:59.742763] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-09T18:27:59.742812] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-09T18:27:59.743069] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-09T18:27:59.743132] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-09T18:27:59.826057] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T18:28:00.001779] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-09T18:28:00.113724] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:00.611621] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T18:28:00.796750] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-09T18:28:01.358480] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-09T18:28:01.596730] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-09T18:28:02.396735] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-09T18:28:03.200266] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-09T18:28:03.202247] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T18:28:03.284956] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T18:28:03.837671] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T18:28:03.996697] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-09T18:28:04.563425] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-09T18:28:04.796746] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-09T18:28:05.596768] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-09T18:28:06.135783] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T18:28:06.384483] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T18:28:06.396672] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-09T18:28:07.196713] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-09T18:28:07.947534] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T18:28:07.996679] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-09T18:28:08.152826] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T18:28:08.547009] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T18:28:08.796738] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-09T18:28:09.547423] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T18:28:09.596671] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-09T18:28:10.402137] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-09T18:28:10.404961] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T18:28:11.196727] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-09T18:28:11.402147] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T18:28:11.934769] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T18:28:11.996670] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-09T18:28:12.491288] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-09T18:28:12.796728] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-09T18:28:13.540595] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T18:28:13.596733] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-09T18:28:14.396725] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-09T18:28:15.181892] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-09T18:28:15.196733] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-09T18:28:15.259602] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T18:28:15.641838] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T18:28:15.996729] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-09T18:28:16.475234] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T18:28:16.796771] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-09T18:28:17.437786] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T18:28:17.596807] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-09T18:28:18.091628] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T18:28:18.092749] [INFO ] [REMOTE ] DMA: Full fetch complete (6716 records). [2025-10-09T18:28:18.092841] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-09T18:28:18.402010] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-09T18:28:18.492348] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-09T18:28:18.492432] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-09T18:28:18.492631] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-09T18:28:18.492730] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-09T18:28:18.493123] [DEBUG] [LOCAL ] DMA: Trimmed 6716 records to 4708 (keeping 200 days of data) [2025-10-09T18:28:18.523476] [DEBUG] [LOCAL ] DMA: Primary data saved (4708 records). [2025-10-09T18:28:18.523586] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-09T18:28:18.523690] [INFO ] [MAIN ] Update Progress: 635/2373 symbols completed. DMA took 24.3s. Estimated remaining: 4h 1m 32s. Rate: 7.2 symbols/min [2025-10-09T18:28:18.700127] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:18.741744] [DEBUG] [LOCAL ] DNOW: Loaded 43622 existing records from primary storage. [2025-10-09T18:28:18.742088] [INFO ] [MAIN ] DNOW: Loaded 43622 existing records. [2025-10-09T18:28:18.918552] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:18.918794] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-09T18:28:18.918844] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-09T18:28:18.919072] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-09T18:28:18.919130] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-09T18:28:19.202101] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-09T18:28:19.282232] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:19.396481] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T18:28:19.996748] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-09T18:28:20.744960] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T18:28:20.746901] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T18:28:20.759619] [INFO ] [REMOTE ] DMO: Full fetch complete (14506 records). [2025-10-09T18:28:20.760199] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-09T18:28:20.801955] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-09T18:28:21.128796] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-09T18:28:21.128877] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-09T18:28:21.129183] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-09T18:28:21.129222] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-09T18:28:21.129730] [DEBUG] [LOCAL ] DMO: Trimmed 14506 records to 10036 (keeping 200 days of data) [2025-10-09T18:28:21.194152] [DEBUG] [LOCAL ] DMO: Primary data saved (10036 records). [2025-10-09T18:28:21.194309] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-09T18:28:21.194421] [INFO ] [MAIN ] Update Progress: 636/2373 symbols completed. DMO took 22.7s. Estimated remaining: 4h 1m 9s. Rate: 7.2 symbols/min [2025-10-09T18:28:21.366176] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:21.400876] [DEBUG] [LOCAL ] DNP: Loaded 33275 existing records from primary storage. [2025-10-09T18:28:21.401205] [INFO ] [MAIN ] DNP: Loaded 33275 existing records. [2025-10-09T18:28:21.582364] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:21.582632] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-09T18:28:21.582716] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-09T18:28:21.583049] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-09T18:28:21.583108] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-09T18:28:21.603740] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-09T18:28:21.698439] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T18:28:22.009934] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:22.396718] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-09T18:28:23.196754] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-09T18:28:23.448174] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T18:28:23.664722] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T18:28:23.803531] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T18:28:23.996790] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-09T18:28:24.796689] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-09T18:28:24.849217] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T18:28:25.596725] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-09T18:28:25.980753] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:28:26.396732] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-09T18:28:27.173604] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T18:28:27.196671] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-09T18:28:27.653528] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T18:28:27.996734] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-09T18:28:28.801277] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-09T18:28:28.809452] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T18:28:29.528582] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T18:28:29.596836] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-09T18:28:29.976862] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T18:28:30.121597] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-09T18:28:30.396731] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-09T18:28:31.196772] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-09T18:28:31.895156] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:28:31.896105] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-09T18:28:31.996701] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-09T18:28:32.796722] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-09T18:28:33.074106] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T18:28:33.596721] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-09T18:28:34.396770] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-09T18:28:34.623313] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T18:28:34.696124] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T18:28:35.196717] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-09T18:28:35.934128] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T18:28:35.996680] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-09T18:28:36.526151] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T18:28:36.796704] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-09T18:28:37.008027] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T18:28:37.596772] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-09T18:28:38.216002] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T18:28:38.396719] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-09T18:28:39.186631] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T18:28:39.198516] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-09T18:28:39.430697] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T18:28:39.938773] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T18:28:39.996691] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-09T18:28:40.796724] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-09T18:28:41.304431] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:28:41.308159] [INFO ] [REMOTE ] DNOW: Full fetch complete (62890 records). [2025-10-09T18:28:41.308257] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-09T18:28:41.416483] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T18:28:41.604880] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-09T18:28:41.701534] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-09T18:28:41.701858] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-09T18:28:41.702733] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-09T18:28:41.702804] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-09T18:28:41.704101] [DEBUG] [LOCAL ] DNOW: Trimmed 62890 records to 43943 (keeping 200 days of data) [2025-10-09T18:28:41.978990] [DEBUG] [LOCAL ] DNOW: Primary data saved (43943 records). [2025-10-09T18:28:41.979166] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-09T18:28:41.979272] [INFO ] [MAIN ] Update Progress: 637/2373 symbols completed. DNOW took 23.5s. Estimated remaining: 4h 1m 34s. Rate: 7.2 symbols/min [2025-10-09T18:28:42.396806] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-09T18:28:42.793674] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T18:28:42.996931] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-09T18:28:43.196724] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-09T18:28:43.912515] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T18:28:43.913749] [INFO ] [REMOTE ] DMB: Full fetch complete (14798 records). [2025-10-09T18:28:43.913823] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-09T18:28:44.002977] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-09T18:28:44.290722] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-09T18:28:44.290854] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-09T18:28:44.291258] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-09T18:28:44.291299] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-09T18:28:44.291829] [DEBUG] [LOCAL ] DMB: Trimmed 14798 records to 10302 (keeping 200 days of data) [2025-10-09T18:28:44.351774] [DEBUG] [LOCAL ] DMB: Primary data saved (10302 records). [2025-10-09T18:28:44.351895] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-09T18:28:44.351980] [INFO ] [MAIN ] Update Progress: 638/2373 symbols completed. DMB took 47.6s. Estimated remaining: 4h 1m 10s. Rate: 7.2 symbols/min [2025-10-09T18:28:44.796825] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-09T18:28:45.946393] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T18:28:45.965065] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-09T18:28:45.969582] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-09T18:28:45.973140] [INFO ] [REMOTE ] DNA: Full fetch complete (71050 records). [2025-10-09T18:28:45.973253] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-09T18:28:46.402149] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-09T18:28:46.402255] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-09T18:28:46.403279] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-09T18:28:46.403356] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-09T18:28:46.405108] [DEBUG] [LOCAL ] DNA: Trimmed 71050 records to 48858 (keeping 200 days of data) [2025-10-09T18:28:46.727316] [DEBUG] [LOCAL ] DNA: Primary data saved (48858 records). [2025-10-09T18:28:46.727492] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-09T18:28:46.728502] [INFO ] [MAIN ] Update Progress: 639/2373 symbols completed. DNA took 47.4s. Estimated remaining: 4h 0m 45s. Rate: 7.2 symbols/min [2025-10-09T18:28:47.418418] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:28:47.426149] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-09T18:28:48.422168] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T18:28:48.429044] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-09T18:28:49.421974] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T18:28:49.429807] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-09T18:28:50.301241] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T18:28:50.308989] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-09T18:28:51.619831] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T18:28:51.627779] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-09T18:28:52.718709] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T18:28:52.721458] [INFO ] [REMOTE ] DNP: Full fetch complete (48886 records). [2025-10-09T18:28:52.721545] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-09T18:28:53.114330] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-09T18:28:53.114411] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-09T18:28:53.115147] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-09T18:28:53.115212] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-09T18:28:53.116329] [DEBUG] [LOCAL ] DNP: Trimmed 48886 records to 33468 (keeping 200 days of data) [2025-10-09T18:28:53.316325] [DEBUG] [LOCAL ] DNP: Primary data saved (33468 records). [2025-10-09T18:28:53.316456] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-09T18:28:53.316537] [INFO ] [MAIN ] Update Progress: 640/2373 symbols completed. DNP took 32.1s. Estimated remaining: 4h 0m 32s. Rate: 7.2 symbols/min [2025-10-09T18:28:53.912613] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:53.909817] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:54.011948] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:54.063176] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:28:54.182712] [DEBUG] [LOCAL ] DOCS: Loaded 50973 existing records from primary storage. [2025-10-09T18:28:54.184060] [INFO ] [MAIN ] DOCS: Loaded 50973 existing records. [2025-10-09T18:28:54.185254] [DEBUG] [LOCAL ] DOC: Loaded 53548 existing records from primary storage. [2025-10-09T18:28:54.183851] [DEBUG] [LOCAL ] DOLE: Loaded 38840 existing records from primary storage. [2025-10-09T18:28:54.215634] [INFO ] [MAIN ] DOC: Loaded 53548 existing records. [2025-10-09T18:28:54.261749] [INFO ] [MAIN ] DOLE: Loaded 38840 existing records. [2025-10-09T18:28:54.440893] [DEBUG] [LOCAL ] DOCN: Loaded 50781 existing records from primary storage. [2025-10-09T18:28:54.516023] [INFO ] [MAIN ] DOCN: Loaded 50781 existing records. [2025-10-09T18:28:54.640230] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:54.640949] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-09T18:28:54.706199] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-09T18:28:54.770501] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:54.791406] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-09T18:28:54.796800] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-09T18:28:54.881401] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-09T18:28:54.891024] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:54.891125] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-09T18:28:54.965731] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-09T18:28:55.012708] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-09T18:28:55.012808] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-09T18:28:55.040204] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:28:55.037167] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-09T18:28:55.058704] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-09T18:28:55.069293] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-09T18:28:55.079771] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-09T18:28:55.090210] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-09T18:28:55.099312] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-09T18:28:55.099252] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-09T18:28:56.207405] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:56.297974] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-09T18:28:56.353905] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:56.389357] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-09T18:28:56.402953] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:56.415029] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-09T18:28:56.479349] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:28:56.479619] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-09T18:28:57.542514] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T18:28:57.549533] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-09T18:28:57.600049] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T18:28:57.608981] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-09T18:28:57.773149] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T18:28:57.784124] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-09T18:28:57.844938] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T18:28:57.855366] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-09T18:28:58.556783] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T18:28:58.564263] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-09T18:28:59.025714] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:28:59.035359] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-09T18:28:59.130049] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T18:28:59.140259] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-09T18:28:59.186165] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T18:28:59.196663] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-09T18:28:59.798011] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T18:28:59.996786] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-09T18:29:00.437029] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:29:00.548551] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T18:29:00.796702] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-09T18:29:00.925670] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T18:29:01.596741] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-09T18:29:01.700842] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T18:29:02.394109] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-09T18:29:02.403558] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-09T18:29:02.864162] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T18:29:03.196715] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-09T18:29:03.551186] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T18:29:03.996721] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-09T18:29:04.640306] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T18:29:04.796708] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-09T18:29:05.321331] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:29:05.596729] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-09T18:29:06.396727] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-09T18:29:06.684068] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T18:29:07.196712] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-09T18:29:07.369805] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T18:29:07.996789] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-09T18:29:08.046489] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T18:29:08.699937] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:29:08.796688] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-09T18:29:09.596736] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-09T18:29:09.837130] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T18:29:10.306235] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T18:29:10.396700] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-09T18:29:10.644355] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T18:29:11.196787] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-09T18:29:11.996706] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-09T18:29:12.221293] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T18:29:12.309869] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T18:29:12.796717] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-09T18:29:13.596686] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-09T18:29:13.772435] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T18:29:14.396695] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-09T18:29:14.731039] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T18:29:15.196766] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-09T18:29:15.368250] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T18:29:15.931899] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T18:29:15.996683] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-09T18:29:16.307894] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:29:16.796775] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-09T18:29:17.596692] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-09T18:29:18.052151] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T18:29:18.396767] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-09T18:29:18.666626] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T18:29:18.768411] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:29:19.196746] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-09T18:29:19.924928] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T18:29:19.996690] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-09T18:29:20.730458] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T18:29:20.796701] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-09T18:29:21.596864] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-09T18:29:21.826608] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T18:29:22.396710] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-09T18:29:22.691753] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-09T18:29:22.696160] [INFO ] [REMOTE ] DOCN: Full fetch complete (72080 records). [2025-10-09T18:29:22.696264] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-09T18:29:23.089244] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-09T18:29:23.089418] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-09T18:29:23.090376] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-09T18:29:23.090441] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-09T18:29:23.091999] [DEBUG] [LOCAL ] DOCN: Trimmed 72080 records to 51170 (keeping 200 days of data) [2025-10-09T18:29:23.197402] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-09T18:29:23.333117] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:29:23.439086] [DEBUG] [LOCAL ] DOCN: Primary data saved (51170 records). [2025-10-09T18:29:23.439222] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-09T18:29:23.439305] [INFO ] [MAIN ] Update Progress: 641/2373 symbols completed. DOCN took 30.0s. Estimated remaining: 4h 1m 23s. Rate: 7.2 symbols/min [2025-10-09T18:29:23.607265] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:23.638689] [DEBUG] [LOCAL ] DOUG: Loaded 34415 existing records from primary storage. [2025-10-09T18:29:23.638983] [INFO ] [MAIN ] DOUG: Loaded 34415 existing records. [2025-10-09T18:29:23.748892] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T18:29:23.778759] [INFO ] [REMOTE ] DOLE: Full fetch complete (54405 records). [2025-10-09T18:29:23.801393] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-09T18:29:23.831724] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:23.832113] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-09T18:29:23.832172] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-09T18:29:23.863758] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-09T18:29:23.907704] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-09T18:29:23.997444] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-09T18:29:24.572140] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:24.608373] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-09T18:29:24.608517] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-09T18:29:24.609355] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-09T18:29:24.609497] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-09T18:29:24.610859] [DEBUG] [LOCAL ] DOLE: Trimmed 54405 records to 39185 (keeping 200 days of data) [2025-10-09T18:29:24.718935] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T18:29:24.725298] [INFO ] [REMOTE ] DOC: Full fetch complete (77386 records). [2025-10-09T18:29:24.725722] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-09T18:29:24.798915] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-09T18:29:25.162331] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-09T18:29:25.162782] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-09T18:29:25.163780] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-09T18:29:25.164166] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-09T18:29:25.169144] [DEBUG] [LOCAL ] DOC: Trimmed 77386 records to 53937 (keeping 200 days of data) [2025-10-09T18:29:25.483567] [DEBUG] [LOCAL ] DOLE: Primary data saved (39185 records). [2025-10-09T18:29:25.492981] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-09T18:29:25.519754] [INFO ] [MAIN ] Update Progress: 642/2373 symbols completed. DOLE took 32.2s. Estimated remaining: 4h 0m 57s. Rate: 7.2 symbols/min [2025-10-09T18:29:25.711061] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:25.833476] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-09T18:29:25.862947] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-09T18:29:25.867620] [DEBUG] [LOCAL ] DOC: Primary data saved (53937 records). [2025-10-09T18:29:25.878967] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-09T18:29:25.879085] [INFO ] [MAIN ] Update Progress: 643/2373 symbols completed. DOC took 32.6s. Estimated remaining: 4h 0m 27s. Rate: 7.2 symbols/min [2025-10-09T18:29:26.026613] [DEBUG] [LOCAL ] DOV: Loaded 45490 existing records from primary storage. [2025-10-09T18:29:26.052603] [INFO ] [MAIN ] DOV: Loaded 45490 existing records. [2025-10-09T18:29:26.079525] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:26.266227] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:26.267072] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-09T18:29:26.267278] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-09T18:29:26.267681] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-09T18:29:26.267831] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-09T18:29:26.390080] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T18:29:26.418259] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-09T18:29:26.499325] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-09T18:29:26.515221] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-09T18:29:26.861747] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:26.869559] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-09T18:29:26.869702] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-09T18:29:26.884499] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-09T18:29:26.886403] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-09T18:29:26.889866] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:27.201840] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-09T18:29:27.262039] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:27.367916] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T18:29:27.372563] [INFO ] [REMOTE ] DOCS: Full fetch complete (74100 records). [2025-10-09T18:29:27.372729] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-09T18:29:27.501734] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T18:29:27.805553] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-09T18:29:27.805663] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-09T18:29:27.806670] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-09T18:29:27.806739] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-09T18:29:27.808295] [DEBUG] [LOCAL ] DOCS: Trimmed 74100 records to 51323 (keeping 200 days of data) [2025-10-09T18:29:28.017991] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-09T18:29:28.130112] [DEBUG] [LOCAL ] DOCS: Primary data saved (51323 records). [2025-10-09T18:29:28.130273] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-09T18:29:28.131853] [INFO ] [MAIN ] Update Progress: 644/2373 symbols completed. DOCS took 34.8s. Estimated remaining: 4h 0m 3s. Rate: 7.2 symbols/min [2025-10-09T18:29:28.305138] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:28.321699] [DEBUG] [LOCAL ] DPG: Loaded 13460 existing records from primary storage. [2025-10-09T18:29:28.321936] [INFO ] [MAIN ] DPG: Loaded 13460 existing records. [2025-10-09T18:29:28.505430] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:28.505823] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-09T18:29:28.505887] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-09T18:29:28.506083] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-09T18:29:28.506140] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-09T18:29:28.802378] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-09T18:29:28.878747] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:28.902871] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T18:29:29.136377] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:29:29.596786] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-09T18:29:30.396722] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-09T18:29:30.592049] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T18:29:30.838899] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T18:29:31.196739] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-09T18:29:31.829576] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T18:29:31.869234] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T18:29:31.996709] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-09T18:29:32.796750] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-09T18:29:33.337148] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T18:29:33.351491] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T18:29:33.596770] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-09T18:29:34.332627] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T18:29:34.396712] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-09T18:29:35.097053] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T18:29:35.196734] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-09T18:29:35.996727] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-09T18:29:36.796700] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-09T18:29:36.889515] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T18:29:37.551154] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T18:29:37.589059] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T18:29:37.596666] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-09T18:29:38.396720] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-09T18:29:38.465331] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T18:29:39.196811] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-09T18:29:39.588976] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T18:29:39.996725] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-09T18:29:40.237342] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:29:40.796717] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-09T18:29:41.596698] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-09T18:29:41.742850] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:29:41.808010] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T18:29:42.215518] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T18:29:42.396697] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-09T18:29:43.093070] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T18:29:43.196771] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-09T18:29:43.996700] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-09T18:29:44.024248] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-09T18:29:44.796739] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-09T18:29:45.596716] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-09T18:29:45.910427] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:29:45.970733] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-09T18:29:46.396715] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-09T18:29:47.137750] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T18:29:47.196721] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-09T18:29:47.484838] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T18:29:47.946016] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T18:29:47.947865] [INFO ] [REMOTE ] DPG: Full fetch complete (18924 records). [2025-10-09T18:29:47.947996] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-09T18:29:48.005117] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-09T18:29:48.341746] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-09T18:29:48.341828] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-09T18:29:48.342247] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-09T18:29:48.342309] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-09T18:29:48.343122] [DEBUG] [LOCAL ] DPG: Trimmed 18924 records to 13621 (keeping 200 days of data) [2025-10-09T18:29:48.429188] [DEBUG] [LOCAL ] DPG: Primary data saved (13621 records). [2025-10-09T18:29:48.429351] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-09T18:29:48.429465] [INFO ] [MAIN ] Update Progress: 645/2373 symbols completed. DPG took 20.3s. Estimated remaining: 4h 0m 26s. Rate: 7.2 symbols/min [2025-10-09T18:29:48.595965] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:48.638934] [DEBUG] [LOCAL ] DQ: Loaded 43500 existing records from primary storage. [2025-10-09T18:29:48.639222] [INFO ] [MAIN ] DQ: Loaded 43500 existing records. [2025-10-09T18:29:48.808825] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-09T18:29:48.813597] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:48.814835] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-09T18:29:48.814937] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-09T18:29:48.815240] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-09T18:29:48.815299] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-09T18:29:49.114907] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T18:29:49.147712] [INFO ] [REMOTE ] DOUG: Full fetch complete (50781 records). [2025-10-09T18:29:49.159696] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-09T18:29:49.191681] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:49.565729] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-09T18:29:49.565814] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-09T18:29:49.566493] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-09T18:29:49.566534] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-09T18:29:49.567573] [DEBUG] [LOCAL ] DOUG: Trimmed 50781 records to 34675 (keeping 200 days of data) [2025-10-09T18:29:49.611487] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-09T18:29:49.763712] [DEBUG] [LOCAL ] DOUG: Primary data saved (34675 records). [2025-10-09T18:29:49.763842] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-09T18:29:49.764358] [INFO ] [MAIN ] Update Progress: 646/2373 symbols completed. DOUG took 26.3s. Estimated remaining: 3h 59m 59s. Rate: 7.2 symbols/min [2025-10-09T18:29:49.937555] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:29:49.975693] [DEBUG] [LOCAL ] DRD: Loaded 37231 existing records from primary storage. [2025-10-09T18:29:49.975976] [INFO ] [MAIN ] DRD: Loaded 37231 existing records. [2025-10-09T18:29:50.153013] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:29:50.153253] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-09T18:29:50.153303] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-09T18:29:50.153682] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-09T18:29:50.153742] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-09T18:29:50.404251] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-09T18:29:50.551731] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:29:50.756189] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-09T18:29:51.196697] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-09T18:29:51.234002] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:29:51.885936] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T18:29:51.996697] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-09T18:29:52.459628] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T18:29:52.796698] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-09T18:29:53.398782] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T18:29:53.596686] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-09T18:29:53.659765] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T18:29:54.396768] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-09T18:29:54.981212] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T18:29:55.196757] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-09T18:29:55.598638] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T18:29:55.996723] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-09T18:29:56.796672] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-09T18:29:57.033484] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T18:29:57.262806] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T18:29:57.596724] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-09T18:29:58.149552] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T18:29:58.396781] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-09T18:29:59.014273] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T18:29:59.196707] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-09T18:29:59.777606] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T18:29:59.996757] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-09T18:30:00.532201] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:30:00.796744] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-09T18:30:01.533840] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T18:30:01.596699] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-09T18:30:01.881450] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T18:30:02.396800] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-09T18:30:02.858877] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T18:30:02.862877] [INFO ] [REMOTE ] DOV: Full fetch complete (65320 records). [2025-10-09T18:30:02.863042] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-09T18:30:03.201813] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-09T18:30:03.269638] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-09T18:30:03.269845] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-09T18:30:03.270693] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-09T18:30:03.270759] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-09T18:30:03.272108] [DEBUG] [LOCAL ] DOV: Trimmed 65320 records to 45846 (keeping 200 days of data) [2025-10-09T18:30:03.563162] [DEBUG] [LOCAL ] DOV: Primary data saved (45846 records). [2025-10-09T18:30:03.563297] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-09T18:30:03.563381] [INFO ] [MAIN ] Update Progress: 647/2373 symbols completed. DOV took 38.0s. Estimated remaining: 4h 0m 6s. Rate: 7.2 symbols/min [2025-10-09T18:30:03.738481] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:03.784838] [DEBUG] [LOCAL ] DRH: Loaded 50450 existing records from primary storage. [2025-10-09T18:30:03.785292] [INFO ] [MAIN ] DRH: Loaded 50450 existing records. [2025-10-09T18:30:03.931546] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T18:30:03.997245] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-09T18:30:04.001020] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:04.002418] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-09T18:30:04.002483] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-09T18:30:04.002780] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-09T18:30:04.002839] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-09T18:30:04.378077] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:04.796720] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-09T18:30:05.309353] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-09T18:30:05.596729] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-09T18:30:05.914344] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T18:30:06.361632] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:30:06.396717] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-09T18:30:07.196683] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-09T18:30:07.367921] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:30:07.715597] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T18:30:07.996727] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-09T18:30:08.578915] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T18:30:08.796758] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-09T18:30:09.392829] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T18:30:09.596734] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-09T18:30:10.396704] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-09T18:30:10.566142] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T18:30:11.196702] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-09T18:30:11.680115] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-09T18:30:11.914964] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:30:11.996669] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-09T18:30:12.796684] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-09T18:30:12.911566] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T18:30:12.915686] [INFO ] [REMOTE ] DQ: Full fetch complete (63224 records). [2025-10-09T18:30:12.915825] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-09T18:30:13.294341] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-09T18:30:13.294429] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-09T18:30:13.295245] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-09T18:30:13.295313] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-09T18:30:13.296603] [DEBUG] [LOCAL ] DQ: Trimmed 63224 records to 43865 (keeping 200 days of data) [2025-10-09T18:30:13.594375] [DEBUG] [LOCAL ] DQ: Primary data saved (43865 records). [2025-10-09T18:30:13.594578] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-09T18:30:13.596014] [INFO ] [MAIN ] Update Progress: 648/2373 symbols completed. DQ took 25.2s. Estimated remaining: 4h 0m 2s. Rate: 7.2 symbols/min [2025-10-09T18:30:13.601495] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-09T18:30:13.849307] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:13.917699] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T18:30:13.998115] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T18:30:14.047449] [DEBUG] [LOCAL ] DRI: Loaded 47675 existing records from primary storage. [2025-10-09T18:30:14.048203] [INFO ] [MAIN ] DRI: Loaded 47675 existing records. [2025-10-09T18:30:14.280149] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:14.280410] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-09T18:30:14.280461] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-09T18:30:14.280874] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-09T18:30:14.280957] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-09T18:30:14.397925] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-09T18:30:14.678132] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:15.196753] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-09T18:30:15.988280] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-09T18:30:15.998933] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-09T18:30:16.067077] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T18:30:16.796703] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-09T18:30:17.002836] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T18:30:17.379494] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T18:30:17.596775] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-09T18:30:18.324010] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T18:30:18.396676] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-09T18:30:19.196769] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-09T18:30:19.789435] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-09T18:30:19.996727] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-09T18:30:20.229418] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T18:30:20.774039] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T18:30:20.796688] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-09T18:30:21.289933] [DEBUG] [REMOTE ] DRI: Error fetching primary data for 2025-01: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-09T18:30:21.290087] [WARN ] [REMOTE ] DRI: No data returned for month 2025-01 [2025-10-09T18:30:21.290159] [FATAL] [REMOTE ] DRI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:30:21.290202] [FATAL] [MAIN ] DRI: Failed to fetch primary data. [2025-10-09T18:30:21.290234] [WARN ] [MAIN ] DRI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:30:21.290272] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-09T18:30:21.290326] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-09T18:30:21.290361] [INFO ] [LOCAL ] DRI: Starting deletion of derivative data. [2025-10-09T18:30:21.290696] [DEBUG] [LOCAL ] DRI: Deleted derivative data file. [2025-10-09T18:30:21.290779] [INFO ] [MAIN ] Update Progress: 649/2373 symbols completed. DRI took 7.7s. Estimated remaining: 3h 59m 52s. Rate: 7.2 symbols/min [2025-10-09T18:30:21.459132] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:21.470849] [DEBUG] [LOCAL ] DRLL: Loaded 9289 existing records from primary storage. [2025-10-09T18:30:21.471102] [INFO ] [MAIN ] DRLL: Loaded 9289 existing records. [2025-10-09T18:30:21.601891] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-09T18:30:21.657103] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:21.657269] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-09T18:30:21.657324] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-09T18:30:21.657513] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-09T18:30:21.657567] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-09T18:30:22.011289] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:22.050442] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T18:30:22.396815] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-09T18:30:22.907893] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T18:30:23.196757] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-09T18:30:23.996730] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-09T18:30:24.225557] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T18:30:24.796688] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-09T18:30:24.899678] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T18:30:25.412286] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T18:30:25.596751] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-09T18:30:26.002028] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T18:30:26.396721] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-09T18:30:27.196717] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-09T18:30:27.537451] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T18:30:27.996710] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-09T18:30:28.322500] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-09T18:30:28.326356] [INFO ] [REMOTE ] DRD: Full fetch complete (50619 records). [2025-10-09T18:30:28.326469] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-09T18:30:28.706584] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T18:30:28.726810] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-09T18:30:28.726870] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-09T18:30:28.727547] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-09T18:30:28.727587] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-09T18:30:28.728619] [DEBUG] [LOCAL ] DRD: Trimmed 50619 records to 37578 (keeping 200 days of data) [2025-10-09T18:30:28.820051] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-09T18:30:28.969686] [DEBUG] [LOCAL ] DRD: Primary data saved (37578 records). [2025-10-09T18:30:28.969849] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-09T18:30:28.970513] [INFO ] [MAIN ] Update Progress: 650/2373 symbols completed. DRD took 39.2s. Estimated remaining: 3h 59m 42s. Rate: 7.2 symbols/min [2025-10-09T18:30:29.140000] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:29.170814] [DEBUG] [LOCAL ] DSL: Loaded 28586 existing records from primary storage. [2025-10-09T18:30:29.171102] [INFO ] [MAIN ] DSL: Loaded 28586 existing records. [2025-10-09T18:30:29.355941] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:29.356246] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-09T18:30:29.356353] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-09T18:30:29.356757] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-09T18:30:29.356818] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-09T18:30:29.528125] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T18:30:29.600976] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-09T18:30:29.604744] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-09T18:30:29.802713] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:30.396739] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-09T18:30:31.144112] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T18:30:31.196674] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-09T18:30:31.333127] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-09T18:30:31.337764] [INFO ] [REMOTE ] DRH: Full fetch complete (71897 records). [2025-10-09T18:30:31.337940] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-09T18:30:31.758202] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-09T18:30:31.758292] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-09T18:30:31.759245] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-09T18:30:31.759312] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-09T18:30:31.760742] [DEBUG] [LOCAL ] DRH: Trimmed 71897 records to 50811 (keeping 200 days of data) [2025-10-09T18:30:31.947582] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T18:30:31.998560] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-09T18:30:32.075125] [DEBUG] [LOCAL ] DRH: Primary data saved (50811 records). [2025-10-09T18:30:32.075263] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-09T18:30:32.075361] [INFO ] [MAIN ] Update Progress: 651/2373 symbols completed. DRH took 28.5s. Estimated remaining: 3h 59m 19s. Rate: 7.2 symbols/min [2025-10-09T18:30:32.242516] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:32.242721] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-10-09T18:30:32.242777] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-10-09T18:30:32.242899] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-09T18:30:32.242945] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-09T18:30:32.242987] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-09T18:30:32.243019] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-09T18:30:32.598061] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:32.796748] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-09T18:30:33.498400] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T18:30:33.596689] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-09T18:30:34.060456] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-09T18:30:34.065081] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-09T18:30:34.065217] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-09T18:30:34.405225] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-09T18:30:34.470120] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-09T18:30:34.470370] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-09T18:30:34.471456] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-09T18:30:34.475107] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-09T18:30:34.479420] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T18:30:34.483398] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 54123 (keeping 200 days of data) [2025-10-09T18:30:34.813441] [DEBUG] [LOCAL ] DOW: Primary data saved (54123 records). [2025-10-09T18:30:34.813581] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-09T18:30:34.813682] [INFO ] [MAIN ] Update Progress: 652/2373 symbols completed. DOW took 1m 9s. Estimated remaining: 3h 58m 56s. Rate: 7.2 symbols/min [2025-10-09T18:30:34.984202] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:34.989407] [DEBUG] [LOCAL ] DSMC: Loaded 1842 existing records from primary storage. [2025-10-09T18:30:34.989594] [INFO ] [MAIN ] DSMC: Loaded 1842 existing records. [2025-10-09T18:30:35.169343] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:35.169623] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-09T18:30:35.169706] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-09T18:30:35.169903] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-09T18:30:35.169961] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-09T18:30:35.201825] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-09T18:30:35.545680] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:35.555943] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T18:30:35.784143] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-09T18:30:35.996746] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-09T18:30:36.796728] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-09T18:30:37.258926] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T18:30:37.596726] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-09T18:30:37.752335] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T18:30:38.396725] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-09T18:30:38.496617] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-09T18:30:38.989415] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:30:39.196780] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-09T18:30:39.678603] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-09T18:30:39.996740] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-09T18:30:40.432205] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-09T18:30:40.796714] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-09T18:30:41.123826] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-09T18:30:41.596755] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-09T18:30:42.396694] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-09T18:30:42.791602] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T18:30:43.196760] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-09T18:30:43.326290] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T18:30:43.996713] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-09T18:30:44.311275] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T18:30:44.335315] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-09T18:30:44.796730] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-09T18:30:45.533456] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:30:45.596707] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-09T18:30:46.396726] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-09T18:30:46.766062] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T18:30:47.196687] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-09T18:30:47.474046] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:30:47.475351] [INFO ] [REMOTE ] DRLL: Full fetch complete (14984 records). [2025-10-09T18:30:47.475456] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-09T18:30:47.851742] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-09T18:30:47.851824] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-09T18:30:47.852145] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-09T18:30:47.852183] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-09T18:30:47.852710] [DEBUG] [LOCAL ] DRLL: Trimmed 14984 records to 9351 (keeping 200 days of data) [2025-10-09T18:30:47.912723] [DEBUG] [LOCAL ] DRLL: Primary data saved (9351 records). [2025-10-09T18:30:47.912862] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-09T18:30:47.912949] [INFO ] [MAIN ] Update Progress: 653/2373 symbols completed. DRLL took 26.6s. Estimated remaining: 3h 59m 0s. Rate: 7.2 symbols/min [2025-10-09T18:30:48.001803] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-09T18:30:48.083168] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:30:48.107200] [DEBUG] [LOCAL ] DSU: Loaded 22858 existing records from primary storage. [2025-10-09T18:30:48.107453] [INFO ] [MAIN ] DSU: Loaded 22858 existing records. [2025-10-09T18:30:48.286430] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:30:48.286738] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-09T18:30:48.286814] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-09T18:30:48.287264] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-09T18:30:48.287332] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-09T18:30:48.483705] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T18:30:48.674220] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:30:48.796678] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-09T18:30:49.151158] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T18:30:49.561799] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T18:30:49.596710] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-09T18:30:50.396744] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-09T18:30:50.676776] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T18:30:50.907898] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T18:30:51.196782] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-09T18:30:51.717368] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T18:30:51.996750] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-09T18:30:52.796760] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-09T18:30:52.836906] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T18:30:53.217488] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-09T18:30:53.596721] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-09T18:30:53.902906] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-09T18:30:54.396740] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-09T18:30:55.125805] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T18:30:55.196675] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-09T18:30:55.992079] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T18:30:55.996673] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-09T18:30:56.628988] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-09T18:30:56.796728] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-09T18:30:57.596694] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-09T18:30:57.705050] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T18:30:58.396715] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-09T18:30:58.607434] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T18:30:58.737665] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-09T18:30:59.196742] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-09T18:30:59.996717] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-09T18:31:00.161995] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:31:00.796737] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-09T18:31:00.904878] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T18:31:00.906393] [INFO ] [REMOTE ] DSM: Full fetch complete (24086 records). [2025-10-09T18:31:00.906465] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-09T18:31:01.275694] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-09T18:31:01.275788] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-09T18:31:01.276268] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-09T18:31:01.276309] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-09T18:31:01.277318] [DEBUG] [LOCAL ] DSM: Trimmed 24086 records to 14667 (keeping 200 days of data) [2025-10-09T18:31:01.342632] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T18:31:01.370601] [DEBUG] [LOCAL ] DSM: Primary data saved (14667 records). [2025-10-09T18:31:01.370800] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-09T18:31:01.370887] [INFO ] [MAIN ] Update Progress: 654/2373 symbols completed. DSM took 29.3s. Estimated remaining: 3h 59m 6s. Rate: 7.2 symbols/min [2025-10-09T18:31:01.552079] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:01.552260] [DEBUG] [LOCAL ] DSX: No existing data file found in primary storage. [2025-10-09T18:31:01.552299] [WARN ] [MAIN ] DSX: No existing data found, performing full refresh instead. [2025-10-09T18:31:01.552438] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-09T18:31:01.552481] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-09T18:31:01.552561] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-09T18:31:01.552610] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-09T18:31:01.602027] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-09T18:31:01.949762] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:02.396693] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-09T18:31:02.571226] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T18:31:02.827135] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T18:31:03.196749] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-09T18:31:03.680471] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T18:31:03.681204] [INFO ] [REMOTE ] DSMC: Full fetch complete (2838 records). [2025-10-09T18:31:03.681322] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-09T18:31:04.001841] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-09T18:31:04.030875] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-09T18:31:04.031691] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-09T18:31:04.031822] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-09T18:31:04.031865] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-09T18:31:04.032210] [DEBUG] [LOCAL ] DSMC: Trimmed 2838 records to 1848 (keeping 200 days of data) [2025-10-09T18:31:04.044298] [DEBUG] [LOCAL ] DSMC: Primary data saved (1848 records). [2025-10-09T18:31:04.044372] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-09T18:31:04.044443] [INFO ] [MAIN ] Update Progress: 655/2373 symbols completed. DSMC took 29.2s. Estimated remaining: 3h 58m 42s. Rate: 7.2 symbols/min [2025-10-09T18:31:04.242274] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:04.296893] [DEBUG] [LOCAL ] DT: Loaded 52944 existing records from primary storage. [2025-10-09T18:31:04.297270] [INFO ] [MAIN ] DT: Loaded 52944 existing records. [2025-10-09T18:31:04.485843] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:04.486108] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-09T18:31:04.486175] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-09T18:31:04.486541] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-09T18:31:04.486621] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-09T18:31:04.804271] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-09T18:31:04.923985] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:05.198072] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T18:31:05.596735] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-09T18:31:05.684965] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T18:31:06.396737] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-09T18:31:07.202760] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-09T18:31:07.216736] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:31:07.747270] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T18:31:07.996734] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-09T18:31:08.238768] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:31:08.796701] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-09T18:31:09.596755] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-09T18:31:09.844765] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-09T18:31:09.934773] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T18:31:10.396717] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-09T18:31:11.111339] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T18:31:11.196724] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-09T18:31:11.707412] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T18:31:11.996719] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-09T18:31:12.367887] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T18:31:12.796731] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-09T18:31:13.248154] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T18:31:13.250943] [INFO ] [REMOTE ] DSL: Full fetch complete (41456 records). [2025-10-09T18:31:13.251063] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-09T18:31:13.602742] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-09T18:31:13.641268] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-09T18:31:13.641336] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-09T18:31:13.642063] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-09T18:31:13.642200] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-09T18:31:13.643560] [DEBUG] [LOCAL ] DSL: Trimmed 41456 records to 28765 (keeping 200 days of data) [2025-10-09T18:31:13.828455] [DEBUG] [LOCAL ] DSL: Primary data saved (28765 records). [2025-10-09T18:31:13.828614] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-09T18:31:13.829254] [INFO ] [MAIN ] Update Progress: 656/2373 symbols completed. DSL took 44.9s. Estimated remaining: 3h 58m 38s. Rate: 7.2 symbols/min [2025-10-09T18:31:14.002628] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:14.014489] [DEBUG] [LOCAL ] DTB: Loaded 5032 existing records from primary storage. [2025-10-09T18:31:14.014741] [INFO ] [MAIN ] DTB: Loaded 5032 existing records. [2025-10-09T18:31:14.194372] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:14.194768] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-09T18:31:14.194841] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-09T18:31:14.195091] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-09T18:31:14.195150] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-09T18:31:14.415305] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-09T18:31:14.639020] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:14.641580] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T18:31:14.708090] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:31:15.196761] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-09T18:31:15.394379] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:31:15.828255] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-09T18:31:15.996754] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-09T18:31:16.470547] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T18:31:16.796766] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-09T18:31:17.596755] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-09T18:31:17.867088] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T18:31:18.396710] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-09T18:31:18.905464] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T18:31:19.196718] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-09T18:31:19.417693] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T18:31:19.562452] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T18:31:19.996733] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-09T18:31:20.796701] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-09T18:31:21.006208] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T18:31:21.008634] [INFO ] [REMOTE ] DSU: Full fetch complete (32917 records). [2025-10-09T18:31:21.008745] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-09T18:31:21.395907] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-09T18:31:21.484219] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-09T18:31:21.484300] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-09T18:31:21.484911] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-09T18:31:21.484974] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-09T18:31:21.485720] [DEBUG] [LOCAL ] DSU: Trimmed 32917 records to 23027 (keeping 200 days of data) [2025-10-09T18:31:21.599040] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-09T18:31:21.650158] [DEBUG] [LOCAL ] DSU: Primary data saved (23027 records). [2025-10-09T18:31:21.650340] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-09T18:31:21.650471] [INFO ] [MAIN ] Update Progress: 657/2373 symbols completed. DSU took 33.7s. Estimated remaining: 3h 58m 28s. Rate: 7.2 symbols/min [2025-10-09T18:31:21.897205] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:21.965269] [DEBUG] [LOCAL ] DTE: Loaded 47531 existing records from primary storage. [2025-10-09T18:31:21.965748] [INFO ] [MAIN ] DTE: Loaded 47531 existing records. [2025-10-09T18:31:22.151755] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-09T18:31:22.268970] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:22.269242] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-09T18:31:22.269300] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-09T18:31:22.269732] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-09T18:31:22.269792] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-09T18:31:22.401869] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-09T18:31:22.811140] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:23.196784] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-09T18:31:23.996722] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-09T18:31:24.201157] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:31:24.424130] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T18:31:24.796735] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-09T18:31:25.601846] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-09T18:31:25.617099] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:31:25.831582] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T18:31:26.396780] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-09T18:31:26.946170] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:31:27.196692] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-09T18:31:27.893289] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T18:31:27.996682] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-09T18:31:28.396579] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T18:31:28.796772] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-09T18:31:29.563794] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T18:31:29.596695] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-09T18:31:30.254899] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-09T18:31:30.396719] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-09T18:31:30.482424] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T18:31:31.064105] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-09T18:31:31.196723] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-09T18:31:31.996734] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-09T18:31:32.796680] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-09T18:31:32.838536] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T18:31:33.012955] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T18:31:33.596712] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-09T18:31:34.396745] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-09T18:31:34.537373] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T18:31:34.958091] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:31:35.196760] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-09T18:31:35.996790] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-09T18:31:36.166622] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T18:31:36.414785] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-09T18:31:36.460618] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T18:31:36.796717] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-09T18:31:37.596800] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-09T18:31:38.396791] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-09T18:31:38.409161] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T18:31:39.196701] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-09T18:31:39.325256] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T18:31:39.579413] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T18:31:39.996731] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-09T18:31:40.632242] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T18:31:40.729446] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T18:31:40.796694] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-09T18:31:41.596705] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-09T18:31:41.681564] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-09T18:31:42.396739] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-09T18:31:43.197036] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-09T18:31:43.412766] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T18:31:43.429127] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T18:31:43.431400] [INFO ] [REMOTE ] DSX: Full fetch complete (36001 records). [2025-10-09T18:31:43.431480] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-09T18:31:43.815574] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-09T18:31:43.815681] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-09T18:31:43.816268] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-09T18:31:43.816329] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-09T18:31:43.817276] [DEBUG] [LOCAL ] DSX: Trimmed 36001 records to 24199 (keeping 200 days of data) [2025-10-09T18:31:43.963543] [DEBUG] [LOCAL ] DSX: Primary data saved (24199 records). [2025-10-09T18:31:43.963741] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-09T18:31:43.963868] [INFO ] [MAIN ] Update Progress: 658/2373 symbols completed. DSX took 42.6s. Estimated remaining: 3h 58m 56s. Rate: 7.2 symbols/min [2025-10-09T18:31:44.001805] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-09T18:31:44.041059] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T18:31:44.153216] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:44.153414] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-09T18:31:44.153458] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-09T18:31:44.153587] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-09T18:31:44.153696] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-09T18:31:44.153791] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-09T18:31:44.153847] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-09T18:31:44.516861] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:44.796703] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-09T18:31:45.222261] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-09T18:31:45.596733] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-09T18:31:45.745049] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:31:45.749515] [INFO ] [REMOTE ] DT: Full fetch complete (76665 records). [2025-10-09T18:31:45.749634] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-09T18:31:46.140688] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-09T18:31:46.140800] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-09T18:31:46.141733] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-09T18:31:46.141798] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-09T18:31:46.143246] [DEBUG] [LOCAL ] DT: Trimmed 76665 records to 53326 (keeping 200 days of data) [2025-10-09T18:31:46.231065] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T18:31:46.233945] [INFO ] [REMOTE ] DTB: Full fetch complete (6830 records). [2025-10-09T18:31:46.234317] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-09T18:31:46.401461] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-09T18:31:46.741200] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-09T18:31:46.747683] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-09T18:31:46.750137] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-09T18:31:46.751100] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-09T18:31:46.759701] [DEBUG] [LOCAL ] DTB: Trimmed 6830 records to 5053 (keeping 200 days of data) [2025-10-09T18:31:46.841179] [DEBUG] [LOCAL ] DTB: Primary data saved (5053 records). [2025-10-09T18:31:46.858843] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-09T18:31:46.859001] [INFO ] [MAIN ] Update Progress: 659/2373 symbols completed. DTB took 33.0s. Estimated remaining: 3h 58m 34s. Rate: 7.2 symbols/min [2025-10-09T18:31:47.030780] [DEBUG] [LOCAL ] DT: Primary data saved (53326 records). [2025-10-09T18:31:47.044333] [INFO ] [MAIN ] DT: Full history saved. [2025-10-09T18:31:47.045381] [INFO ] [MAIN ] Update Progress: 660/2373 symbols completed. DT took 43.0s. Estimated remaining: 3h 58m 4s. Rate: 7.2 symbols/min [2025-10-09T18:31:47.108018] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:47.201444] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-09T18:31:47.233243] [DEBUG] [LOCAL ] DTG: Loaded 5856 existing records from primary storage. [2025-10-09T18:31:47.254000] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:47.254532] [INFO ] [MAIN ] DTG: Loaded 5856 existing records. [2025-10-09T18:31:47.254761] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-09T18:31:47.287551] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-09T18:31:47.327310] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-09T18:31:47.338803] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-09T18:31:47.361442] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-09T18:31:47.361499] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-09T18:31:47.584897] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:47.605907] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-09T18:31:47.622578] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-09T18:31:47.648247] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-09T18:31:47.672435] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-09T18:31:47.743046] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-09T18:31:47.931903] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:48.003283] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-09T18:31:48.211119] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:48.222804] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T18:31:48.233725] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:31:48.233990] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-09T18:31:48.234096] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:31:48.234161] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-09T18:31:48.234222] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:31:48.234294] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-09T18:31:48.234369] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-09T18:31:48.234445] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-09T18:31:48.234535] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-09T18:31:48.234605] [INFO ] [MAIN ] Update Progress: 661/2373 symbols completed. DTK took 1.2s. Estimated remaining: 3h 57m 37s. Rate: 7.2 symbols/min [2025-10-09T18:31:48.402272] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:48.444237] [DEBUG] [LOCAL ] DTM: Loaded 44082 existing records from primary storage. [2025-10-09T18:31:48.444526] [INFO ] [MAIN ] DTM: Loaded 44082 existing records. [2025-10-09T18:31:48.619849] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:48.620032] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-09T18:31:48.620080] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-09T18:31:48.620302] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-09T18:31:48.620373] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-09T18:31:48.806291] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-09T18:31:48.979894] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:49.596724] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-09T18:31:49.943810] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T18:31:50.396699] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-09T18:31:50.439284] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T18:31:50.509883] [DEBUG] [REMOTE ] DTM: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-09T18:31:50.510189] [WARN ] [REMOTE ] DTM: No data returned for month 2024-12 [2025-10-09T18:31:50.510269] [FATAL] [REMOTE ] DTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:31:50.510320] [FATAL] [MAIN ] DTM: Failed to fetch primary data. [2025-10-09T18:31:50.510377] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:31:50.510448] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-09T18:31:50.510510] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-09T18:31:50.510544] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-10-09T18:31:50.510813] [DEBUG] [LOCAL ] DTM: Deleted derivative data file. [2025-10-09T18:31:50.510901] [INFO ] [MAIN ] Update Progress: 662/2373 symbols completed. DTM took 2.3s. Estimated remaining: 3h 57m 13s. Rate: 7.2 symbols/min [2025-10-09T18:31:50.683127] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:50.683260] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-09T18:31:50.683297] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-09T18:31:50.683406] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-09T18:31:50.683447] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-09T18:31:50.683488] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-09T18:31:50.683519] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-09T18:31:51.083911] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:51.196729] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-09T18:31:51.996691] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-09T18:31:52.031254] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-09T18:31:52.796690] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-09T18:31:52.911307] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T18:31:53.596725] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-09T18:31:54.068585] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T18:31:54.238785] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T18:31:54.242279] [INFO ] [REMOTE ] DTE: Full fetch complete (68449 records). [2025-10-09T18:31:54.242382] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-09T18:31:54.243152] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:31:54.243253] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:31:54.243330] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:31:54.243466] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-09T18:31:54.243557] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-09T18:31:54.243614] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-10-09T18:31:54.243820] [DEBUG] [LOCAL ] DTE: Deleted derivative data file. [2025-10-09T18:31:54.244735] [INFO ] [MAIN ] Update Progress: 663/2373 symbols completed. DTE took 32.6s. Estimated remaining: 3h 56m 53s. Rate: 7.2 symbols/min [2025-10-09T18:31:54.410383] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-09T18:31:54.413916] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:31:54.475981] [DEBUG] [LOCAL ] DUK: Loaded 53445 existing records from primary storage. [2025-10-09T18:31:54.476303] [INFO ] [MAIN ] DUK: Loaded 53445 existing records. [2025-10-09T18:31:54.653195] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:31:54.653419] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-09T18:31:54.653475] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-09T18:31:54.653746] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-09T18:31:54.653813] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-09T18:31:55.034982] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-09T18:31:55.039035] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:31:55.196714] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-09T18:31:55.690171] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-09T18:31:55.996732] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-09T18:31:56.472478] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-09T18:31:56.796703] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-09T18:31:57.242436] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:31:57.596762] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-09T18:31:58.396730] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-09T18:31:58.868798] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T18:31:59.196691] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-09T18:31:59.386931] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T18:31:59.476511] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-09T18:31:59.996721] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-09T18:32:00.474409] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T18:32:00.796735] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-09T18:32:01.303794] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-09T18:32:01.596721] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-09T18:32:02.183073] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:32:02.396737] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-09T18:32:02.795351] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T18:32:03.196729] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-09T18:32:03.794520] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T18:32:03.795292] [INFO ] [REMOTE ] DTF: Full fetch complete (1899 records). [2025-10-09T18:32:03.795360] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-09T18:32:03.979551] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-09T18:32:03.979733] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:32:03.979803] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:32:03.979879] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-09T18:32:03.979970] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-09T18:32:03.980030] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-09T18:32:03.980093] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-09T18:32:03.980200] [INFO ] [MAIN ] Update Progress: 664/2373 symbols completed. DTF took 20.0s. Estimated remaining: 3h 56m 48s. Rate: 7.2 symbols/min [2025-10-09T18:32:04.001838] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-09T18:32:04.156286] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:04.156472] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-09T18:32:04.156509] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-09T18:32:04.156623] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-09T18:32:04.156698] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-09T18:32:04.156754] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-09T18:32:04.156788] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-09T18:32:04.549155] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:32:04.796725] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-09T18:32:05.223591] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T18:32:05.596699] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-09T18:32:05.822745] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T18:32:06.180326] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T18:32:06.396697] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-09T18:32:07.105710] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T18:32:07.196698] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-09T18:32:07.695386] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-09T18:32:07.996702] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-09T18:32:08.589469] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T18:32:08.796704] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-09T18:32:09.596774] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-09T18:32:10.245469] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-09T18:32:10.396694] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-09T18:32:10.637404] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-09T18:32:10.822768] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T18:32:11.196732] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-09T18:32:11.884722] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-09T18:32:11.996696] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-09T18:32:12.614274] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T18:32:12.796713] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-09T18:32:13.596806] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-09T18:32:13.619418] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T18:32:14.034958] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T18:32:14.396731] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-09T18:32:14.968752] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T18:32:15.196794] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-09T18:32:15.803354] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T18:32:15.996748] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-09T18:32:16.796723] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-09T18:32:17.511861] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T18:32:17.584227] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T18:32:17.596671] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-09T18:32:18.396774] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-09T18:32:19.066846] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T18:32:19.196722] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-09T18:32:19.727287] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T18:32:19.728340] [INFO ] [REMOTE ] DTW: Full fetch complete (7365 records). [2025-10-09T18:32:19.728412] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-09T18:32:19.999810] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-09T18:32:20.096773] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-09T18:32:20.097006] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-09T18:32:20.097333] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-09T18:32:20.097448] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-09T18:32:20.098390] [DEBUG] [LOCAL ] DTW: Trimmed 7365 records to 4922 (keeping 200 days of data) [2025-10-09T18:32:20.130947] [DEBUG] [LOCAL ] DTW: Primary data saved (4922 records). [2025-10-09T18:32:20.131335] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-09T18:32:20.131454] [INFO ] [MAIN ] Update Progress: 665/2373 symbols completed. DTW took 29.6s. Estimated remaining: 3h 57m 0s. Rate: 7.2 symbols/min [2025-10-09T18:32:20.302977] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:20.347597] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-09T18:32:20.401963] [DEBUG] [LOCAL ] DV: Loaded 51300 existing records from primary storage. [2025-10-09T18:32:20.402309] [INFO ] [MAIN ] DV: Loaded 51300 existing records. [2025-10-09T18:32:20.601832] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:32:20.602052] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-09T18:32:20.602115] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-09T18:32:20.602449] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-09T18:32:20.602506] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-09T18:32:20.801935] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-09T18:32:20.872883] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T18:32:21.002908] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:32:21.502694] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T18:32:21.596683] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-09T18:32:22.396776] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-09T18:32:23.003898] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T18:32:23.067629] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T18:32:23.196729] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-09T18:32:23.996691] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-09T18:32:24.581129] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T18:32:24.796689] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-09T18:32:25.006082] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-09T18:32:25.181493] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-09T18:32:25.596718] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-09T18:32:26.176682] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T18:32:26.177580] [INFO ] [REMOTE ] DUKB: Full fetch complete (9361 records). [2025-10-09T18:32:26.177673] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-09T18:32:26.402232] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-09T18:32:26.585990] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-09T18:32:26.586074] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-09T18:32:26.586322] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-09T18:32:26.586362] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-09T18:32:26.586873] [DEBUG] [LOCAL ] DUKB: Trimmed 9361 records to 6397 (keeping 200 days of data) [2025-10-09T18:32:26.628288] [DEBUG] [LOCAL ] DUKB: Primary data saved (6397 records). [2025-10-09T18:32:26.628424] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-09T18:32:26.628498] [INFO ] [MAIN ] Update Progress: 666/2373 symbols completed. DUKB took 22.6s. Estimated remaining: 3h 56m 47s. Rate: 7.2 symbols/min [2025-10-09T18:32:26.807399] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:26.850407] [DEBUG] [LOCAL ] DVA: Loaded 41008 existing records from primary storage. [2025-10-09T18:32:26.850732] [INFO ] [MAIN ] DVA: Loaded 41008 existing records. [2025-10-09T18:32:27.096469] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-09T18:32:27.096056] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:32:27.099978] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-09T18:32:27.100028] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-09T18:32:27.100536] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-09T18:32:27.100605] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-09T18:32:27.200789] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-09T18:32:27.451095] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:32:27.996724] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-09T18:32:28.796691] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-09T18:32:28.836586] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T18:32:29.233856] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T18:32:29.260774] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T18:32:29.596754] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-09T18:32:30.215942] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T18:32:30.396791] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-09T18:32:30.871771] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T18:32:31.196766] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-09T18:32:31.996723] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-09T18:32:32.635552] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T18:32:32.646520] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T18:32:32.647793] [INFO ] [REMOTE ] DTG: Full fetch complete (8932 records). [2025-10-09T18:32:32.647896] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-09T18:32:32.801839] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-09T18:32:33.028957] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-09T18:32:33.029036] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-09T18:32:33.029243] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-09T18:32:33.029283] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-09T18:32:33.029706] [DEBUG] [LOCAL ] DTG: Trimmed 8932 records to 5881 (keeping 200 days of data) [2025-10-09T18:32:33.066668] [DEBUG] [LOCAL ] DTG: Primary data saved (5881 records). [2025-10-09T18:32:33.066777] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-09T18:32:33.066865] [INFO ] [MAIN ] Update Progress: 667/2373 symbols completed. DTG took 46.2s. Estimated remaining: 3h 56m 34s. Rate: 7.2 symbols/min [2025-10-09T18:32:33.236334] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:33.236500] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-09T18:32:33.236557] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-09T18:32:33.236761] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-09T18:32:33.236821] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-09T18:32:33.236866] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-09T18:32:33.236899] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-09T18:32:33.589160] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:32:33.596673] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-09T18:32:34.394696] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T18:32:34.404090] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-09T18:32:35.196733] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-09T18:32:35.528867] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T18:32:35.900913] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T18:32:35.996692] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-09T18:32:36.607707] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T18:32:36.796725] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-09T18:32:37.596740] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-09T18:32:37.926570] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-09T18:32:38.253220] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:32:38.396708] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-09T18:32:39.035446] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T18:32:39.196722] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-09T18:32:39.968186] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T18:32:39.996707] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-09T18:32:40.796709] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-09T18:32:41.056997] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T18:32:41.191737] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T18:32:41.596801] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-09T18:32:42.396713] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-09T18:32:43.132509] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-09T18:32:43.196686] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-09T18:32:43.661054] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:32:43.784526] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-09T18:32:43.996726] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-09T18:32:44.796727] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-09T18:32:44.946921] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T18:32:45.596684] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-09T18:32:46.081262] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-09T18:32:46.396732] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-09T18:32:46.690062] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T18:32:47.196737] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-09T18:32:47.996813] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-09T18:32:48.247330] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-09T18:32:48.579208] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-09T18:32:48.796682] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-09T18:32:48.903797] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-09T18:32:49.596718] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-09T18:32:49.980959] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-09T18:32:49.985442] [INFO ] [REMOTE ] DUK: Full fetch complete (77389 records). [2025-10-09T18:32:49.985557] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-09T18:32:50.374749] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-09T18:32:50.374829] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-09T18:32:50.375725] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-09T18:32:50.375789] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-09T18:32:50.377341] [DEBUG] [LOCAL ] DUK: Trimmed 77389 records to 53830 (keeping 200 days of data) [2025-10-09T18:32:50.433560] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-09T18:32:50.723952] [DEBUG] [LOCAL ] DUK: Primary data saved (53830 records). [2025-10-09T18:32:50.724092] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-09T18:32:50.725355] [INFO ] [MAIN ] Update Progress: 668/2373 symbols completed. DUK took 56.5s. Estimated remaining: 3h 56m 50s. Rate: 7.2 symbols/min [2025-10-09T18:32:50.901060] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:50.901401] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-09T18:32:50.901512] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-09T18:32:50.901991] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-09T18:32:50.902233] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-09T18:32:50.917970] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-09T18:32:50.930734] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-09T18:32:50.932942] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-09T18:32:51.200383] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-09T18:32:51.257337] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T18:32:51.339526] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:32:51.806934] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T18:32:51.996787] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-09T18:32:52.796704] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-09T18:32:53.225459] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-09T18:32:53.299091] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T18:32:53.596722] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-09T18:32:54.396706] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-09T18:32:54.672015] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-09T18:32:55.196762] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-09T18:32:55.379281] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T18:32:55.981864] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T18:32:55.996664] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-09T18:32:56.675010] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T18:32:56.796722] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-09T18:32:57.586791] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T18:32:57.596668] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-09T18:32:58.396716] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-09T18:32:58.712481] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T18:32:58.892616] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T18:32:58.896272] [INFO ] [REMOTE ] DVA: Full fetch complete (59775 records). [2025-10-09T18:32:58.896407] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-09T18:32:59.201817] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-09T18:32:59.291362] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-09T18:32:59.291461] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-09T18:32:59.292269] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-09T18:32:59.292335] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-09T18:32:59.293979] [DEBUG] [LOCAL ] DVA: Trimmed 59775 records to 41299 (keeping 200 days of data) [2025-10-09T18:32:59.545289] [DEBUG] [LOCAL ] DVA: Primary data saved (41299 records). [2025-10-09T18:32:59.545428] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-09T18:32:59.545544] [INFO ] [MAIN ] Update Progress: 669/2373 symbols completed. DVA took 32.9s. Estimated remaining: 3h 56m 43s. Rate: 7.2 symbols/min [2025-10-09T18:32:59.713767] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:32:59.758912] [DEBUG] [LOCAL ] DXC: Loaded 49857 existing records from primary storage. [2025-10-09T18:32:59.759211] [INFO ] [MAIN ] DXC: Loaded 49857 existing records. [2025-10-09T18:32:59.934273] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:32:59.934472] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-09T18:32:59.934519] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-09T18:32:59.934966] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-09T18:32:59.935025] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-09T18:32:59.998581] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-09T18:33:00.104083] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T18:33:00.181146] [INFO ] [REMOTE ] DV: Full fetch complete (73557 records). [2025-10-09T18:33:00.207447] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-09T18:33:00.456368] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:00.755372] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-09T18:33:00.755463] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-09T18:33:00.756438] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-09T18:33:00.756508] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-09T18:33:00.758162] [DEBUG] [LOCAL ] DV: Trimmed 73557 records to 51658 (keeping 200 days of data) [2025-10-09T18:33:00.808157] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-09T18:33:01.083110] [DEBUG] [LOCAL ] DV: Primary data saved (51658 records). [2025-10-09T18:33:01.083250] [INFO ] [MAIN ] DV: Full history saved. [2025-10-09T18:33:01.083333] [INFO ] [MAIN ] Update Progress: 670/2373 symbols completed. DV took 41.0s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-10-09T18:33:01.289428] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:01.329964] [DEBUG] [LOCAL ] DXYZ: Loaded 37113 existing records from primary storage. [2025-10-09T18:33:01.330341] [INFO ] [MAIN ] DXYZ: Loaded 37113 existing records. [2025-10-09T18:33:01.493183] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-09T18:33:01.585629] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:01.586000] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-09T18:33:01.586119] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-09T18:33:01.586486] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-09T18:33:01.586548] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-09T18:33:01.601950] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-09T18:33:01.990985] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-09T18:33:01.996905] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:02.396706] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-09T18:33:02.428055] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-09T18:33:03.086802] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T18:33:03.196700] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-09T18:33:03.996715] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-09T18:33:04.757137] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:33:04.761828] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-10-09T18:33:04.761992] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-09T18:33:04.805373] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-09T18:33:05.104248] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-10-09T18:33:05.237935] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-09T18:33:05.238055] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-09T18:33:05.239055] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-09T18:33:05.239135] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-09T18:33:05.240882] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54089 (keeping 200 days of data) [2025-10-09T18:33:05.362753] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T18:33:05.609628] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-09T18:33:05.650905] [DEBUG] [LOCAL ] DVN: Primary data saved (54089 records). [2025-10-09T18:33:05.651077] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-09T18:33:05.651157] [INFO ] [MAIN ] Update Progress: 671/2373 symbols completed. DVN took 32.6s. Estimated remaining: 3h 55m 59s. Rate: 7.2 symbols/min [2025-10-09T18:33:05.829753] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:05.860212] [DEBUG] [LOCAL ] DY: Loaded 28554 existing records from primary storage. [2025-10-09T18:33:05.860509] [INFO ] [MAIN ] DY: Loaded 28554 existing records. [2025-10-09T18:33:06.036340] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:06.036584] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-09T18:33:06.036633] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-09T18:33:06.036903] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-09T18:33:06.036960] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-09T18:33:06.385093] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:06.396667] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-09T18:33:06.859508] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T18:33:07.055678] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T18:33:07.196817] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-09T18:33:07.669883] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-09T18:33:07.996749] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-09T18:33:08.796788] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-09T18:33:09.127686] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-09T18:33:09.596705] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-09T18:33:09.727316] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T18:33:09.763739] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T18:33:10.396754] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-09T18:33:11.196758] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-09T18:33:11.413741] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:33:11.782193] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T18:33:11.996741] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-09T18:33:12.796763] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-09T18:33:12.983348] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T18:33:13.596697] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-09T18:33:13.644741] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:33:14.004676] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T18:33:14.396784] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-09T18:33:15.104034] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T18:33:15.196711] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-09T18:33:15.920249] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:33:15.996748] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-09T18:33:16.541431] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T18:33:16.796780] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-09T18:33:16.930352] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T18:33:17.596778] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-09T18:33:18.396694] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-09T18:33:18.594198] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T18:33:19.196727] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-09T18:33:19.403145] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T18:33:19.480355] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T18:33:19.996778] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-09T18:33:20.796737] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-09T18:33:21.194381] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T18:33:21.428931] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T18:33:21.596700] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-09T18:33:22.396682] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-09T18:33:22.463068] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T18:33:23.196676] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-09T18:33:23.395380] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T18:33:23.576401] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-09T18:33:23.996722] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-09T18:33:24.706099] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T18:33:24.796684] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-09T18:33:25.596704] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-09T18:33:25.866503] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T18:33:25.897376] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T18:33:26.396732] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-09T18:33:27.196748] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-09T18:33:27.359852] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T18:33:27.775527] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T18:33:27.996771] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-09T18:33:28.802413] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-09T18:33:28.816035] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T18:33:29.595080] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T18:33:29.602304] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-09T18:33:29.952674] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T18:33:29.954972] [INFO ] [REMOTE ] DY: Full fetch complete (43742 records). [2025-10-09T18:33:29.955068] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-09T18:33:30.397032] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-09T18:33:30.414035] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-09T18:33:30.414192] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-09T18:33:30.415031] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-09T18:33:30.415102] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-09T18:33:30.416151] [DEBUG] [LOCAL ] DY: Trimmed 43742 records to 28668 (keeping 200 days of data) [2025-10-09T18:33:30.627545] [DEBUG] [LOCAL ] DY: Primary data saved (28668 records). [2025-10-09T18:33:30.627749] [INFO ] [MAIN ] DY: Full history saved. [2025-10-09T18:33:30.628633] [INFO ] [MAIN ] Update Progress: 672/2373 symbols completed. DY took 25.0s. Estimated remaining: 3h 56m 33s. Rate: 7.2 symbols/min [2025-10-09T18:33:30.821556] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:30.857111] [DEBUG] [LOCAL ] E: Loaded 33186 existing records from primary storage. [2025-10-09T18:33:30.857407] [INFO ] [MAIN ] E: Loaded 33186 existing records. [2025-10-09T18:33:31.057305] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:31.057765] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-09T18:33:31.057913] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-09T18:33:31.058312] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-09T18:33:31.058381] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-09T18:33:31.198143] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-09T18:33:31.302854] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T18:33:31.470744] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:31.996741] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-09T18:33:32.312757] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-09T18:33:32.796776] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-09T18:33:33.299898] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-09T18:33:33.304394] [INFO ] [REMOTE ] DX: Full fetch complete (75563 records). [2025-10-09T18:33:33.304513] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-09T18:33:33.491139] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T18:33:33.601817] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-09T18:33:33.733681] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-09T18:33:33.733776] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-09T18:33:33.734669] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-09T18:33:33.734734] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-09T18:33:33.736167] [DEBUG] [LOCAL ] DX: Trimmed 75563 records to 52858 (keeping 200 days of data) [2025-10-09T18:33:34.070774] [DEBUG] [LOCAL ] DX: Primary data saved (52858 records). [2025-10-09T18:33:34.070899] [INFO ] [MAIN ] DX: Full history saved. [2025-10-09T18:33:34.070986] [INFO ] [MAIN ] Update Progress: 673/2373 symbols completed. DX took 43.3s. Estimated remaining: 3h 56m 12s. Rate: 7.2 symbols/min [2025-10-09T18:33:34.248614] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:34.290743] [DEBUG] [LOCAL ] EAF: Loaded 42154 existing records from primary storage. [2025-10-09T18:33:34.291102] [INFO ] [MAIN ] EAF: Loaded 42154 existing records. [2025-10-09T18:33:34.398511] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-09T18:33:34.545226] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T18:33:34.550501] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:34.551277] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-09T18:33:34.561035] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-09T18:33:34.561531] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-09T18:33:34.561602] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-09T18:33:34.996983] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:35.026735] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:33:35.196714] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-09T18:33:35.996768] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-09T18:33:36.175117] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T18:33:36.179048] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57467 records). [2025-10-09T18:33:36.179157] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-09T18:33:36.563238] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-09T18:33:36.563322] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-09T18:33:36.564096] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-09T18:33:36.564161] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-09T18:33:36.565320] [DEBUG] [LOCAL ] DXYZ: Trimmed 57467 records to 37365 (keeping 200 days of data) [2025-10-09T18:33:36.795462] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37365 records). [2025-10-09T18:33:36.795639] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-09T18:33:36.795777] [INFO ] [MAIN ] Update Progress: 674/2373 symbols completed. DXYZ took 35.7s. Estimated remaining: 3h 55m 50s. Rate: 7.2 symbols/min [2025-10-09T18:33:36.829203] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-09T18:33:36.979381] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:37.010944] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T18:33:37.024292] [DEBUG] [LOCAL ] EAI: Loaded 4002 existing records from primary storage. [2025-10-09T18:33:37.024515] [INFO ] [MAIN ] EAI: Loaded 4002 existing records. [2025-10-09T18:33:37.201166] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:37.201376] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-09T18:33:37.201423] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-09T18:33:37.201612] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-09T18:33:37.201703] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-09T18:33:37.583106] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:37.601837] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-09T18:33:37.619096] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T18:33:38.137982] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T18:33:38.396725] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-09T18:33:38.879205] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T18:33:39.196723] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-09T18:33:39.706616] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:33:39.710851] [INFO ] [REMOTE ] DXC: Full fetch complete (69306 records). [2025-10-09T18:33:39.710980] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-09T18:33:39.711768] [FATAL] [VALIDATOR ] DXC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:33:39.711857] [FATAL] [MAIN ] DXC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:33:39.711902] [WARN ] [MAIN ] DXC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:33:39.711968] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-09T18:33:39.712043] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-09T18:33:39.712118] [INFO ] [LOCAL ] DXC: Starting deletion of derivative data. [2025-10-09T18:33:39.712402] [DEBUG] [LOCAL ] DXC: Deleted derivative data file. [2025-10-09T18:33:39.712505] [INFO ] [MAIN ] Update Progress: 675/2373 symbols completed. DXC took 40.2s. Estimated remaining: 3h 55m 28s. Rate: 7.2 symbols/min [2025-10-09T18:33:39.913299] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:33:39.941478] [DEBUG] [LOCAL ] EARN: Loaded 29114 existing records from primary storage. [2025-10-09T18:33:39.941768] [INFO ] [MAIN ] EARN: Loaded 29114 existing records. [2025-10-09T18:33:39.999678] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-09T18:33:40.121973] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:33:40.122159] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-09T18:33:40.122206] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-09T18:33:40.122429] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-09T18:33:40.122485] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-09T18:33:40.486986] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:33:40.621203] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T18:33:40.790890] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T18:33:40.799905] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-09T18:33:41.357618] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T18:33:41.596711] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-09T18:33:42.396721] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-09T18:33:42.956751] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T18:33:43.196709] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-09T18:33:43.764685] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T18:33:43.996706] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-09T18:33:44.476370] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T18:33:44.796687] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-09T18:33:44.829780] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T18:33:45.525958] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T18:33:45.596704] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-09T18:33:46.103777] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-09T18:33:46.396762] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-09T18:33:47.196721] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-09T18:33:47.588700] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T18:33:47.975230] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T18:33:47.996670] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-09T18:33:48.796749] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-09T18:33:49.207671] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-09T18:33:49.526598] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T18:33:49.596692] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-09T18:33:50.396719] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-09T18:33:51.109431] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T18:33:51.196721] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-09T18:33:51.851393] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T18:33:51.996695] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-09T18:33:52.129973] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T18:33:52.796721] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-09T18:33:53.559746] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T18:33:53.596685] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-09T18:33:54.396755] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-09T18:33:54.451246] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T18:33:54.850796] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T18:33:54.953108] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T18:33:55.196711] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-09T18:33:55.996725] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-09T18:33:56.651917] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T18:33:56.796715] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-09T18:33:57.596710] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-09T18:33:57.672492] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T18:33:58.172222] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T18:33:58.396744] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-09T18:33:58.615778] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-09T18:33:59.196730] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-09T18:33:59.533378] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T18:33:59.741858] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T18:33:59.743262] [INFO ] [REMOTE ] EAI: Full fetch complete (6106 records). [2025-10-09T18:33:59.743359] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-09T18:34:00.010454] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-09T18:34:00.267777] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-10-09T18:34:00.267907] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-10-09T18:34:00.268142] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-10-09T18:34:00.268184] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-10-09T18:34:00.268686] [DEBUG] [LOCAL ] EAI: Trimmed 6106 records to 4026 (keeping 200 days of data) [2025-10-09T18:34:00.303133] [DEBUG] [LOCAL ] EAI: Primary data saved (4026 records). [2025-10-09T18:34:00.303346] [INFO ] [MAIN ] EAI: Full history saved. [2025-10-09T18:34:00.303469] [INFO ] [MAIN ] Update Progress: 676/2373 symbols completed. EAI took 23.5s. Estimated remaining: 3h 55m 50s. Rate: 7.2 symbols/min [2025-10-09T18:34:00.551440] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:00.601902] [DEBUG] [LOCAL ] EAT: Loaded 49839 existing records from primary storage. [2025-10-09T18:34:00.602249] [INFO ] [MAIN ] EAT: Loaded 49839 existing records. [2025-10-09T18:34:00.776095] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:00.776288] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-09T18:34:00.776345] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-09T18:34:00.776613] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-09T18:34:00.776695] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-09T18:34:00.806831] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-09T18:34:01.123176] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:01.596685] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-09T18:34:02.065868] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T18:34:02.396761] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-09T18:34:02.780164] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T18:34:03.085344] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-09T18:34:03.088336] [INFO ] [REMOTE ] E: Full fetch complete (47941 records). [2025-10-09T18:34:03.088441] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-09T18:34:03.201870] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-09T18:34:03.482233] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-09T18:34:03.482329] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-09T18:34:03.483031] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-09T18:34:03.483095] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-09T18:34:03.484171] [DEBUG] [LOCAL ] E: Trimmed 47941 records to 33374 (keeping 200 days of data) [2025-10-09T18:34:03.696205] [DEBUG] [LOCAL ] E: Primary data saved (33374 records). [2025-10-09T18:34:03.696359] [INFO ] [MAIN ] E: Full history saved. [2025-10-09T18:34:03.697237] [INFO ] [MAIN ] Update Progress: 677/2373 symbols completed. E took 33.1s. Estimated remaining: 3h 55m 30s. Rate: 7.2 symbols/min [2025-10-09T18:34:03.996732] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-09T18:34:04.335968] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-09T18:34:04.734495] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T18:34:04.796752] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-09T18:34:05.596710] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-09T18:34:05.746734] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T18:34:05.982096] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T18:34:06.396780] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-09T18:34:07.196696] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-09T18:34:07.434131] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T18:34:07.673564] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T18:34:07.996770] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-09T18:34:08.347134] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T18:34:08.350082] [INFO ] [REMOTE ] EAF: Full fetch complete (63063 records). [2025-10-09T18:34:08.350180] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-09T18:34:08.772811] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-09T18:34:08.772926] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-09T18:34:08.773871] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-09T18:34:08.773949] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-09T18:34:08.775342] [DEBUG] [LOCAL ] EAF: Trimmed 63063 records to 42401 (keeping 200 days of data) [2025-10-09T18:34:08.821889] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-09T18:34:09.028730] [DEBUG] [LOCAL ] EAF: Primary data saved (42401 records). [2025-10-09T18:34:09.028871] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-09T18:34:09.030507] [INFO ] [MAIN ] Update Progress: 678/2373 symbols completed. EAF took 35.0s. Estimated remaining: 3h 55m 14s. Rate: 7.2 symbols/min [2025-10-09T18:34:09.786514] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T18:34:09.798272] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-09T18:34:09.971162] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T18:34:10.396720] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-09T18:34:11.466671] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:34:11.477601] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-09T18:34:11.809786] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T18:34:11.996787] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-09T18:34:13.223268] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T18:34:13.229496] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-09T18:34:13.392216] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T18:34:13.596733] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-09T18:34:14.345613] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T18:34:14.396789] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-09T18:34:15.326817] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T18:34:15.337621] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-09T18:34:15.739542] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T18:34:15.742258] [INFO ] [REMOTE ] EARN: Full fetch complete (45691 records). [2025-10-09T18:34:15.742342] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-09T18:34:16.127093] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-09T18:34:16.127175] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-09T18:34:16.127960] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-09T18:34:16.128022] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-09T18:34:16.128994] [DEBUG] [LOCAL ] EARN: Trimmed 45691 records to 29315 (keeping 200 days of data) [2025-10-09T18:34:16.302171] [DEBUG] [LOCAL ] EARN: Primary data saved (29315 records). [2025-10-09T18:34:16.302307] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-09T18:34:16.302387] [INFO ] [MAIN ] Update Progress: 679/2373 symbols completed. EARN took 36.6s. Estimated remaining: 3h 55m 3s. Rate: 7.2 symbols/min [2025-10-09T18:34:16.769609] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T18:34:16.779609] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-09T18:34:18.338119] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T18:34:18.348980] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-09T18:34:19.869061] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T18:34:19.880196] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-09T18:34:21.591567] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T18:34:21.602586] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-09T18:34:23.083329] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T18:34:23.087536] [INFO ] [REMOTE ] EAT: Full fetch complete (72103 records). [2025-10-09T18:34:23.087682] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-09T18:34:23.476386] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-09T18:34:23.476476] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-09T18:34:23.477342] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-09T18:34:23.477406] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-09T18:34:23.478784] [DEBUG] [LOCAL ] EAT: Trimmed 72103 records to 50205 (keeping 200 days of data) [2025-10-09T18:34:23.779441] [DEBUG] [LOCAL ] EAT: Primary data saved (50205 records). [2025-10-09T18:34:23.779576] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-09T18:34:23.779675] [INFO ] [MAIN ] Update Progress: 680/2373 symbols completed. EAT took 23.5s. Estimated remaining: 3h 54m 52s. Rate: 7.2 symbols/min [2025-10-09T18:34:24.314122] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:24.369486] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:24.442849] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-10-09T18:34:24.466183] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-10-09T18:34:24.478147] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:24.478756] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-09T18:34:24.478811] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-09T18:34:24.478857] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-09T18:34:24.478890] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-09T18:34:24.518888] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:24.632886] [DEBUG] [LOCAL ] EBF: Loaded 19015 existing records from primary storage. [2025-10-09T18:34:24.658243] [INFO ] [MAIN ] EBF: Loaded 19015 existing records. [2025-10-09T18:34:24.975876] [DEBUG] [LOCAL ] EBS: Loaded 46781 existing records from primary storage. [2025-10-09T18:34:24.993569] [INFO ] [MAIN ] EBS: Loaded 46781 existing records. [2025-10-09T18:34:24.993354] [DEBUG] [LOCAL ] EBR: Loaded 43127 existing records from primary storage. [2025-10-09T18:34:25.158553] [INFO ] [MAIN ] EBR: Loaded 43127 existing records. [2025-10-09T18:34:25.158304] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:25.295917] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:25.301863] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-09T18:34:25.252521] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-09T18:34:25.341031] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-09T18:34:25.423904] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-09T18:34:25.455249] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-09T18:34:25.455129] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:25.517296] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-09T18:34:25.538577] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-09T18:34:25.569102] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-09T18:34:25.582838] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-09T18:34:25.575218] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:25.674603] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-09T18:34:25.697193] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-09T18:34:25.751262] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-09T18:34:25.783336] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-09T18:34:26.398028] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:26.425322] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-09T18:34:26.565265] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:26.570286] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-09T18:34:26.660851] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:26.661206] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-09T18:34:27.095714] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T18:34:27.105096] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-09T18:34:27.459529] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T18:34:27.463150] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-09T18:34:28.447572] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:34:28.451398] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-09T18:34:28.515665] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T18:34:28.525739] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-09T18:34:28.597516] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T18:34:28.606491] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-09T18:34:28.664132] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T18:34:28.673482] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-09T18:34:29.295750] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T18:34:29.300073] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-09T18:34:29.705801] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:34:29.716385] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-09T18:34:29.842762] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:34:29.851176] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-09T18:34:30.008019] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T18:34:30.017389] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-09T18:34:30.440514] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T18:34:30.446034] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-09T18:34:30.724689] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T18:34:31.150220] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T18:34:31.196681] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-09T18:34:31.289864] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T18:34:31.313386] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T18:34:31.996780] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-09T18:34:32.482757] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T18:34:32.796855] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-09T18:34:33.422275] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T18:34:33.567461] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T18:34:33.596739] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-09T18:34:34.396788] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-09T18:34:35.108326] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T18:34:35.196694] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-09T18:34:35.366694] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T18:34:35.996736] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-09T18:34:36.393033] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T18:34:36.796700] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-09T18:34:36.995678] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T18:34:37.596730] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-09T18:34:37.975206] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T18:34:38.396719] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-09T18:34:38.703237] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T18:34:39.196691] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-09T18:34:39.244948] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T18:34:39.996692] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-09T18:34:40.498509] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T18:34:40.796691] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-09T18:34:41.038330] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T18:34:41.596781] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-09T18:34:42.298149] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T18:34:42.396720] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-09T18:34:42.804172] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T18:34:43.196719] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-09T18:34:43.877848] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T18:34:43.996729] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-09T18:34:44.759811] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T18:34:44.796705] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-09T18:34:45.596785] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-09T18:34:45.816023] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T18:34:46.161861] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T18:34:46.310265] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T18:34:46.396673] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-09T18:34:47.196713] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-09T18:34:47.713690] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T18:34:47.996727] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-09T18:34:48.432066] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:34:48.434238] [INFO ] [REMOTE ] EBF: Full fetch complete (27633 records). [2025-10-09T18:34:48.434341] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-09T18:34:48.809059] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-09T18:34:48.807237] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-09T18:34:48.809200] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-09T18:34:48.809896] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-09T18:34:48.810544] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-09T18:34:48.811521] [DEBUG] [LOCAL ] EBF: Trimmed 27633 records to 19184 (keeping 200 days of data) [2025-10-09T18:34:48.934925] [DEBUG] [LOCAL ] EBF: Primary data saved (19184 records). [2025-10-09T18:34:48.935062] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-09T18:34:48.935145] [INFO ] [MAIN ] Update Progress: 681/2373 symbols completed. EBF took 25.2s. Estimated remaining: 3h 55m 26s. Rate: 7.2 symbols/min [2025-10-09T18:34:49.101507] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:49.146447] [DEBUG] [LOCAL ] EC: Loaded 49065 existing records from primary storage. [2025-10-09T18:34:49.146800] [INFO ] [MAIN ] EC: Loaded 49065 existing records. [2025-10-09T18:34:49.329909] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:49.330298] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-09T18:34:49.330438] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-09T18:34:49.331103] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-09T18:34:49.331165] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-09T18:34:49.603187] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-09T18:34:49.758478] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:34:49.763940] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:50.051269] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T18:34:50.396731] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-09T18:34:51.196715] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-09T18:34:51.593127] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T18:34:51.996750] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-09T18:34:52.330909] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T18:34:52.502703] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:34:52.505812] [INFO ] [REMOTE ] EB: Full fetch complete (55726 records). [2025-10-09T18:34:52.505904] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-09T18:34:52.802719] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-09T18:34:52.899304] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-09T18:34:52.899394] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-09T18:34:52.900161] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-09T18:34:52.900247] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-09T18:34:52.901498] [DEBUG] [LOCAL ] EB: Trimmed 55726 records to 37092 (keeping 200 days of data) [2025-10-09T18:34:53.113526] [DEBUG] [LOCAL ] EB: Primary data saved (37092 records). [2025-10-09T18:34:53.113673] [INFO ] [MAIN ] EB: Full history saved. [2025-10-09T18:34:53.113765] [INFO ] [MAIN ] Update Progress: 682/2373 symbols completed. EB took 29.3s. Estimated remaining: 3h 55m 7s. Rate: 7.2 symbols/min [2025-10-09T18:34:53.288706] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:53.314719] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T18:34:53.348311] [DEBUG] [LOCAL ] ECAT: Loaded 29416 existing records from primary storage. [2025-10-09T18:34:53.348561] [INFO ] [MAIN ] ECAT: Loaded 29416 existing records. [2025-10-09T18:34:53.522984] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:53.523215] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-09T18:34:53.523298] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-09T18:34:53.523729] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-09T18:34:53.523805] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-09T18:34:53.601812] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-09T18:34:53.879084] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:54.312404] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T18:34:54.396680] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-09T18:34:55.096220] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T18:34:55.196690] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-09T18:34:55.711892] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:34:55.996725] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-09T18:34:56.602292] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T18:34:56.606089] [INFO ] [REMOTE ] EBR: Full fetch complete (62466 records). [2025-10-09T18:34:56.606196] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-09T18:34:56.801809] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-09T18:34:57.003156] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-09T18:34:57.003248] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-09T18:34:57.004115] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-09T18:34:57.004185] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-09T18:34:57.005452] [DEBUG] [LOCAL ] EBR: Trimmed 62466 records to 43463 (keeping 200 days of data) [2025-10-09T18:34:57.231459] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T18:34:57.289609] [DEBUG] [LOCAL ] EBR: Primary data saved (43463 records). [2025-10-09T18:34:57.289768] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-09T18:34:57.289868] [INFO ] [MAIN ] Update Progress: 683/2373 symbols completed. EBR took 33.4s. Estimated remaining: 3h 54m 48s. Rate: 7.2 symbols/min [2025-10-09T18:34:57.456795] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:34:57.499980] [DEBUG] [LOCAL ] ECC: Loaded 43089 existing records from primary storage. [2025-10-09T18:34:57.500928] [INFO ] [MAIN ] ECC: Loaded 43089 existing records. [2025-10-09T18:34:57.599573] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-09T18:34:57.682910] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:34:57.683347] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-09T18:34:57.683409] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-09T18:34:57.684049] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-09T18:34:57.684110] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-09T18:34:58.057450] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:34:58.396675] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-09T18:34:58.734517] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T18:34:58.780767] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:34:59.196714] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-09T18:34:59.678235] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T18:34:59.683949] [INFO ] [REMOTE ] EBS: Full fetch complete (67342 records). [2025-10-09T18:34:59.684155] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-09T18:34:59.999956] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-09T18:35:00.145491] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-09T18:35:00.145759] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-09T18:35:00.146701] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-09T18:35:00.146786] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-09T18:35:00.156866] [DEBUG] [LOCAL ] EBS: Trimmed 67342 records to 47100 (keeping 200 days of data) [2025-10-09T18:35:00.173370] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T18:35:00.450262] [DEBUG] [LOCAL ] EBS: Primary data saved (47100 records). [2025-10-09T18:35:00.450404] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-09T18:35:00.450489] [INFO ] [MAIN ] Update Progress: 684/2373 symbols completed. EBS took 36.7s. Estimated remaining: 3h 54m 27s. Rate: 7.2 symbols/min [2025-10-09T18:35:00.617476] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:00.617632] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-09T18:35:00.617704] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-09T18:35:00.617841] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-09T18:35:00.617894] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-09T18:35:00.617937] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-09T18:35:00.617969] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-09T18:35:00.802021] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-09T18:35:00.970607] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:01.596675] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-09T18:35:01.750841] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T18:35:02.396733] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-09T18:35:02.750245] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T18:35:02.959319] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T18:35:03.185222] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T18:35:03.196684] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-09T18:35:03.996811] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-09T18:35:04.389477] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T18:35:04.796822] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-09T18:35:05.596776] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-09T18:35:05.636353] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-09T18:35:06.000543] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T18:35:06.396742] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-09T18:35:06.734485] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-09T18:35:07.196683] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-09T18:35:07.464760] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:35:07.519531] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T18:35:07.996781] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-09T18:35:08.796810] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-09T18:35:09.204695] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:35:09.596768] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-09T18:35:10.396689] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-09T18:35:10.546830] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T18:35:11.002339] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T18:35:11.196769] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-09T18:35:11.903320] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T18:35:11.996774] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-09T18:35:12.589488] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T18:35:12.796718] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-09T18:35:13.346745] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T18:35:13.596717] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-09T18:35:14.396715] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-09T18:35:14.444916] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:35:14.829518] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T18:35:15.196778] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-09T18:35:15.404899] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T18:35:15.500849] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-09T18:35:15.996776] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-09T18:35:16.796795] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-09T18:35:17.238915] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T18:35:17.596824] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-09T18:35:17.686272] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:35:18.396740] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-09T18:35:18.983858] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T18:35:19.196796] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-09T18:35:19.544754] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T18:35:19.572227] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T18:35:19.575735] [INFO ] [REMOTE ] EC: Full fetch complete (71470 records). [2025-10-09T18:35:19.575859] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-09T18:35:19.576607] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:35:19.576741] [FATAL] [MAIN ] EC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:35:19.576825] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:35:19.576911] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-09T18:35:19.576992] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-09T18:35:19.577044] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-10-09T18:35:19.577371] [DEBUG] [LOCAL ] EC: Deleted derivative data file. [2025-10-09T18:35:19.578522] [INFO ] [MAIN ] Update Progress: 685/2373 symbols completed. EC took 30.6s. Estimated remaining: 3h 54m 46s. Rate: 7.2 symbols/min [2025-10-09T18:35:19.748778] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:19.754787] [DEBUG] [LOCAL ] ECCU: Loaded 2260 existing records from primary storage. [2025-10-09T18:35:19.754994] [INFO ] [MAIN ] ECCU: Loaded 2260 existing records. [2025-10-09T18:35:19.934085] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:35:19.934327] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-09T18:35:19.934401] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-09T18:35:19.934619] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-09T18:35:19.934716] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-09T18:35:20.001821] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-09T18:35:20.288788] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:20.431187] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T18:35:20.796762] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-09T18:35:21.596738] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-09T18:35:22.020499] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-09T18:35:22.366799] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T18:35:22.396678] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-09T18:35:23.196723] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-09T18:35:23.686196] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T18:35:23.791905] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T18:35:23.996701] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-09T18:35:24.564144] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T18:35:24.796722] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-09T18:35:25.373213] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T18:35:25.596780] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-09T18:35:26.088021] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T18:35:26.396752] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-09T18:35:27.196731] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-09T18:35:27.761308] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T18:35:27.996746] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-09T18:35:28.600586] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T18:35:28.796721] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-09T18:35:29.236491] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T18:35:29.596823] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-09T18:35:30.127302] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T18:35:30.396721] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-09T18:35:31.143456] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T18:35:31.147226] [INFO ] [REMOTE ] ECC: Full fetch complete (60989 records). [2025-10-09T18:35:31.147332] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-09T18:35:31.202010] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-09T18:35:31.467875] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-09T18:35:31.515016] [INFO ] [REMOTE ] ECAT: Full fetch complete (42898 records). [2025-10-09T18:35:31.539618] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-09T18:35:31.628804] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-09T18:35:31.639883] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-09T18:35:31.659622] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-09T18:35:31.662078] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-09T18:35:31.722400] [DEBUG] [LOCAL ] ECC: Trimmed 60989 records to 43399 (keeping 200 days of data) [2025-10-09T18:35:31.821078] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T18:35:32.002563] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-09T18:35:32.050977] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-09T18:35:32.051361] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-09T18:35:32.052056] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-09T18:35:32.052363] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-09T18:35:32.063388] [DEBUG] [LOCAL ] ECAT: Trimmed 42898 records to 29593 (keeping 200 days of data) [2025-10-09T18:35:32.355077] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T18:35:32.370719] [DEBUG] [LOCAL ] ECAT: Primary data saved (29593 records). [2025-10-09T18:35:32.371686] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-09T18:35:32.376026] [INFO ] [MAIN ] Update Progress: 686/2373 symbols completed. ECAT took 39.3s. Estimated remaining: 3h 54m 48s. Rate: 7.2 symbols/min [2025-10-09T18:35:32.597639] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:32.600950] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-09T18:35:32.601039] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-09T18:35:32.607146] [DEBUG] [LOCAL ] ECC: Primary data saved (43399 records). [2025-10-09T18:35:32.607673] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-09T18:35:32.607969] [INFO ] [MAIN ] Update Progress: 687/2373 symbols completed. ECC took 35.3s. Estimated remaining: 3h 54m 20s. Rate: 7.2 symbols/min [2025-10-09T18:35:32.607771] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-09T18:35:32.640911] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-09T18:35:32.641017] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-09T18:35:32.641086] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-09T18:35:32.815613] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-09T18:35:33.098531] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:33.120532] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-09T18:35:33.120615] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-09T18:35:33.126601] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-09T18:35:33.131851] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-09T18:35:33.142245] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-09T18:35:33.147472] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-09T18:35:33.313806] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:33.342462] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T18:35:33.594416] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:33.596673] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-09T18:35:34.234916] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T18:35:34.396721] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-09T18:35:34.786053] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-09T18:35:35.196735] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-09T18:35:35.505478] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-09T18:35:35.996771] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-09T18:35:36.405615] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T18:35:36.406351] [INFO ] [REMOTE ] ECCC: Full fetch complete (1304 records). [2025-10-09T18:35:36.406420] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-09T18:35:36.584259] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-09T18:35:36.584533] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:35:36.584622] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:35:36.584733] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-09T18:35:36.584822] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-09T18:35:36.584874] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-09T18:35:36.584943] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-09T18:35:36.585007] [INFO ] [MAIN ] Update Progress: 688/2373 symbols completed. ECCC took 36.1s. Estimated remaining: 3h 54m 1s. Rate: 7.2 symbols/min [2025-10-09T18:35:36.755420] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:36.791052] [DEBUG] [LOCAL ] ECG: Loaded 33381 existing records from primary storage. [2025-10-09T18:35:36.791377] [INFO ] [MAIN ] ECG: Loaded 33381 existing records. [2025-10-09T18:35:36.802313] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-09T18:35:36.977769] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:35:36.978035] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-09T18:35:36.978083] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-09T18:35:36.978335] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-09T18:35:36.978394] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-09T18:35:37.342914] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:37.381541] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T18:35:37.596740] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-09T18:35:38.022568] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T18:35:38.396734] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-09T18:35:38.984278] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T18:35:39.196743] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-09T18:35:39.451870] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-09T18:35:39.996729] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-09T18:35:40.291937] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-09T18:35:40.796735] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-09T18:35:41.108425] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-09T18:35:41.596747] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-09T18:35:42.013628] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:35:42.396724] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-09T18:35:43.196728] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-09T18:35:43.858784] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T18:35:43.996715] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-09T18:35:44.393323] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-09T18:35:44.796810] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-09T18:35:44.983956] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-09T18:35:45.245105] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:35:45.596764] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-09T18:35:46.037670] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T18:35:46.396691] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-09T18:35:46.660400] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-09T18:35:47.196797] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-09T18:35:47.697775] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T18:35:47.996728] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-09T18:35:48.572544] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T18:35:48.573278] [INFO ] [REMOTE ] ECCU: Full fetch complete (4450 records). [2025-10-09T18:35:48.573347] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-09T18:35:48.806001] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-09T18:35:48.930203] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-09T18:35:48.930315] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-09T18:35:48.930501] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-09T18:35:48.930562] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-09T18:35:48.930974] [DEBUG] [LOCAL ] ECCU: Trimmed 4450 records to 2264 (keeping 200 days of data) [2025-10-09T18:35:48.946923] [DEBUG] [LOCAL ] ECCU: Primary data saved (2264 records). [2025-10-09T18:35:48.947059] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-09T18:35:48.947147] [INFO ] [MAIN ] Update Progress: 689/2373 symbols completed. ECCU took 29.4s. Estimated remaining: 3h 54m 2s. Rate: 7.2 symbols/min [2025-10-09T18:35:49.116697] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:49.166860] [DEBUG] [LOCAL ] ECL: Loaded 46683 existing records from primary storage. [2025-10-09T18:35:49.167220] [INFO ] [MAIN ] ECL: Loaded 46683 existing records. [2025-10-09T18:35:49.272409] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T18:35:49.357222] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:35:49.357459] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-09T18:35:49.357509] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-09T18:35:49.357912] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-09T18:35:49.357972] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-09T18:35:49.601938] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-09T18:35:49.717952] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:49.975158] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-09T18:35:50.396731] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-09T18:35:50.689821] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-09T18:35:51.196724] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-09T18:35:51.588670] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-09T18:35:51.589384] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-09T18:35:51.589455] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-09T18:35:51.771857] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-09T18:35:51.772053] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:35:51.772123] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:35:51.772213] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-09T18:35:51.772293] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-09T18:35:51.772349] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-09T18:35:51.772416] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-09T18:35:51.772525] [INFO ] [MAIN ] Update Progress: 690/2373 symbols completed. ECCW took 19.4s. Estimated remaining: 3h 53m 41s. Rate: 7.2 symbols/min [2025-10-09T18:35:51.945834] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:35:51.968724] [DEBUG] [LOCAL ] ECO: Loaded 18349 existing records from primary storage. [2025-10-09T18:35:51.968997] [INFO ] [MAIN ] ECO: Loaded 18349 existing records. [2025-10-09T18:35:52.001800] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-09T18:35:52.184579] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:35:52.184861] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-09T18:35:52.184910] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-09T18:35:52.185494] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-09T18:35:52.185554] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-09T18:35:52.552731] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:35:52.796726] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-09T18:35:53.287929] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T18:35:53.596731] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-09T18:35:53.984929] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T18:35:53.988559] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T18:35:54.396708] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-09T18:35:55.196722] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-09T18:35:55.453100] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-09T18:35:55.470342] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T18:35:55.996731] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-09T18:35:56.352781] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T18:35:56.796719] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-09T18:35:57.596728] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-09T18:35:58.171962] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T18:35:58.396694] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-09T18:35:58.758078] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-09T18:35:59.196774] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-09T18:35:59.511046] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T18:35:59.996794] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-09T18:36:00.409064] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T18:36:00.796803] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-09T18:36:01.596728] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-09T18:36:01.890539] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T18:36:02.360606] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T18:36:02.396764] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-09T18:36:03.142407] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:36:03.196670] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-09T18:36:03.607082] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T18:36:03.996752] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-09T18:36:04.711846] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T18:36:04.796773] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-09T18:36:05.598528] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T18:36:05.598426] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-09T18:36:05.643328] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T18:36:06.396790] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-09T18:36:06.550781] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T18:36:06.737016] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-09T18:36:07.196732] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-09T18:36:07.996697] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-09T18:36:08.030891] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T18:36:08.418681] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-09T18:36:08.419390] [INFO ] [REMOTE ] ECCX: Full fetch complete (1450 records). [2025-10-09T18:36:08.419459] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-09T18:36:08.613821] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-09T18:36:08.614065] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:36:08.614150] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:36:08.614229] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-09T18:36:08.614294] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-09T18:36:08.614329] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-09T18:36:08.614368] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-09T18:36:08.614454] [INFO ] [MAIN ] Update Progress: 691/2373 symbols completed. ECCX took 36.0s. Estimated remaining: 3h 53m 53s. Rate: 7.2 symbols/min [2025-10-09T18:36:08.805154] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:08.802162] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-09T18:36:08.845509] [DEBUG] [LOCAL ] ECVT: Loaded 43281 existing records from primary storage. [2025-10-09T18:36:08.845867] [INFO ] [MAIN ] ECVT: Loaded 43281 existing records. [2025-10-09T18:36:09.024950] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:09.025221] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-09T18:36:09.025272] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-09T18:36:09.026561] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-09T18:36:09.026623] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-09T18:36:09.419096] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:09.596724] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-09T18:36:10.051453] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T18:36:10.396720] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-09T18:36:11.196691] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-09T18:36:11.322298] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T18:36:11.429713] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-09T18:36:11.996732] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-09T18:36:12.476834] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T18:36:12.796721] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-09T18:36:12.993069] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T18:36:13.596694] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-09T18:36:13.820371] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-09T18:36:14.396709] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-09T18:36:15.167499] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T18:36:15.196674] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-09T18:36:15.365076] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T18:36:15.996771] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-09T18:36:16.581427] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T18:36:16.796696] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-09T18:36:16.911551] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T18:36:17.596687] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-09T18:36:17.984120] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T18:36:18.396752] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-09T18:36:18.580072] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T18:36:19.196765] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-09T18:36:19.996766] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-09T18:36:20.045929] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T18:36:20.440937] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:36:20.443428] [INFO ] [REMOTE ] ECG: Full fetch complete (50626 records). [2025-10-09T18:36:20.443508] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-09T18:36:20.444143] [FATAL] [VALIDATOR ] ECG: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:36:20.444245] [FATAL] [MAIN ] ECG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:36:20.444297] [WARN ] [MAIN ] ECG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:36:20.444367] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-09T18:36:20.444430] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-10-09T18:36:20.444468] [INFO ] [LOCAL ] ECG: Starting deletion of derivative data. [2025-10-09T18:36:20.444730] [DEBUG] [LOCAL ] ECG: Deleted derivative data file. [2025-10-09T18:36:20.444833] [INFO ] [MAIN ] Update Progress: 692/2373 symbols completed. ECG took 43.9s. Estimated remaining: 3h 53m 53s. Rate: 7.2 symbols/min [2025-10-09T18:36:20.612079] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:20.664380] [DEBUG] [LOCAL ] ED: Loaded 52710 existing records from primary storage. [2025-10-09T18:36:20.664885] [INFO ] [MAIN ] ED: Loaded 52710 existing records. [2025-10-09T18:36:20.803103] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-09T18:36:20.844427] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:20.844700] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-09T18:36:20.844816] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-09T18:36:20.846797] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-09T18:36:20.846859] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-09T18:36:21.130989] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:36:21.154073] [INFO ] [REMOTE ] ECO: Full fetch complete (28570 records). [2025-10-09T18:36:21.171976] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-09T18:36:21.279816] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:21.582167] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-09T18:36:21.582240] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-09T18:36:21.582721] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-09T18:36:21.582782] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-09T18:36:21.583474] [DEBUG] [LOCAL ] ECO: Trimmed 28570 records to 18474 (keeping 200 days of data) [2025-10-09T18:36:21.630953] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-09T18:36:21.697453] [DEBUG] [LOCAL ] ECO: Primary data saved (18474 records). [2025-10-09T18:36:21.697570] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-09T18:36:21.697668] [INFO ] [MAIN ] Update Progress: 693/2373 symbols completed. ECO took 29.9s. Estimated remaining: 3h 53m 28s. Rate: 7.2 symbols/min [2025-10-09T18:36:21.864808] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:21.890147] [DEBUG] [LOCAL ] EDD: Loaded 26944 existing records from primary storage. [2025-10-09T18:36:21.890389] [INFO ] [MAIN ] EDD: Loaded 26944 existing records. [2025-10-09T18:36:22.070365] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:22.070706] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-09T18:36:22.070766] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-09T18:36:22.071004] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-09T18:36:22.071062] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-09T18:36:22.404794] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-09T18:36:22.437336] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:22.473821] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:36:23.196744] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-09T18:36:23.660329] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T18:36:23.699785] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T18:36:23.996794] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-09T18:36:24.344926] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T18:36:24.796735] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-09T18:36:25.564280] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T18:36:25.596678] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-09T18:36:26.319639] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T18:36:26.396718] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-09T18:36:26.711491] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T18:36:27.196716] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-09T18:36:27.805265] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:36:27.996682] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-09T18:36:28.335741] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T18:36:28.796697] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-09T18:36:29.596685] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-09T18:36:29.864592] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T18:36:30.176435] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T18:36:30.396733] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-09T18:36:30.610890] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T18:36:31.196762] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-09T18:36:31.996694] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-09T18:36:32.288792] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T18:36:32.316320] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:36:32.796766] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-09T18:36:33.435538] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T18:36:33.596691] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-09T18:36:34.309973] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T18:36:34.396730] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-09T18:36:35.082000] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T18:36:35.196728] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-09T18:36:35.931966] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T18:36:35.996694] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-09T18:36:36.645502] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T18:36:36.796721] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-09T18:36:37.460705] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T18:36:37.464461] [INFO ] [REMOTE ] ECVT: Full fetch complete (60114 records). [2025-10-09T18:36:37.464578] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-09T18:36:37.605727] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-09T18:36:37.862796] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-09T18:36:37.862877] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-09T18:36:37.863781] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-09T18:36:37.863849] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-09T18:36:37.865177] [DEBUG] [LOCAL ] ECVT: Trimmed 60114 records to 43520 (keeping 200 days of data) [2025-10-09T18:36:38.131144] [DEBUG] [LOCAL ] ECVT: Primary data saved (43520 records). [2025-10-09T18:36:38.131279] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-09T18:36:38.131359] [INFO ] [MAIN ] Update Progress: 694/2373 symbols completed. ECVT took 29.5s. Estimated remaining: 3h 53m 39s. Rate: 7.2 symbols/min [2025-10-09T18:36:38.301694] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:38.315147] [DEBUG] [LOCAL ] EDF: Loaded 13210 existing records from primary storage. [2025-10-09T18:36:38.315348] [INFO ] [MAIN ] EDF: Loaded 13210 existing records. [2025-10-09T18:36:38.406006] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-09T18:36:38.519709] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:38.520290] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-09T18:36:38.520376] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-09T18:36:38.521158] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-09T18:36:38.521240] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-09T18:36:38.864682] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:36:39.046157] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:39.049424] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-09T18:36:39.196731] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-09T18:36:39.651405] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T18:36:39.996780] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-09T18:36:40.796732] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-09T18:36:40.992262] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T18:36:41.200261] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T18:36:41.596782] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-09T18:36:41.862204] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T18:36:42.396772] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-09T18:36:43.196761] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-09T18:36:43.311028] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T18:36:43.924085] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T18:36:43.961418] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T18:36:43.996673] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-09T18:36:44.796682] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-09T18:36:44.955963] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T18:36:45.596743] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-09T18:36:46.396751] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-09T18:36:46.495278] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T18:36:46.499873] [INFO ] [REMOTE ] ED: Full fetch complete (76297 records). [2025-10-09T18:36:46.499991] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-09T18:36:46.684739] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T18:36:46.945607] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-09T18:36:46.945749] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-09T18:36:46.951519] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-09T18:36:46.955096] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-09T18:36:46.956113] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T18:36:46.960742] [DEBUG] [LOCAL ] ED: Trimmed 76297 records to 53094 (keeping 200 days of data) [2025-10-09T18:36:47.197138] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-09T18:36:47.294608] [DEBUG] [LOCAL ] ED: Primary data saved (53094 records). [2025-10-09T18:36:47.294770] [INFO ] [MAIN ] ED: Full history saved. [2025-10-09T18:36:47.296895] [INFO ] [MAIN ] Update Progress: 695/2373 symbols completed. ED took 26.9s. Estimated remaining: 3h 53m 32s. Rate: 7.2 symbols/min [2025-10-09T18:36:47.469723] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:47.490192] [DEBUG] [LOCAL ] EDN: Loaded 18262 existing records from primary storage. [2025-10-09T18:36:47.490433] [INFO ] [MAIN ] EDN: Loaded 18262 existing records. [2025-10-09T18:36:47.674724] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:47.674991] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-09T18:36:47.675040] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-09T18:36:47.675264] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-09T18:36:47.675321] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-09T18:36:48.004956] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-09T18:36:48.047484] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:48.214239] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T18:36:48.796744] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-09T18:36:49.129019] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T18:36:49.596772] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-09T18:36:50.104843] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T18:36:50.108978] [INFO ] [REMOTE ] ECL: Full fetch complete (68016 records). [2025-10-09T18:36:50.109105] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-09T18:36:50.401973] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-09T18:36:50.500877] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-09T18:36:50.500977] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-09T18:36:50.501877] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-09T18:36:50.501957] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-09T18:36:50.503292] [DEBUG] [LOCAL ] ECL: Trimmed 68016 records to 46987 (keeping 200 days of data) [2025-10-09T18:36:50.818376] [DEBUG] [LOCAL ] ECL: Primary data saved (46987 records). [2025-10-09T18:36:50.818536] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-09T18:36:50.820047] [INFO ] [MAIN ] Update Progress: 696/2373 symbols completed. ECL took 1m 2s. Estimated remaining: 3h 53m 13s. Rate: 7.2 symbols/min [2025-10-09T18:36:50.993780] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:36:51.037831] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T18:36:51.058065] [DEBUG] [LOCAL ] EDU: Loaded 44849 existing records from primary storage. [2025-10-09T18:36:51.058391] [INFO ] [MAIN ] EDU: Loaded 44849 existing records. [2025-10-09T18:36:51.201616] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-09T18:36:51.242845] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:36:51.244018] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-09T18:36:51.244167] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-09T18:36:51.244925] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-09T18:36:51.245006] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-09T18:36:51.358813] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T18:36:51.616157] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:36:51.996718] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-09T18:36:52.349476] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T18:36:52.796742] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-09T18:36:53.552439] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:36:53.579772] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-09T18:36:53.596804] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-09T18:36:54.396737] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-09T18:36:54.791977] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T18:36:55.196717] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-09T18:36:55.969359] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T18:36:55.996667] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-09T18:36:56.060415] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T18:36:56.548021] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T18:36:56.796715] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-09T18:36:57.596694] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-09T18:36:57.930178] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T18:36:58.396781] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-09T18:36:58.790064] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T18:36:59.196749] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-09T18:36:59.978740] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T18:36:59.996674] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-09T18:37:00.034088] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T18:37:00.796735] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-09T18:37:01.596739] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-09T18:37:01.668117] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:37:01.711744] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T18:37:02.396788] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-09T18:37:02.939268] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T18:37:03.196733] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-09T18:37:03.498744] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T18:37:03.996780] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-09T18:37:04.351391] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T18:37:04.354272] [INFO ] [REMOTE ] EDD: Full fetch complete (38517 records). [2025-10-09T18:37:04.354367] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-09T18:37:04.732890] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-09T18:37:04.733007] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-09T18:37:04.733634] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-09T18:37:04.733724] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-09T18:37:04.734753] [DEBUG] [LOCAL ] EDD: Trimmed 38517 records to 27133 (keeping 200 days of data) [2025-10-09T18:37:04.817998] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-09T18:37:04.896042] [DEBUG] [LOCAL ] EDD: Primary data saved (27133 records). [2025-10-09T18:37:04.896187] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-09T18:37:04.896268] [INFO ] [MAIN ] Update Progress: 697/2373 symbols completed. EDD took 43.2s. Estimated remaining: 3h 53m 18s. Rate: 7.2 symbols/min [2025-10-09T18:37:05.077531] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T18:37:05.080783] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:05.117394] [DEBUG] [LOCAL ] EE: Loaded 32798 existing records from primary storage. [2025-10-09T18:37:05.117717] [INFO ] [MAIN ] EE: Loaded 32798 existing records. [2025-10-09T18:37:05.301888] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:37:05.302154] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-09T18:37:05.302207] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-09T18:37:05.302460] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-09T18:37:05.302517] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-09T18:37:05.601815] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-09T18:37:05.669832] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:05.672098] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T18:37:05.674276] [INFO ] [REMOTE ] EDF: Full fetch complete (20550 records). [2025-10-09T18:37:05.674364] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-09T18:37:06.117916] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-09T18:37:06.118032] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-09T18:37:06.118666] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-09T18:37:06.118752] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-09T18:37:06.119478] [DEBUG] [LOCAL ] EDF: Trimmed 20550 records to 13313 (keeping 200 days of data) [2025-10-09T18:37:06.209904] [DEBUG] [LOCAL ] EDF: Primary data saved (13313 records). [2025-10-09T18:37:06.210051] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-09T18:37:06.210134] [INFO ] [MAIN ] Update Progress: 698/2373 symbols completed. EDF took 28.1s. Estimated remaining: 3h 52m 53s. Rate: 7.2 symbols/min [2025-10-09T18:37:06.391430] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:06.391579] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-09T18:37:06.391615] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-09T18:37:06.391743] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-09T18:37:06.391784] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-09T18:37:06.391825] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-09T18:37:06.391861] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-09T18:37:06.402785] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-09T18:37:06.746757] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T18:37:06.765876] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:07.196729] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-09T18:37:07.983789] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T18:37:07.996704] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-09T18:37:08.172377] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T18:37:08.796734] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-09T18:37:09.596767] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-09T18:37:09.677110] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T18:37:09.802959] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T18:37:10.396686] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-09T18:37:10.679748] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T18:37:10.876634] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T18:37:11.196758] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-09T18:37:11.996755] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-09T18:37:12.796704] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-09T18:37:12.839255] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T18:37:13.101129] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-09T18:37:13.164109] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T18:37:13.596786] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-09T18:37:14.194088] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T18:37:14.396768] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-09T18:37:14.899186] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T18:37:15.196772] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-09T18:37:15.996773] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-09T18:37:16.276710] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T18:37:16.796754] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-09T18:37:16.973136] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:37:17.596747] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-09T18:37:18.322831] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T18:37:18.396667] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-09T18:37:18.777770] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T18:37:19.196683] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-09T18:37:19.635363] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T18:37:19.996754] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-09T18:37:20.413956] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T18:37:20.796771] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-09T18:37:21.596693] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-09T18:37:21.795133] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T18:37:21.986665] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T18:37:21.988881] [INFO ] [REMOTE ] EDN: Full fetch complete (29648 records). [2025-10-09T18:37:21.988956] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-09T18:37:22.371279] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-09T18:37:22.371369] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-09T18:37:22.371958] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-09T18:37:22.372185] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-09T18:37:22.373133] [DEBUG] [LOCAL ] EDN: Trimmed 29648 records to 18533 (keeping 200 days of data) [2025-10-09T18:37:22.423132] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-09T18:37:22.494965] [DEBUG] [LOCAL ] EDN: Primary data saved (18533 records). [2025-10-09T18:37:22.495098] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-09T18:37:22.495177] [INFO ] [MAIN ] Update Progress: 699/2373 symbols completed. EDN took 35.2s. Estimated remaining: 3h 53m 3s. Rate: 7.2 symbols/min [2025-10-09T18:37:22.638546] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:37:22.707016] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:22.718562] [DEBUG] [LOCAL ] EEX: Loaded 10841 existing records from primary storage. [2025-10-09T18:37:22.718818] [INFO ] [MAIN ] EEX: Loaded 10841 existing records. [2025-10-09T18:37:22.908399] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:37:22.908748] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-09T18:37:22.908804] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-09T18:37:22.909360] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-09T18:37:22.909441] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-09T18:37:23.202453] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-09T18:37:23.293532] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:23.830061] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T18:37:23.870183] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T18:37:23.996732] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-09T18:37:24.796762] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-09T18:37:25.113081] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T18:37:25.596774] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-09T18:37:26.150563] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T18:37:26.172017] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T18:37:26.396764] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-09T18:37:27.196707] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-09T18:37:27.957519] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:37:27.965121] [INFO ] [REMOTE ] EDU: Full fetch complete (66524 records). [2025-10-09T18:37:27.965257] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-09T18:37:28.001912] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-09T18:37:28.369044] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-09T18:37:28.369168] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-09T18:37:28.370032] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-09T18:37:28.370176] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-09T18:37:28.391017] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T18:37:28.398297] [DEBUG] [LOCAL ] EDU: Trimmed 66524 records to 45177 (keeping 200 days of data) [2025-10-09T18:37:28.604976] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-09T18:37:28.679607] [DEBUG] [LOCAL ] EDU: Primary data saved (45177 records). [2025-10-09T18:37:28.679777] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-09T18:37:28.681048] [INFO ] [MAIN ] Update Progress: 700/2373 symbols completed. EDU took 37.9s. Estimated remaining: 3h 52m 50s. Rate: 7.2 symbols/min [2025-10-09T18:37:28.801797] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-09T18:37:28.850705] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:28.850856] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-10-09T18:37:28.850899] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-10-09T18:37:28.851007] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-09T18:37:28.851050] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-09T18:37:28.851094] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-09T18:37:28.851127] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-09T18:37:29.205606] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:29.596689] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-09T18:37:29.627264] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-09T18:37:30.396735] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-09T18:37:30.611677] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T18:37:30.756791] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T18:37:31.196732] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-09T18:37:31.756619] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T18:37:31.996701] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-09T18:37:32.796795] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-09T18:37:33.596747] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-09T18:37:33.970429] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-09T18:37:34.031225] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T18:37:34.178426] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T18:37:34.396752] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-09T18:37:34.934639] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T18:37:34.935381] [INFO ] [REMOTE ] EEA: Full fetch complete (3861 records). [2025-10-09T18:37:34.935451] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-09T18:37:35.119852] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T18:37:35.120071] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:37:35.120158] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:37:35.120252] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-09T18:37:35.120330] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-09T18:37:35.120367] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-09T18:37:35.120423] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-09T18:37:35.120500] [INFO ] [MAIN ] Update Progress: 701/2373 symbols completed. EEA took 28.9s. Estimated remaining: 3h 52m 37s. Rate: 7.2 symbols/min [2025-10-09T18:37:35.201806] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-09T18:37:35.299464] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:35.315202] [DEBUG] [LOCAL ] EFR: Loaded 14966 existing records from primary storage. [2025-10-09T18:37:35.315422] [INFO ] [MAIN ] EFR: Loaded 14966 existing records. [2025-10-09T18:37:35.491220] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:37:35.491399] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-09T18:37:35.491447] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-09T18:37:35.492244] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-09T18:37:35.492305] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-09T18:37:35.842359] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:35.996676] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-09T18:37:36.391613] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T18:37:36.796774] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-09T18:37:37.071833] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T18:37:37.596774] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-09T18:37:37.703128] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T18:37:38.396717] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-09T18:37:38.872558] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:37:39.196707] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-09T18:37:39.552558] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:37:39.555484] [INFO ] [REMOTE ] EE: Full fetch complete (43844 records). [2025-10-09T18:37:39.555564] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-09T18:37:39.975091] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-09T18:37:39.975347] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-09T18:37:39.976036] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-09T18:37:39.976114] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-09T18:37:39.977151] [DEBUG] [LOCAL ] EE: Trimmed 43844 records to 33129 (keeping 200 days of data) [2025-10-09T18:37:40.031302] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-09T18:37:40.082593] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T18:37:40.193206] [DEBUG] [LOCAL ] EE: Primary data saved (33129 records). [2025-10-09T18:37:40.193336] [INFO ] [MAIN ] EE: Full history saved. [2025-10-09T18:37:40.193966] [INFO ] [MAIN ] Update Progress: 702/2373 symbols completed. EE took 35.3s. Estimated remaining: 3h 52m 21s. Rate: 7.2 symbols/min [2025-10-09T18:37:40.367978] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:37:40.383463] [DEBUG] [LOCAL ] EFT: Loaded 13144 existing records from primary storage. [2025-10-09T18:37:40.383718] [INFO ] [MAIN ] EFT: Loaded 13144 existing records. [2025-10-09T18:37:40.566535] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:37:40.566746] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-09T18:37:40.566800] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-09T18:37:40.567345] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-09T18:37:40.567404] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-09T18:37:40.677427] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T18:37:40.801865] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-09T18:37:40.942288] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:37:41.596723] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-09T18:37:41.636340] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T18:37:42.396740] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-09T18:37:42.879735] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T18:37:43.023183] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T18:37:43.196699] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-09T18:37:43.996702] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-09T18:37:44.438663] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:37:44.503768] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T18:37:44.796706] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-09T18:37:45.480462] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T18:37:45.596797] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-09T18:37:46.396736] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-09T18:37:47.171840] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T18:37:47.199975] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-09T18:37:47.202959] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T18:37:47.996780] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-09T18:37:48.677995] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T18:37:48.796686] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-09T18:37:48.869809] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T18:37:49.596726] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-09T18:37:50.107377] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T18:37:50.396682] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-09T18:37:50.498479] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T18:37:50.858809] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T18:37:51.196716] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-09T18:37:51.996719] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-09T18:37:52.773152] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T18:37:52.796668] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-09T18:37:52.931978] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T18:37:53.596721] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-09T18:37:54.166679] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T18:37:54.396738] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-09T18:37:54.624563] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T18:37:55.117537] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T18:37:55.196665] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-09T18:37:55.996669] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-09T18:37:56.015017] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T18:37:56.796777] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-09T18:37:57.493161] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T18:37:57.596677] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-09T18:37:57.925308] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T18:37:58.264923] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T18:37:58.396718] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-09T18:37:59.196747] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-09T18:37:59.371194] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T18:37:59.953614] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T18:37:59.954829] [INFO ] [REMOTE ] EEX: Full fetch complete (18904 records). [2025-10-09T18:37:59.954899] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-09T18:38:00.007048] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-09T18:38:00.316609] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-09T18:38:00.316714] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-09T18:38:00.317060] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-09T18:38:00.317099] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-09T18:38:00.317614] [DEBUG] [LOCAL ] EEX: Trimmed 18904 records to 10865 (keeping 200 days of data) [2025-10-09T18:38:00.392389] [DEBUG] [LOCAL ] EEX: Primary data saved (10865 records). [2025-10-09T18:38:00.392541] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-09T18:38:00.392631] [INFO ] [MAIN ] Update Progress: 703/2373 symbols completed. EEX took 37.9s. Estimated remaining: 3h 52m 41s. Rate: 7.2 symbols/min [2025-10-09T18:38:00.558893] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:00.602707] [DEBUG] [LOCAL ] EFX: Loaded 44556 existing records from primary storage. [2025-10-09T18:38:00.602997] [INFO ] [MAIN ] EFX: Loaded 44556 existing records. [2025-10-09T18:38:00.784089] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:00.784297] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-09T18:38:00.784352] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-09T18:38:00.785692] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-09T18:38:00.785752] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-09T18:38:00.806005] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-09T18:38:01.092536] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T18:38:01.174383] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:01.596792] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-09T18:38:02.353937] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T18:38:02.358105] [INFO ] [REMOTE ] EFC: Full fetch complete (66312 records). [2025-10-09T18:38:02.358214] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-09T18:38:02.359169] [FATAL] [VALIDATOR ] EFC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:38:02.359258] [FATAL] [MAIN ] EFC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:38:02.359328] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:38:02.359403] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-09T18:38:02.359469] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-09T18:38:02.359506] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-10-09T18:38:02.359552] [DEBUG] [LOCAL ] EFC: No derivative data file found to delete. [2025-10-09T18:38:02.359612] [INFO ] [MAIN ] Update Progress: 704/2373 symbols completed. EFC took 33.7s. Estimated remaining: 3h 52m 17s. Rate: 7.2 symbols/min [2025-10-09T18:38:02.401951] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-09T18:38:02.506548] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T18:38:02.570314] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:02.599693] [DEBUG] [LOCAL ] EFXT: Loaded 29343 existing records from primary storage. [2025-10-09T18:38:02.599956] [INFO ] [MAIN ] EFXT: Loaded 29343 existing records. [2025-10-09T18:38:02.776146] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:02.776397] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-09T18:38:02.776471] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-09T18:38:02.777271] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-09T18:38:02.777332] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-09T18:38:03.139379] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:03.196726] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-09T18:38:03.929512] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:38:03.996673] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-09T18:38:04.606385] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T18:38:04.796730] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-09T18:38:05.532608] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T18:38:05.596690] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-09T18:38:05.873069] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T18:38:06.396748] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-09T18:38:06.997733] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T18:38:07.196686] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-09T18:38:07.343963] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T18:38:07.855316] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T18:38:07.996717] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-09T18:38:08.796771] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-09T18:38:08.853147] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T18:38:09.596723] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-09T18:38:10.134736] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T18:38:10.396724] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-09T18:38:10.617719] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T18:38:11.196718] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-09T18:38:11.615013] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T18:38:11.873584] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-09T18:38:11.875371] [INFO ] [REMOTE ] EFT: Full fetch complete (17964 records). [2025-10-09T18:38:11.875463] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-09T18:38:12.001815] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-09T18:38:12.250267] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-09T18:38:12.250349] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-09T18:38:12.250748] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-09T18:38:12.250815] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-09T18:38:12.251350] [DEBUG] [LOCAL ] EFT: Trimmed 17964 records to 13215 (keeping 200 days of data) [2025-10-09T18:38:12.332050] [DEBUG] [LOCAL ] EFT: Primary data saved (13215 records). [2025-10-09T18:38:12.332194] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-09T18:38:12.332276] [INFO ] [MAIN ] Update Progress: 705/2373 symbols completed. EFT took 32.1s. Estimated remaining: 3h 52m 13s. Rate: 7.2 symbols/min [2025-10-09T18:38:12.505456] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:12.531673] [DEBUG] [LOCAL ] EG: Loaded 27804 existing records from primary storage. [2025-10-09T18:38:12.531947] [INFO ] [MAIN ] EG: Loaded 27804 existing records. [2025-10-09T18:38:12.716062] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:12.716339] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-09T18:38:12.716405] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-09T18:38:12.717351] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-09T18:38:12.717412] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-09T18:38:12.801948] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-09T18:38:13.038774] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T18:38:13.067208] [INFO ] [REMOTE ] EFR: Full fetch complete (19161 records). [2025-10-09T18:38:13.097019] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-09T18:38:13.153253] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:13.481326] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-09T18:38:13.481407] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-09T18:38:13.481823] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-09T18:38:13.481935] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-09T18:38:13.482537] [DEBUG] [LOCAL ] EFR: Trimmed 19161 records to 15071 (keeping 200 days of data) [2025-10-09T18:38:13.572721] [DEBUG] [LOCAL ] EFR: Primary data saved (15071 records). [2025-10-09T18:38:13.572860] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-09T18:38:13.572939] [INFO ] [MAIN ] Update Progress: 706/2373 symbols completed. EFR took 38.5s. Estimated remaining: 3h 51m 47s. Rate: 7.2 symbols/min [2025-10-09T18:38:13.602240] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-09T18:38:13.743389] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:13.743558] [DEBUG] [LOCAL ] EGO: No existing data file found in primary storage. [2025-10-09T18:38:13.743596] [WARN ] [MAIN ] EGO: No existing data found, performing full refresh instead. [2025-10-09T18:38:13.743728] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-09T18:38:13.743772] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-09T18:38:13.743814] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-09T18:38:13.743911] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-09T18:38:14.094925] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:14.403782] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-09T18:38:14.423004] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T18:38:14.818505] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T18:38:15.196749] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-09T18:38:15.829790] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T18:38:15.996756] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-09T18:38:16.791836] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T18:38:16.798010] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-09T18:38:17.512662] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:38:17.596735] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-09T18:38:17.941192] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T18:38:18.396750] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-09T18:38:18.598343] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T18:38:19.196778] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-09T18:38:19.573157] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T18:38:19.996710] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-09T18:38:20.796721] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-09T18:38:20.823231] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T18:38:21.304324] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T18:38:21.596680] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-09T18:38:21.941216] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T18:38:22.396785] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-09T18:38:22.984318] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T18:38:23.196693] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-09T18:38:23.872939] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T18:38:23.996675] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-09T18:38:24.685236] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T18:38:24.796688] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-09T18:38:25.596830] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-09T18:38:25.832951] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T18:38:26.396717] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-09T18:38:26.612501] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T18:38:26.908430] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T18:38:27.196723] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-09T18:38:27.393296] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T18:38:27.996738] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-09T18:38:28.552000] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T18:38:28.796716] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-09T18:38:29.319099] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T18:38:29.596691] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-09T18:38:29.807512] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T18:38:30.396761] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-09T18:38:30.702324] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T18:38:31.196705] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-09T18:38:31.564930] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T18:38:31.996738] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-09T18:38:32.711082] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T18:38:32.796695] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-09T18:38:32.941197] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T18:38:33.596713] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-09T18:38:34.338960] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T18:38:34.396682] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-09T18:38:34.714960] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T18:38:35.196713] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-09T18:38:35.712735] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T18:38:35.996754] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-09T18:38:36.376974] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T18:38:36.380142] [INFO ] [REMOTE ] EFXT: Full fetch complete (43993 records). [2025-10-09T18:38:36.380229] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-09T18:38:36.762207] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-09T18:38:36.762293] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-09T18:38:36.762904] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-09T18:38:36.762973] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-09T18:38:36.763913] [DEBUG] [LOCAL ] EFXT: Trimmed 43993 records to 29630 (keeping 200 days of data) [2025-10-09T18:38:36.819633] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-09T18:38:36.945624] [DEBUG] [LOCAL ] EFXT: Primary data saved (29630 records). [2025-10-09T18:38:36.945794] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-09T18:38:36.945968] [INFO ] [MAIN ] Update Progress: 707/2373 symbols completed. EFXT took 34.6s. Estimated remaining: 3h 52m 15s. Rate: 7.2 symbols/min [2025-10-09T18:38:37.112420] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:37.142917] [DEBUG] [LOCAL ] EGP: Loaded 30646 existing records from primary storage. [2025-10-09T18:38:37.143181] [INFO ] [MAIN ] EGP: Loaded 30646 existing records. [2025-10-09T18:38:37.321373] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:37.321730] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-09T18:38:37.321816] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-09T18:38:37.322934] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-09T18:38:37.322995] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-09T18:38:37.601387] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-09T18:38:37.675928] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T18:38:37.721164] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:38.235851] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T18:38:38.396696] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-09T18:38:38.720848] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T18:38:39.196702] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-09T18:38:39.740244] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T18:38:39.996735] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-09T18:38:40.796708] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-09T18:38:40.884296] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T18:38:40.888390] [INFO ] [REMOTE ] EFX: Full fetch complete (64497 records). [2025-10-09T18:38:40.888537] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-09T18:38:41.274786] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-09T18:38:41.274955] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-09T18:38:41.275893] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-09T18:38:41.275975] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-09T18:38:41.277338] [DEBUG] [LOCAL ] EFX: Trimmed 64497 records to 44924 (keeping 200 days of data) [2025-10-09T18:38:41.412550] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T18:38:41.602778] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-09T18:38:41.621471] [DEBUG] [LOCAL ] EFX: Primary data saved (44924 records). [2025-10-09T18:38:41.621602] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-09T18:38:41.621729] [INFO ] [MAIN ] Update Progress: 708/2373 symbols completed. EFX took 41.2s. Estimated remaining: 3h 51m 57s. Rate: 7.2 symbols/min [2025-10-09T18:38:41.813264] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:41.869819] [DEBUG] [LOCAL ] EGY: Loaded 41770 existing records from primary storage. [2025-10-09T18:38:41.870863] [INFO ] [MAIN ] EGY: Loaded 41770 existing records. [2025-10-09T18:38:41.871395] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T18:38:42.059959] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:42.060179] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-09T18:38:42.060230] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-09T18:38:42.061247] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-09T18:38:42.061348] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-09T18:38:42.403167] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-09T18:38:42.434475] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:42.950394] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T18:38:43.196749] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-09T18:38:43.852744] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T18:38:43.996692] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-09T18:38:44.749523] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:38:44.796707] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-09T18:38:45.394065] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T18:38:45.596755] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-09T18:38:45.937028] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T18:38:45.939929] [INFO ] [REMOTE ] EG: Full fetch complete (43252 records). [2025-10-09T18:38:45.940096] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-09T18:38:46.336079] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-09T18:38:46.336193] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-09T18:38:46.337044] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-09T18:38:46.337112] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-09T18:38:46.338178] [DEBUG] [LOCAL ] EG: Trimmed 43252 records to 28013 (keeping 200 days of data) [2025-10-09T18:38:46.404567] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-09T18:38:46.520852] [DEBUG] [LOCAL ] EG: Primary data saved (28013 records). [2025-10-09T18:38:46.521030] [INFO ] [MAIN ] EG: Full history saved. [2025-10-09T18:38:46.521127] [INFO ] [MAIN ] Update Progress: 709/2373 symbols completed. EG took 34.2s. Estimated remaining: 3h 51m 41s. Rate: 7.2 symbols/min [2025-10-09T18:38:46.688258] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:46.715766] [DEBUG] [LOCAL ] EHAB: Loaded 29327 existing records from primary storage. [2025-10-09T18:38:46.716095] [INFO ] [MAIN ] EHAB: Loaded 29327 existing records. [2025-10-09T18:38:46.898985] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:46.899315] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-09T18:38:46.899496] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-09T18:38:46.900328] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-09T18:38:46.900393] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-09T18:38:47.027242] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T18:38:47.201916] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-09T18:38:47.296318] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:47.720577] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T18:38:47.996692] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-09T18:38:48.796817] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-09T18:38:49.007099] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T18:38:49.202037] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T18:38:49.596724] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-09T18:38:49.736112] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T18:38:50.396753] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-09T18:38:51.196769] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-09T18:38:51.320999] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T18:38:51.325876] [INFO ] [REMOTE ] EGO: Full fetch complete (73939 records). [2025-10-09T18:38:51.325996] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-09T18:38:51.769905] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-09T18:38:51.770056] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-09T18:38:51.776556] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-09T18:38:51.786762] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-09T18:38:51.788330] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T18:38:51.795531] [DEBUG] [LOCAL ] EGO: Trimmed 73939 records to 52063 (keeping 200 days of data) [2025-10-09T18:38:51.999930] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-09T18:38:52.110270] [DEBUG] [LOCAL ] EGO: Primary data saved (52063 records). [2025-10-09T18:38:52.110418] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-09T18:38:52.110494] [INFO ] [MAIN ] Update Progress: 710/2373 symbols completed. EGO took 38.5s. Estimated remaining: 3h 51m 26s. Rate: 7.2 symbols/min [2025-10-09T18:38:52.276202] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:38:52.323623] [DEBUG] [LOCAL ] EHC: Loaded 41177 existing records from primary storage. [2025-10-09T18:38:52.324156] [INFO ] [MAIN ] EHC: Loaded 41177 existing records. [2025-10-09T18:38:52.508902] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:38:52.509273] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-09T18:38:52.509479] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-09T18:38:52.510879] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-09T18:38:52.510941] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-09T18:38:52.812424] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-09T18:38:52.868019] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:38:52.921184] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:38:52.935973] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T18:38:53.596737] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-09T18:38:53.913152] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T18:38:54.396806] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-09T18:38:55.196747] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-09T18:38:55.306068] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T18:38:55.843187] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T18:38:55.996747] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-09T18:38:56.317830] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T18:38:56.796706] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-09T18:38:57.128378] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T18:38:57.596681] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-09T18:38:57.778741] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T18:38:58.396753] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-09T18:38:59.054933] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:38:59.196689] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-09T18:38:59.465511] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T18:38:59.996718] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-09T18:39:00.435542] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T18:39:00.796723] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-09T18:39:01.197332] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T18:39:01.596792] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-09T18:39:02.238921] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T18:39:02.396761] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-09T18:39:02.642926] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T18:39:02.645575] [INFO ] [REMOTE ] EGP: Full fetch complete (45348 records). [2025-10-09T18:39:02.645729] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-09T18:39:03.040297] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-09T18:39:03.040380] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-09T18:39:03.041064] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-09T18:39:03.041130] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-09T18:39:03.042296] [DEBUG] [LOCAL ] EGP: Trimmed 45348 records to 30837 (keeping 200 days of data) [2025-10-09T18:39:03.201629] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-09T18:39:03.243567] [DEBUG] [LOCAL ] EGP: Primary data saved (30837 records). [2025-10-09T18:39:03.243746] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-09T18:39:03.244994] [INFO ] [MAIN ] Update Progress: 711/2373 symbols completed. EGP took 26.3s. Estimated remaining: 3h 51m 24s. Rate: 7.2 symbols/min [2025-10-09T18:39:03.418150] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:03.430853] [DEBUG] [LOCAL ] EHI: Loaded 10705 existing records from primary storage. [2025-10-09T18:39:03.431118] [INFO ] [MAIN ] EHI: Loaded 10705 existing records. [2025-10-09T18:39:03.641395] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:39:03.641683] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-09T18:39:03.641743] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-09T18:39:03.657294] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-09T18:39:03.657381] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-09T18:39:03.744319] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T18:39:04.001859] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-09T18:39:04.029370] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:04.796687] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-09T18:39:04.903499] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T18:39:05.037690] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T18:39:05.596697] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-09T18:39:05.850748] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T18:39:06.396758] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-09T18:39:07.043955] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T18:39:07.196769] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-09T18:39:07.225392] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:39:07.996777] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-09T18:39:08.523369] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T18:39:08.796774] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-09T18:39:09.157261] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T18:39:09.596724] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-09T18:39:09.948005] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T18:39:10.396721] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-09T18:39:10.470353] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T18:39:11.196747] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-09T18:39:11.996980] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-09T18:39:11.999576] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T18:39:12.653521] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T18:39:12.796714] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-09T18:39:13.171293] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:39:13.596778] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-09T18:39:14.249851] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T18:39:14.396743] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-09T18:39:14.545335] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-09T18:39:15.196709] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-09T18:39:15.736890] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:39:15.996734] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-09T18:39:16.340321] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T18:39:16.343767] [INFO ] [REMOTE ] EGY: Full fetch complete (61086 records). [2025-10-09T18:39:16.343868] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-09T18:39:16.724345] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-09T18:39:16.724431] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-09T18:39:16.725235] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-09T18:39:16.725301] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-09T18:39:16.726554] [DEBUG] [LOCAL ] EGY: Trimmed 61086 records to 42030 (keeping 200 days of data) [2025-10-09T18:39:16.809986] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-09T18:39:16.977503] [DEBUG] [LOCAL ] EGY: Primary data saved (42030 records). [2025-10-09T18:39:16.977675] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-09T18:39:16.977788] [INFO ] [MAIN ] Update Progress: 712/2373 symbols completed. EGY took 35.4s. Estimated remaining: 3h 51m 29s. Rate: 7.2 symbols/min [2025-10-09T18:39:17.173665] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T18:39:17.177300] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:17.206179] [DEBUG] [LOCAL ] EIC: Loaded 23043 existing records from primary storage. [2025-10-09T18:39:17.206451] [INFO ] [MAIN ] EIC: Loaded 23043 existing records. [2025-10-09T18:39:17.389395] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:39:17.389636] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-09T18:39:17.389722] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-09T18:39:17.390483] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-09T18:39:17.390545] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-09T18:39:17.603785] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-09T18:39:17.702448] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T18:39:17.799177] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:18.396735] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-09T18:39:18.912084] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:39:19.063310] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T18:39:19.196727] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-09T18:39:19.996793] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-09T18:39:20.584412] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T18:39:20.796684] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-09T18:39:20.809047] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T18:39:21.596789] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-09T18:39:21.891406] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T18:39:22.396752] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-09T18:39:22.458256] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T18:39:23.196734] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-09T18:39:23.474549] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T18:39:23.996695] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-09T18:39:24.796700] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-09T18:39:24.895867] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T18:39:24.995265] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T18:39:24.997606] [INFO ] [REMOTE ] EHAB: Full fetch complete (40897 records). [2025-10-09T18:39:24.997758] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-09T18:39:25.377324] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-09T18:39:25.377422] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-09T18:39:25.378076] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-09T18:39:25.378139] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-09T18:39:25.379143] [DEBUG] [LOCAL ] EHAB: Trimmed 40897 records to 29479 (keeping 200 days of data) [2025-10-09T18:39:25.547755] [DEBUG] [LOCAL ] EHAB: Primary data saved (29479 records). [2025-10-09T18:39:25.547923] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-09T18:39:25.548013] [INFO ] [MAIN ] Update Progress: 713/2373 symbols completed. EHAB took 39.0s. Estimated remaining: 3h 51m 21s. Rate: 7.2 symbols/min [2025-10-09T18:39:25.601867] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-09T18:39:25.659346] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T18:39:25.735112] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:25.735237] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-09T18:39:25.735289] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-09T18:39:25.735422] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-09T18:39:25.735490] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-09T18:39:25.735545] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-09T18:39:25.735585] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-09T18:39:26.090853] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:26.396743] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-09T18:39:26.902524] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T18:39:27.043027] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T18:39:27.196717] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-09T18:39:27.996719] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-09T18:39:28.117761] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T18:39:28.119253] [INFO ] [REMOTE ] EHI: Full fetch complete (16260 records). [2025-10-09T18:39:28.119322] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-09T18:39:28.493114] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-09T18:39:28.493191] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-09T18:39:28.493569] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-09T18:39:28.493608] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-09T18:39:28.494133] [DEBUG] [LOCAL ] EHI: Trimmed 16260 records to 10769 (keeping 200 days of data) [2025-10-09T18:39:28.555445] [DEBUG] [LOCAL ] EHI: Primary data saved (10769 records). [2025-10-09T18:39:28.555577] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-09T18:39:28.555688] [INFO ] [MAIN ] Update Progress: 714/2373 symbols completed. EHI took 25.3s. Estimated remaining: 3h 50m 60s. Rate: 7.2 symbols/min [2025-10-09T18:39:28.732466] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:28.732663] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-09T18:39:28.732724] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-09T18:39:28.732836] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-09T18:39:28.732877] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-09T18:39:28.732918] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-09T18:39:28.732950] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-09T18:39:28.801943] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-09T18:39:29.116188] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:29.262968] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-09T18:39:29.480713] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T18:39:29.596671] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-09T18:39:30.396720] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-09T18:39:30.983581] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T18:39:31.044343] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T18:39:31.196703] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-09T18:39:31.996760] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-09T18:39:32.265730] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T18:39:32.426573] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T18:39:32.796737] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-09T18:39:33.596749] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-09T18:39:34.189683] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T18:39:34.193073] [INFO ] [REMOTE ] EHC: Full fetch complete (58733 records). [2025-10-09T18:39:34.193182] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-09T18:39:34.405221] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-09T18:39:34.579014] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-09T18:39:34.579093] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-09T18:39:34.579862] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-09T18:39:34.579926] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-09T18:39:34.581118] [DEBUG] [LOCAL ] EHC: Trimmed 58733 records to 41416 (keeping 200 days of data) [2025-10-09T18:39:34.821795] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T18:39:34.870289] [DEBUG] [LOCAL ] EHC: Primary data saved (41416 records). [2025-10-09T18:39:34.870412] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-09T18:39:34.870488] [INFO ] [MAIN ] Update Progress: 715/2373 symbols completed. EHC took 42.8s. Estimated remaining: 3h 50m 47s. Rate: 7.2 symbols/min [2025-10-09T18:39:34.976165] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T18:39:35.047841] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:35.048051] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-09T18:39:35.048107] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-09T18:39:35.048256] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-09T18:39:35.048298] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-09T18:39:35.048339] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-09T18:39:35.048370] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-09T18:39:35.197557] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-09T18:39:35.405554] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:35.637489] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T18:39:35.996799] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-09T18:39:36.328994] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-09T18:39:36.796727] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-09T18:39:37.116839] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-09T18:39:37.596774] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-09T18:39:38.396693] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-09T18:39:38.653507] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-09T18:39:38.748003] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T18:39:39.196711] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-09T18:39:39.620355] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:39:39.996724] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-09T18:39:40.380239] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-09T18:39:40.796740] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-09T18:39:41.596791] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-09T18:39:41.925483] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T18:39:42.025983] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:39:42.396721] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-09T18:39:43.196686] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-09T18:39:43.572270] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-09T18:39:43.589039] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T18:39:43.996741] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-09T18:39:44.455999] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-09T18:39:44.796742] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-09T18:39:45.173425] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-09T18:39:45.596720] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-09T18:39:46.339128] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:39:46.396777] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-09T18:39:47.196708] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-09T18:39:47.229556] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T18:39:47.231582] [INFO ] [REMOTE ] EIC: Full fetch complete (34494 records). [2025-10-09T18:39:47.231701] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-09T18:39:47.602406] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-09T18:39:47.602488] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-09T18:39:47.603090] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-09T18:39:47.603161] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-09T18:39:47.603918] [DEBUG] [LOCAL ] EIC: Trimmed 34494 records to 23193 (keeping 200 days of data) [2025-10-09T18:39:47.732317] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T18:39:47.758042] [DEBUG] [LOCAL ] EIC: Primary data saved (23193 records). [2025-10-09T18:39:47.758185] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-09T18:39:47.758274] [INFO ] [MAIN ] Update Progress: 716/2373 symbols completed. EIC took 30.8s. Estimated remaining: 3h 50m 49s. Rate: 7.2 symbols/min [2025-10-09T18:39:47.941856] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:39:47.962309] [DEBUG] [LOCAL ] EIG: Loaded 20264 existing records from primary storage. [2025-10-09T18:39:47.962549] [INFO ] [MAIN ] EIG: Loaded 20264 existing records. [2025-10-09T18:39:48.001937] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-09T18:39:48.149765] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:39:48.150047] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-09T18:39:48.150108] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-09T18:39:48.151152] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-09T18:39:48.151214] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-09T18:39:48.516966] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:39:48.701947] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T18:39:48.796718] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-09T18:39:49.136238] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-09T18:39:49.596758] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-09T18:39:50.018033] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T18:39:50.396723] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-09T18:39:50.932174] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T18:39:51.196705] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-09T18:39:51.590191] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-09T18:39:51.996721] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-09T18:39:52.357213] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T18:39:52.357963] [INFO ] [REMOTE ] EICA: Full fetch complete (1279 records). [2025-10-09T18:39:52.358030] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-09T18:39:52.532834] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-09T18:39:52.533046] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:39:52.533115] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:39:52.533166] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-09T18:39:52.533220] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-09T18:39:52.533255] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-09T18:39:52.533293] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-09T18:39:52.533350] [INFO ] [MAIN ] Update Progress: 717/2373 symbols completed. EICA took 27.0s. Estimated remaining: 3h 50m 32s. Rate: 7.2 symbols/min [2025-10-09T18:39:52.796766] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-09T18:39:53.337108] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T18:39:53.596738] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-09T18:39:54.296696] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T18:39:54.396739] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-09T18:39:55.070458] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T18:39:55.196709] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-09T18:39:55.972876] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:39:55.996676] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-09T18:39:56.551782] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T18:39:56.796762] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-09T18:39:57.279536] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-09T18:39:57.596723] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-09T18:39:58.158020] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T18:39:58.396743] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-09T18:39:59.040889] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-09T18:39:59.196707] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-09T18:39:59.779246] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T18:39:59.996707] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-09T18:40:00.698198] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T18:40:00.796723] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-09T18:40:01.525189] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T18:40:01.596723] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-09T18:40:01.931496] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-09T18:40:02.396740] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-09T18:40:02.980086] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T18:40:02.980896] [INFO ] [REMOTE ] EICB: Full fetch complete (2699 records). [2025-10-09T18:40:02.980968] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-09T18:40:03.174883] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T18:40:03.175079] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:40:03.175147] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:40:03.175199] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-09T18:40:03.175255] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-09T18:40:03.175291] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-09T18:40:03.175369] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-09T18:40:03.175458] [INFO ] [MAIN ] Update Progress: 718/2373 symbols completed. EICB took 34.6s. Estimated remaining: 3h 50m 29s. Rate: 7.2 symbols/min [2025-10-09T18:40:03.196700] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-09T18:40:03.996694] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-09T18:40:04.078229] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T18:40:04.719318] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-09T18:40:04.796704] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-09T18:40:05.317677] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T18:40:05.318938] [INFO ] [REMOTE ] EICC: Full fetch complete (8380 records). [2025-10-09T18:40:05.319051] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-09T18:40:05.319469] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T18:40:05.319568] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:40:05.319611] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:40:05.319699] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-09T18:40:05.319767] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-09T18:40:05.319803] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-09T18:40:05.319860] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-09T18:40:05.319941] [INFO ] [MAIN ] Update Progress: 719/2373 symbols completed. EICC took 30.4s. Estimated remaining: 3h 50m 7s. Rate: 7.2 symbols/min [2025-10-09T18:40:05.596725] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-09T18:40:06.789597] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T18:40:06.794591] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-09T18:40:07.855934] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T18:40:07.861585] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-09T18:40:08.856977] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T18:40:08.861826] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-09T18:40:09.957230] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-09T18:40:09.962249] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-09T18:40:11.106304] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T18:40:11.112407] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-09T18:40:11.852278] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T18:40:11.857053] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-09T18:40:12.828171] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T18:40:12.829973] [INFO ] [REMOTE ] EIG: Full fetch complete (27079 records). [2025-10-09T18:40:12.830044] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-09T18:40:13.199836] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-09T18:40:13.199916] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-09T18:40:13.200418] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-09T18:40:13.200459] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-09T18:40:13.201148] [DEBUG] [LOCAL ] EIG: Trimmed 27079 records to 20377 (keeping 200 days of data) [2025-10-09T18:40:13.325583] [DEBUG] [LOCAL ] EIG: Primary data saved (20377 records). [2025-10-09T18:40:13.325740] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-09T18:40:13.325834] [INFO ] [MAIN ] Update Progress: 720/2373 symbols completed. EIG took 25.6s. Estimated remaining: 3h 49m 57s. Rate: 7.2 symbols/min [2025-10-09T18:40:13.953279] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:13.968679] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:14.024710] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:14.045087] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:14.050510] [DEBUG] [LOCAL ] ELC: Loaded 3504 existing records from primary storage. [2025-10-09T18:40:14.050914] [INFO ] [MAIN ] ELC: Loaded 3504 existing records. [2025-10-09T18:40:14.272458] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:14.272812] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-09T18:40:14.272875] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-09T18:40:14.273233] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-09T18:40:14.273304] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-09T18:40:14.430871] [DEBUG] [LOCAL ] EL: Loaded 53372 existing records from primary storage. [2025-10-09T18:40:14.461831] [DEBUG] [LOCAL ] EIX: Loaded 53347 existing records from primary storage. [2025-10-09T18:40:14.468185] [INFO ] [MAIN ] EL: Loaded 53372 existing records. [2025-10-09T18:40:14.473575] [INFO ] [MAIN ] EIX: Loaded 53347 existing records. [2025-10-09T18:40:14.586773] [DEBUG] [LOCAL ] ELAN: Loaded 53293 existing records from primary storage. [2025-10-09T18:40:14.722157] [INFO ] [MAIN ] ELAN: Loaded 53293 existing records. [2025-10-09T18:40:15.086727] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:15.178874] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:15.210554] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:15.248298] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-09T18:40:15.179042] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-09T18:40:15.216125] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-09T18:40:15.272566] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-09T18:40:15.275480] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:15.276575] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-09T18:40:15.276634] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-09T18:40:15.278429] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-09T18:40:15.278512] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-09T18:40:15.276437] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-09T18:40:15.289974] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-09T18:40:15.304979] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-09T18:40:15.325416] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-09T18:40:15.375124] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-09T18:40:16.122790] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T18:40:16.156784] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-09T18:40:16.299733] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:16.336030] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-09T18:40:16.330624] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:16.341558] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-09T18:40:16.406503] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:16.407226] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-09T18:40:16.874817] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T18:40:16.876277] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-09T18:40:17.990503] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T18:40:18.001044] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-09T18:40:18.117167] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T18:40:18.129996] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-09T18:40:18.725683] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-09T18:40:18.737478] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-09T18:40:18.742049] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T18:40:18.743284] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-09T18:40:19.063633] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-09T18:40:19.196755] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-09T18:40:19.420889] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:40:19.514433] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T18:40:19.809821] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T18:40:19.996745] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-09T18:40:20.322166] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T18:40:20.796784] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-09T18:40:21.596775] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-09T18:40:21.741615] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T18:40:21.906595] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-09T18:40:22.396708] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-09T18:40:22.833779] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-09T18:40:22.926896] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T18:40:23.196719] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-09T18:40:23.620350] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-09T18:40:23.996767] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-09T18:40:24.588060] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:40:24.796757] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-09T18:40:25.596715] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-09T18:40:26.160262] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T18:40:26.203797] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:40:26.396711] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-09T18:40:27.196741] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-09T18:40:27.996743] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-09T18:40:28.165432] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:40:28.612202] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T18:40:28.613382] [INFO ] [REMOTE ] ELC: Full fetch complete (5059 records). [2025-10-09T18:40:28.613691] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-09T18:40:28.801861] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-09T18:40:29.061859] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-09T18:40:29.061972] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-09T18:40:29.062294] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-09T18:40:29.062429] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-09T18:40:29.063240] [DEBUG] [LOCAL ] ELC: Trimmed 5059 records to 3524 (keeping 200 days of data) [2025-10-09T18:40:29.106870] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-09T18:40:29.131219] [DEBUG] [LOCAL ] ELC: Primary data saved (3524 records). [2025-10-09T18:40:29.131352] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-09T18:40:29.131463] [INFO ] [MAIN ] Update Progress: 721/2373 symbols completed. ELC took 15.8s. Estimated remaining: 3h 50m 6s. Rate: 7.2 symbols/min [2025-10-09T18:40:29.336378] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:29.389184] [DEBUG] [LOCAL ] ELF: Loaded 52053 existing records from primary storage. [2025-10-09T18:40:29.389542] [INFO ] [MAIN ] ELF: Loaded 52053 existing records. [2025-10-09T18:40:29.573273] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:29.573519] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-09T18:40:29.573578] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-09T18:40:29.575015] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-09T18:40:29.575078] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-09T18:40:29.606164] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-09T18:40:29.987092] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:30.396709] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-09T18:40:30.535987] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T18:40:31.196743] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-09T18:40:31.511408] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T18:40:31.996699] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-09T18:40:32.113567] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T18:40:32.505907] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T18:40:32.796733] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-09T18:40:33.596735] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-09T18:40:34.006372] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T18:40:34.396720] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-09T18:40:34.832018] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-09T18:40:34.960932] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:40:35.196706] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-09T18:40:35.996681] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-09T18:40:36.195897] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:40:36.796756] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-09T18:40:36.864818] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:40:37.596694] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-09T18:40:37.798871] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T18:40:38.048814] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T18:40:38.396733] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-09T18:40:39.085718] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T18:40:39.196815] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-09T18:40:39.996719] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-09T18:40:40.559104] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-09T18:40:40.796721] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-09T18:40:41.277790] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-09T18:40:41.596691] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-09T18:40:41.817413] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T18:40:42.396692] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-09T18:40:42.444167] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:40:43.201842] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-09T18:40:43.218905] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T18:40:43.996733] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-09T18:40:44.268705] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:40:44.796711] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-09T18:40:45.043579] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T18:40:45.432693] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T18:40:45.596700] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-09T18:40:46.396685] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-09T18:40:46.869841] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-09T18:40:47.196708] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-09T18:40:47.247474] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T18:40:47.252099] [INFO ] [REMOTE ] ELAN: Full fetch complete (76872 records). [2025-10-09T18:40:47.252222] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-09T18:40:47.645693] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-09T18:40:47.645802] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-09T18:40:47.647336] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-09T18:40:47.647404] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-09T18:40:47.649059] [DEBUG] [LOCAL ] ELAN: Trimmed 76872 records to 53679 (keeping 200 days of data) [2025-10-09T18:40:47.971822] [DEBUG] [LOCAL ] ELAN: Primary data saved (53679 records). [2025-10-09T18:40:47.971966] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-09T18:40:47.972080] [INFO ] [MAIN ] Update Progress: 722/2373 symbols completed. ELAN took 34.6s. Estimated remaining: 3h 50m 22s. Rate: 7.2 symbols/min [2025-10-09T18:40:48.003693] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-09T18:40:48.147402] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:48.184893] [DEBUG] [LOCAL ] ELME: Loaded 39293 existing records from primary storage. [2025-10-09T18:40:48.185172] [INFO ] [MAIN ] ELME: Loaded 39293 existing records. [2025-10-09T18:40:48.370880] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:48.371186] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-09T18:40:48.371298] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-09T18:40:48.372756] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-09T18:40:48.372819] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-09T18:40:48.743504] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-09T18:40:48.810690] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-09T18:40:48.834183] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:49.239752] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-09T18:40:49.596697] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-09T18:40:49.774788] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T18:40:50.396744] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-09T18:40:50.647035] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T18:40:51.097876] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T18:40:51.196738] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-09T18:40:51.996716] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-09T18:40:52.202263] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T18:40:52.241400] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T18:40:52.796761] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-09T18:40:53.596689] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-09T18:40:53.673576] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T18:40:54.396691] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-09T18:40:54.711974] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-09T18:40:55.196685] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-09T18:40:55.297401] [DEBUG] [REMOTE ] EIX: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-09T18:40:55.297723] [WARN ] [REMOTE ] EIX: No data returned for month 2025-10 [2025-10-09T18:40:55.297843] [FATAL] [REMOTE ] EIX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:40:55.297951] [FATAL] [MAIN ] EIX: Failed to fetch primary data. [2025-10-09T18:40:55.298017] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:40:55.298089] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-09T18:40:55.298151] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-09T18:40:55.298186] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-10-09T18:40:55.298471] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-10-09T18:40:55.298572] [INFO ] [MAIN ] Update Progress: 723/2373 symbols completed. EIX took 42.0s. Estimated remaining: 3h 50m 11s. Rate: 7.2 symbols/min [2025-10-09T18:40:55.475330] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:55.508389] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:40:55.544590] [DEBUG] [LOCAL ] ELP: Loaded 25619 existing records from primary storage. [2025-10-09T18:40:55.544924] [INFO ] [MAIN ] ELP: Loaded 25619 existing records. [2025-10-09T18:40:55.785089] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:40:55.792108] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-09T18:40:55.803566] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-09T18:40:55.804900] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:40:55.804949] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-09T18:40:55.814101] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-09T18:40:56.005736] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-09T18:40:56.183292] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:56.796732] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-09T18:40:57.550355] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T18:40:57.554499] [INFO ] [REMOTE ] ELF: Full fetch complete (75261 records). [2025-10-09T18:40:57.554614] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-09T18:40:57.601799] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-09T18:40:57.976893] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-09T18:40:57.976979] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-09T18:40:57.978126] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-09T18:40:57.978196] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-09T18:40:57.979723] [DEBUG] [LOCAL ] ELF: Trimmed 75261 records to 52403 (keeping 200 days of data) [2025-10-09T18:40:58.090881] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T18:40:58.330530] [DEBUG] [LOCAL ] ELF: Primary data saved (52403 records). [2025-10-09T18:40:58.330702] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-09T18:40:58.330798] [INFO ] [MAIN ] Update Progress: 724/2373 symbols completed. ELF took 29.2s. Estimated remaining: 3h 49m 51s. Rate: 7.2 symbols/min [2025-10-09T18:40:58.406342] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-09T18:40:58.513861] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:40:58.514039] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-09T18:40:58.514098] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-09T18:40:58.514217] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-09T18:40:58.514260] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-09T18:40:58.514302] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-09T18:40:58.514336] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-09T18:40:58.905119] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:40:59.196712] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-09T18:40:59.481408] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-09T18:40:59.486439] [INFO ] [REMOTE ] EL: Full fetch complete (77274 records). [2025-10-09T18:40:59.486583] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-09T18:40:59.797528] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:40:59.913600] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-09T18:40:59.914150] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-09T18:40:59.915252] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-09T18:40:59.915359] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-09T18:40:59.939622] [DEBUG] [LOCAL ] EL: Trimmed 77274 records to 53760 (keeping 200 days of data) [2025-10-09T18:40:59.940458] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T18:41:00.005515] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-09T18:41:00.292762] [DEBUG] [LOCAL ] EL: Primary data saved (53760 records). [2025-10-09T18:41:00.292925] [INFO ] [MAIN ] EL: Full history saved. [2025-10-09T18:41:00.293031] [INFO ] [MAIN ] Update Progress: 725/2373 symbols completed. EL took 47.0s. Estimated remaining: 3h 49m 28s. Rate: 7.2 symbols/min [2025-10-09T18:41:00.465193] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:00.512006] [DEBUG] [LOCAL ] ELS: Loaded 49760 existing records from primary storage. [2025-10-09T18:41:00.512333] [INFO ] [MAIN ] ELS: Loaded 49760 existing records. [2025-10-09T18:41:00.690749] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:00.690926] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-09T18:41:00.690979] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-09T18:41:00.692336] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-09T18:41:00.692396] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-09T18:41:00.801829] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-09T18:41:01.054594] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:01.138665] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T18:41:01.445479] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T18:41:01.596747] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-09T18:41:02.396778] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-09T18:41:02.671579] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-09T18:41:02.976583] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:41:03.196702] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-09T18:41:03.526402] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-09T18:41:03.996787] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-09T18:41:04.796767] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-09T18:41:05.397351] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T18:41:05.596739] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-09T18:41:06.396699] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-09T18:41:06.578190] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T18:41:06.775372] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-09T18:41:06.890621] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T18:41:07.196707] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-09T18:41:07.996776] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-09T18:41:08.279359] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-09T18:41:08.590977] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T18:41:08.796750] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-09T18:41:09.123313] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T18:41:09.596705] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-09T18:41:10.396715] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-09T18:41:10.589725] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T18:41:11.196762] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-09T18:41:11.996756] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-09T18:41:12.122339] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:41:12.425532] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T18:41:12.530993] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T18:41:12.796706] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-09T18:41:13.596788] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-09T18:41:14.127188] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T18:41:14.396688] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-09T18:41:14.423180] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T18:41:15.196715] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-09T18:41:15.510035] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-09T18:41:15.996763] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-09T18:41:16.188608] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T18:41:16.796717] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-09T18:41:17.074566] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-09T18:41:17.424020] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T18:41:17.596766] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-09T18:41:17.937031] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-09T18:41:17.937746] [INFO ] [REMOTE ] ELPC: Full fetch complete (1416 records). [2025-10-09T18:41:17.937850] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-09T18:41:18.121303] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-09T18:41:18.121512] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:41:18.121605] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:41:18.121700] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-09T18:41:18.121779] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-09T18:41:18.121838] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-09T18:41:18.121900] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-09T18:41:18.121982] [INFO ] [MAIN ] Update Progress: 726/2373 symbols completed. ELPC took 19.8s. Estimated remaining: 3h 49m 41s. Rate: 7.2 symbols/min [2025-10-09T18:41:18.289888] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:18.338132] [DEBUG] [LOCAL ] ELV: Loaded 50611 existing records from primary storage. [2025-10-09T18:41:18.338464] [INFO ] [MAIN ] ELV: Loaded 50611 existing records. [2025-10-09T18:41:18.401891] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-09T18:41:18.517561] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:18.517783] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-09T18:41:18.517871] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-09T18:41:18.519304] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-09T18:41:18.519364] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-09T18:41:18.876174] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:19.196688] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-09T18:41:19.575157] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T18:41:19.996735] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-09T18:41:20.705750] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T18:41:20.710253] [INFO ] [REMOTE ] ELME: Full fetch complete (56092 records). [2025-10-09T18:41:20.710381] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-09T18:41:20.801815] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-09T18:41:21.111931] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-09T18:41:21.112014] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-09T18:41:21.112807] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-09T18:41:21.112872] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-09T18:41:21.113996] [DEBUG] [LOCAL ] ELME: Trimmed 56092 records to 39587 (keeping 200 days of data) [2025-10-09T18:41:21.362555] [DEBUG] [LOCAL ] ELME: Primary data saved (39587 records). [2025-10-09T18:41:21.362804] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-09T18:41:21.362899] [INFO ] [MAIN ] Update Progress: 727/2373 symbols completed. ELME took 33.4s. Estimated remaining: 3h 49m 21s. Rate: 7.2 symbols/min [2025-10-09T18:41:21.581855] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T18:41:21.580242] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:21.591485] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-09T18:41:21.591594] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-09T18:41:21.592288] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-09T18:41:21.592712] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-09T18:41:21.592808] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-09T18:41:21.592849] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-09T18:41:21.604271] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-09T18:41:21.954701] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:22.396689] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-09T18:41:22.762219] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T18:41:23.196695] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-09T18:41:23.419150] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-09T18:41:23.564888] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T18:41:23.996720] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-09T18:41:24.763981] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T18:41:24.796681] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-09T18:41:24.974275] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T18:41:25.596714] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-09T18:41:26.162794] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T18:41:26.396742] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-09T18:41:27.196693] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-09T18:41:27.320582] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T18:41:27.369195] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T18:41:27.413837] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:41:27.414174] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-09T18:41:27.414272] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:41:27.414322] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-09T18:41:27.414358] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:41:27.414397] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-09T18:41:27.414476] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-09T18:41:27.414532] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-09T18:41:27.414576] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-09T18:41:27.414625] [INFO ] [MAIN ] Update Progress: 728/2373 symbols completed. EMA took 6.1s. Estimated remaining: 3h 49m 7s. Rate: 7.2 symbols/min [2025-10-09T18:41:27.589786] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:27.611725] [DEBUG] [LOCAL ] EMD: Loaded 21094 existing records from primary storage. [2025-10-09T18:41:27.611975] [INFO ] [MAIN ] EMD: Loaded 21094 existing records. [2025-10-09T18:41:27.793695] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:27.793891] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-09T18:41:27.793937] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-09T18:41:27.794206] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-09T18:41:27.794264] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-09T18:41:28.001846] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-09T18:41:28.159239] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:28.796774] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-09T18:41:29.279317] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T18:41:29.596715] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-09T18:41:30.168383] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T18:41:30.396728] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-09T18:41:31.198116] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-09T18:41:31.211512] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T18:41:31.795310] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T18:41:31.996795] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-09T18:41:32.274323] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T18:41:32.796751] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-09T18:41:33.596723] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-09T18:41:33.809373] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-09T18:41:33.985815] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T18:41:33.988113] [INFO ] [REMOTE ] ELP: Full fetch complete (36830 records). [2025-10-09T18:41:33.988222] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-09T18:41:34.372150] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-09T18:41:34.372229] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-09T18:41:34.372908] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-09T18:41:34.372972] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-09T18:41:34.373842] [DEBUG] [LOCAL ] ELP: Trimmed 36830 records to 25781 (keeping 200 days of data) [2025-10-09T18:41:34.422482] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-09T18:41:34.531371] [DEBUG] [LOCAL ] ELP: Primary data saved (25781 records). [2025-10-09T18:41:34.531522] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-09T18:41:34.531634] [INFO ] [MAIN ] Update Progress: 729/2373 symbols completed. ELP took 39.2s. Estimated remaining: 3h 48m 56s. Rate: 7.2 symbols/min [2025-10-09T18:41:34.708260] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:34.743387] [DEBUG] [LOCAL ] EME: Loaded 31165 existing records from primary storage. [2025-10-09T18:41:34.743694] [INFO ] [MAIN ] EME: Loaded 31165 existing records. [2025-10-09T18:41:34.918715] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:34.918926] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-09T18:41:34.918974] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-09T18:41:34.919169] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-09T18:41:34.919225] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-09T18:41:35.197528] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-09T18:41:35.286756] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:35.301122] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T18:41:35.529915] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-09T18:41:35.996732] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-09T18:41:36.672151] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T18:41:36.796708] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-09T18:41:37.596705] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-09T18:41:37.782431] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T18:41:38.194624] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T18:41:38.199025] [INFO ] [REMOTE ] ELS: Full fetch complete (70987 records). [2025-10-09T18:41:38.199158] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-09T18:41:38.402076] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-09T18:41:38.621042] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-09T18:41:38.621350] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-09T18:41:38.622561] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-09T18:41:38.622805] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-09T18:41:38.624453] [DEBUG] [LOCAL ] ELS: Trimmed 70987 records to 50144 (keeping 200 days of data) [2025-10-09T18:41:38.896125] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T18:41:39.004000] [DEBUG] [LOCAL ] ELS: Primary data saved (50144 records). [2025-10-09T18:41:39.004176] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-09T18:41:39.004274] [INFO ] [MAIN ] Update Progress: 730/2373 symbols completed. ELS took 38.7s. Estimated remaining: 3h 48m 39s. Rate: 7.2 symbols/min [2025-10-09T18:41:39.202030] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-09T18:41:39.206465] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:39.214581] [DEBUG] [LOCAL ] EMF: Loaded 3289 existing records from primary storage. [2025-10-09T18:41:39.215051] [INFO ] [MAIN ] EMF: Loaded 3289 existing records. [2025-10-09T18:41:39.427765] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:39.428295] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-09T18:41:39.428352] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-09T18:41:39.428671] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-09T18:41:39.428732] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-09T18:41:39.858851] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:39.996697] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-09T18:41:40.138546] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T18:41:40.244105] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T18:41:40.796700] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-09T18:41:40.918537] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T18:41:41.596725] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-09T18:41:42.396740] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-09T18:41:42.533224] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T18:41:43.018429] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-09T18:41:43.196703] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-09T18:41:43.366909] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T18:41:43.911243] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T18:41:43.996701] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-09T18:41:44.529937] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T18:41:44.796727] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-09T18:41:45.468190] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T18:41:45.596732] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-09T18:41:46.396729] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-09T18:41:47.000906] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-09T18:41:47.070366] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T18:41:47.196672] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-09T18:41:47.996720] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-09T18:41:48.666206] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T18:41:48.796704] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-09T18:41:49.219513] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-09T18:41:49.539475] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T18:41:49.596687] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-09T18:41:50.396766] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-09T18:41:51.196677] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-09T18:41:51.659225] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-09T18:41:51.996693] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-09T18:41:52.078832] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T18:41:52.137406] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T18:41:52.796771] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-09T18:41:53.596724] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-09T18:41:53.707067] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T18:41:53.711322] [INFO ] [REMOTE ] ELV: Full fetch complete (73075 records). [2025-10-09T18:41:53.711423] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-09T18:41:53.906809] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T18:41:54.123895] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-09T18:41:54.123980] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-09T18:41:54.124876] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-09T18:41:54.124940] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-09T18:41:54.126353] [DEBUG] [LOCAL ] ELV: Trimmed 73075 records to 50963 (keeping 200 days of data) [2025-10-09T18:41:54.415538] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-09T18:41:54.455925] [DEBUG] [LOCAL ] ELV: Primary data saved (50963 records). [2025-10-09T18:41:54.456033] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-09T18:41:54.457278] [INFO ] [MAIN ] Update Progress: 731/2373 symbols completed. ELV took 36.3s. Estimated remaining: 3h 48m 47s. Rate: 7.2 symbols/min [2025-10-09T18:41:54.626468] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:41:54.677929] [DEBUG] [LOCAL ] EMN: Loaded 50628 existing records from primary storage. [2025-10-09T18:41:54.678244] [INFO ] [MAIN ] EMN: Loaded 50628 existing records. [2025-10-09T18:41:54.856565] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:41:54.857045] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-09T18:41:54.857193] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-09T18:41:54.857875] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-09T18:41:54.857937] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-09T18:41:55.160408] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T18:41:55.196855] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-09T18:41:55.260397] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:41:55.273695] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T18:41:55.996773] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-09T18:41:56.572580] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T18:41:56.796683] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-09T18:41:56.909460] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T18:41:57.596738] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-09T18:41:58.396688] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-09T18:41:58.501558] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T18:41:58.791769] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T18:41:59.196698] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-09T18:41:59.504915] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:41:59.996708] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-09T18:42:00.351371] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T18:42:00.797758] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-09T18:42:00.799835] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T18:42:01.284839] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-09T18:42:01.596731] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-09T18:42:02.396725] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-09T18:42:03.095604] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T18:42:03.196736] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-09T18:42:03.493851] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:42:03.496327] [INFO ] [REMOTE ] EMD: Full fetch complete (32327 records). [2025-10-09T18:42:03.496408] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-09T18:42:03.880054] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-09T18:42:03.880135] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-09T18:42:03.880732] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-09T18:42:03.880795] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-09T18:42:03.881531] [DEBUG] [LOCAL ] EMD: Trimmed 32327 records to 21300 (keeping 200 days of data) [2025-10-09T18:42:03.996950] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-09T18:42:04.011806] [DEBUG] [LOCAL ] EMD: Primary data saved (21300 records). [2025-10-09T18:42:04.011991] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-09T18:42:04.012118] [INFO ] [MAIN ] Update Progress: 732/2373 symbols completed. EMD took 36.6s. Estimated remaining: 3h 48m 41s. Rate: 7.2 symbols/min [2025-10-09T18:42:04.181446] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:04.196005] [DEBUG] [LOCAL ] EMO: Loaded 12883 existing records from primary storage. [2025-10-09T18:42:04.196219] [INFO ] [MAIN ] EMO: Loaded 12883 existing records. [2025-10-09T18:42:04.376705] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:04.376921] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-09T18:42:04.376991] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-09T18:42:04.377181] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-09T18:42:04.377238] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-09T18:42:04.609678] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T18:42:04.789803] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:04.801780] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-09T18:42:04.819408] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T18:42:05.596696] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-09T18:42:05.762510] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T18:42:06.143073] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T18:42:06.396772] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-09T18:42:07.022354] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T18:42:07.196704] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-09T18:42:07.996726] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-09T18:42:08.588006] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T18:42:08.590877] [INFO ] [REMOTE ] EME: Full fetch complete (46823 records). [2025-10-09T18:42:08.590968] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-09T18:42:08.801823] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-09T18:42:08.977406] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-09T18:42:08.977502] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-09T18:42:08.978362] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-09T18:42:08.978435] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-09T18:42:08.979606] [DEBUG] [LOCAL ] EME: Trimmed 46823 records to 31359 (keeping 200 days of data) [2025-10-09T18:42:09.183987] [DEBUG] [LOCAL ] EME: Primary data saved (31359 records). [2025-10-09T18:42:09.184144] [INFO ] [MAIN ] EME: Full history saved. [2025-10-09T18:42:09.184754] [INFO ] [MAIN ] Update Progress: 733/2373 symbols completed. EME took 34.7s. Estimated remaining: 3h 48m 25s. Rate: 7.2 symbols/min [2025-10-09T18:42:09.381991] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:09.382363] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-10-09T18:42:09.382467] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-10-09T18:42:09.382691] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-09T18:42:09.382803] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-09T18:42:09.382886] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-09T18:42:09.382940] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-09T18:42:09.603400] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-09T18:42:09.651006] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T18:42:09.784410] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T18:42:09.806746] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:10.280434] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T18:42:10.396712] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-09T18:42:10.889815] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-09T18:42:10.890795] [INFO ] [REMOTE ] EMF: Full fetch complete (6873 records). [2025-10-09T18:42:10.890885] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-09T18:42:11.201799] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-09T18:42:11.302081] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-09T18:42:11.302164] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-09T18:42:11.302395] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-09T18:42:11.302438] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-09T18:42:11.302885] [DEBUG] [LOCAL ] EMF: Trimmed 6873 records to 3301 (keeping 200 days of data) [2025-10-09T18:42:11.327732] [DEBUG] [LOCAL ] EMF: Primary data saved (3301 records). [2025-10-09T18:42:11.328127] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-09T18:42:11.328303] [INFO ] [MAIN ] Update Progress: 734/2373 symbols completed. EMF took 32.3s. Estimated remaining: 3h 48m 3s. Rate: 7.2 symbols/min [2025-10-09T18:42:11.520463] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:11.574445] [DEBUG] [LOCAL ] EMR: Loaded 53224 existing records from primary storage. [2025-10-09T18:42:11.574805] [INFO ] [MAIN ] EMR: Loaded 53224 existing records. [2025-10-09T18:42:11.752477] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:11.752735] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-09T18:42:11.752791] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-09T18:42:11.753197] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-09T18:42:11.753255] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-09T18:42:11.950051] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T18:42:11.999770] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-09T18:42:12.142056] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:12.796764] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-09T18:42:12.966948] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T18:42:13.544997] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T18:42:13.596696] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-09T18:42:14.396748] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-09T18:42:14.999940] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T18:42:15.114305] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T18:42:15.196707] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-09T18:42:15.725955] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T18:42:15.996699] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-09T18:42:16.795531] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T18:42:16.799166] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-09T18:42:17.596769] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-09T18:42:18.221584] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T18:42:18.396695] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-09T18:42:18.516441] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T18:42:18.864972] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T18:42:19.196713] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-09T18:42:19.996742] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-09T18:42:20.273936] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T18:42:20.439234] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T18:42:20.796726] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-09T18:42:21.596760] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-09T18:42:22.307130] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T18:42:22.396719] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-09T18:42:22.855398] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T18:42:23.196777] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-09T18:42:23.435029] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-09T18:42:23.996751] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-09T18:42:24.006215] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T18:42:24.008421] [INFO ] [REMOTE ] EMO: Full fetch complete (17558 records). [2025-10-09T18:42:24.008525] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-09T18:42:24.382606] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-09T18:42:24.382727] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-09T18:42:24.383106] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-09T18:42:24.383146] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-09T18:42:24.383758] [DEBUG] [LOCAL ] EMO: Trimmed 17558 records to 13052 (keeping 200 days of data) [2025-10-09T18:42:24.466288] [DEBUG] [LOCAL ] EMO: Primary data saved (13052 records). [2025-10-09T18:42:24.466425] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-09T18:42:24.466511] [INFO ] [MAIN ] Update Progress: 735/2373 symbols completed. EMO took 20.5s. Estimated remaining: 3h 48m 5s. Rate: 7.2 symbols/min [2025-10-09T18:42:24.634189] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:24.639022] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T18:42:24.686324] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-09T18:42:24.686636] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-09T18:42:24.801877] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-09T18:42:24.867303] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:24.867567] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-09T18:42:24.867617] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-09T18:42:24.867957] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-09T18:42:24.868018] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-09T18:42:25.277300] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:25.596724] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-09T18:42:26.169247] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-09T18:42:26.401855] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-09T18:42:26.418795] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:42:27.196704] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-09T18:42:27.996784] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-09T18:42:28.139795] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T18:42:28.796705] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-09T18:42:29.046401] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T18:42:29.393818] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T18:42:29.596738] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-09T18:42:30.396709] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-09T18:42:30.598090] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T18:42:31.023187] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T18:42:31.196713] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-09T18:42:31.653154] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T18:42:31.871747] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T18:42:31.996741] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-09T18:42:32.559524] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T18:42:32.796728] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-09T18:42:33.193901] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-09T18:42:33.596791] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-09T18:42:34.396726] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-09T18:42:35.196725] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-09T18:42:35.385094] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T18:42:35.708994] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T18:42:35.996792] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-09T18:42:36.191000] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T18:42:36.796752] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-09T18:42:37.379771] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T18:42:37.380582] [INFO ] [REMOTE ] EMP: Full fetch complete (4267 records). [2025-10-09T18:42:37.380723] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-09T18:42:37.601977] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-09T18:42:37.744560] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-09T18:42:37.744765] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-09T18:42:37.744972] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-09T18:42:37.745029] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-09T18:42:37.745380] [DEBUG] [LOCAL ] EMP: Trimmed 4267 records to 3098 (keeping 200 days of data) [2025-10-09T18:42:37.764917] [DEBUG] [LOCAL ] EMP: Primary data saved (3098 records). [2025-10-09T18:42:37.764981] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-09T18:42:37.765047] [INFO ] [MAIN ] Update Progress: 736/2373 symbols completed. EMP took 28.6s. Estimated remaining: 3h 48m 8s. Rate: 7.2 symbols/min [2025-10-09T18:42:37.946172] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:37.952575] [DEBUG] [LOCAL ] ENFY: Loaded 3235 existing records from primary storage. [2025-10-09T18:42:37.952813] [INFO ] [MAIN ] ENFY: Loaded 3235 existing records. [2025-10-09T18:42:38.132975] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:38.133256] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-09T18:42:38.133314] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-09T18:42:38.133593] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-09T18:42:38.133744] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-09T18:42:38.280372] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-09T18:42:38.401838] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-09T18:42:38.537388] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:39.196737] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-09T18:42:39.612767] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T18:42:39.996808] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-09T18:42:40.006776] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T18:42:40.090512] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T18:42:40.796767] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-09T18:42:41.354498] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T18:42:41.543520] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:42:41.596737] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-09T18:42:42.396736] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-09T18:42:43.196762] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-09T18:42:43.996780] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-09T18:42:44.232925] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-09T18:42:44.523668] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T18:42:44.796749] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-09T18:42:44.982084] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T18:42:45.003836] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-09T18:42:45.008256] [INFO ] [REMOTE ] EMN: Full fetch complete (72095 records). [2025-10-09T18:42:45.008373] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-09T18:42:45.192409] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-09T18:42:45.411130] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-09T18:42:45.411212] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-09T18:42:45.412096] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-09T18:42:45.412209] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-09T18:42:45.413758] [DEBUG] [LOCAL ] EMN: Trimmed 72095 records to 50972 (keeping 200 days of data) [2025-10-09T18:42:45.597690] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-09T18:42:45.736315] [DEBUG] [LOCAL ] EMN: Primary data saved (50972 records). [2025-10-09T18:42:45.736460] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-09T18:42:45.736570] [INFO ] [MAIN ] Update Progress: 737/2373 symbols completed. EMN took 51.3s. Estimated remaining: 3h 47m 59s. Rate: 7.2 symbols/min [2025-10-09T18:42:45.910356] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:45.947078] [DEBUG] [LOCAL ] ENIC: Loaded 36357 existing records from primary storage. [2025-10-09T18:42:45.947406] [INFO ] [MAIN ] ENIC: Loaded 36357 existing records. [2025-10-09T18:42:46.051031] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:42:46.131326] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:46.131561] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-09T18:42:46.131619] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-09T18:42:46.131960] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-09T18:42:46.132017] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-09T18:42:46.401849] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-09T18:42:46.504376] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:47.196758] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-09T18:42:47.827070] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T18:42:47.996704] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-09T18:42:48.360439] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-09T18:42:48.796720] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-09T18:42:49.596694] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-09T18:42:49.718296] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:42:50.020522] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T18:42:50.295833] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-09T18:42:50.396677] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-09T18:42:51.101365] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T18:42:51.196775] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-09T18:42:51.996730] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-09T18:42:52.796704] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-09T18:42:52.979928] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:42:53.254616] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T18:42:53.298357] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-09T18:42:53.596793] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-09T18:42:54.396765] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-09T18:42:54.989360] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-09T18:42:55.196709] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-09T18:42:55.378482] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T18:42:55.996785] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-09T18:42:56.450828] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T18:42:56.796809] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-09T18:42:57.596691] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-09T18:42:58.046415] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-09T18:42:58.139213] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T18:42:58.140167] [INFO ] [REMOTE ] ENFY: Full fetch complete (5548 records). [2025-10-09T18:42:58.140238] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-09T18:42:58.352656] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T18:42:58.401737] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-09T18:42:58.559001] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-09T18:42:58.559091] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-09T18:42:58.559275] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-09T18:42:58.559325] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-09T18:42:58.559957] [DEBUG] [LOCAL ] ENFY: Trimmed 5548 records to 3256 (keeping 200 days of data) [2025-10-09T18:42:58.580384] [DEBUG] [LOCAL ] ENFY: Primary data saved (3256 records). [2025-10-09T18:42:58.580523] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-09T18:42:58.580637] [INFO ] [MAIN ] Update Progress: 738/2373 symbols completed. ENFY took 20.8s. Estimated remaining: 3h 48m 0s. Rate: 7.2 symbols/min [2025-10-09T18:42:58.749511] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:42:58.753888] [DEBUG] [LOCAL ] ENO: Loaded 1889 existing records from primary storage. [2025-10-09T18:42:58.754039] [INFO ] [MAIN ] ENO: Loaded 1889 existing records. [2025-10-09T18:42:58.929448] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:42:58.929683] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-09T18:42:58.929740] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-09T18:42:58.929920] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-09T18:42:58.929977] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-09T18:42:59.202724] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-09T18:42:59.279440] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:42:59.996736] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-09T18:43:00.162158] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:43:00.467076] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:43:00.589373] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T18:43:00.796738] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-09T18:43:01.152712] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-09T18:43:01.596701] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-09T18:43:02.396719] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-09T18:43:03.196705] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-09T18:43:03.333967] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:43:03.996673] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-09T18:43:04.101700] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T18:43:04.106543] [INFO ] [REMOTE ] ENB: Full fetch complete (77487 records). [2025-10-09T18:43:04.106676] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-09T18:43:04.499612] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-09T18:43:04.499829] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-09T18:43:04.500828] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-09T18:43:04.500892] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-09T18:43:04.502335] [DEBUG] [LOCAL ] ENB: Trimmed 77487 records to 53900 (keeping 200 days of data) [2025-10-09T18:43:04.630136] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T18:43:04.819772] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-09T18:43:04.870730] [DEBUG] [LOCAL ] ENB: Primary data saved (53900 records). [2025-10-09T18:43:04.870874] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-09T18:43:04.870979] [INFO ] [MAIN ] Update Progress: 739/2373 symbols completed. ENB took 40.4s. Estimated remaining: 3h 47m 47s. Rate: 7.2 symbols/min [2025-10-09T18:43:05.038950] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:05.078188] [DEBUG] [LOCAL ] ENOV: Loaded 44833 existing records from primary storage. [2025-10-09T18:43:05.078482] [INFO ] [MAIN ] ENOV: Loaded 44833 existing records. [2025-10-09T18:43:05.252698] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:05.252907] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-09T18:43:05.252954] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-09T18:43:05.253212] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-09T18:43:05.253269] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-09T18:43:05.633171] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:05.634499] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T18:43:05.603667] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-09T18:43:05.640178] [INFO ] [REMOTE ] EMR: Full fetch complete (77079 records). [2025-10-09T18:43:05.640272] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-09T18:43:06.035144] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-09T18:43:06.035313] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-09T18:43:06.036268] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-09T18:43:06.036333] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-09T18:43:06.037890] [DEBUG] [LOCAL ] EMR: Trimmed 77079 records to 53610 (keeping 200 days of data) [2025-10-09T18:43:06.235713] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T18:43:06.287509] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T18:43:06.396697] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-09T18:43:06.417668] [DEBUG] [LOCAL ] EMR: Primary data saved (53610 records). [2025-10-09T18:43:06.417777] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-09T18:43:06.421249] [INFO ] [MAIN ] Update Progress: 740/2373 symbols completed. EMR took 55.1s. Estimated remaining: 3h 47m 24s. Rate: 7.2 symbols/min [2025-10-09T18:43:06.595375] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:06.652270] [DEBUG] [LOCAL ] ENR: Loaded 43238 existing records from primary storage. [2025-10-09T18:43:06.652575] [INFO ] [MAIN ] ENR: Loaded 43238 existing records. [2025-10-09T18:43:06.825497] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:06.825792] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-09T18:43:06.825843] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-09T18:43:06.826136] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-09T18:43:06.826194] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-09T18:43:07.198698] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-09T18:43:07.198551] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:07.714946] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T18:43:07.996726] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-09T18:43:08.796786] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-09T18:43:08.854181] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T18:43:09.096697] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-09T18:43:09.495770] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T18:43:09.596715] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-09T18:43:10.396728] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-09T18:43:10.919900] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T18:43:11.017481] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:43:11.196750] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-09T18:43:11.642596] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-09T18:43:11.996743] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-09T18:43:12.796762] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-09T18:43:12.952701] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T18:43:13.596814] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-09T18:43:14.033263] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-09T18:43:14.170906] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T18:43:14.396736] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-09T18:43:15.196788] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-09T18:43:15.526883] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-09T18:43:15.706998] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T18:43:15.996749] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-09T18:43:16.796719] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-09T18:43:17.178338] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-09T18:43:17.332474] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T18:43:17.596775] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-09T18:43:18.396779] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-09T18:43:18.915005] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T18:43:19.196775] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-09T18:43:19.565357] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T18:43:19.996768] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-09T18:43:20.718722] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T18:43:20.796726] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-09T18:43:21.152612] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T18:43:21.596762] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-09T18:43:21.989783] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T18:43:22.126525] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T18:43:22.396746] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-09T18:43:23.196721] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-09T18:43:23.676026] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T18:43:23.996781] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-09T18:43:24.198360] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T18:43:24.201239] [INFO ] [REMOTE ] ENIC: Full fetch complete (51436 records). [2025-10-09T18:43:24.201332] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-09T18:43:24.609156] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-09T18:43:24.609244] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-09T18:43:24.610024] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-09T18:43:24.610090] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-09T18:43:24.611224] [DEBUG] [LOCAL ] ENIC: Trimmed 51436 records to 36571 (keeping 200 days of data) [2025-10-09T18:43:24.797301] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-09T18:43:24.823979] [DEBUG] [LOCAL ] ENIC: Primary data saved (36571 records). [2025-10-09T18:43:24.824101] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-09T18:43:24.824183] [INFO ] [MAIN ] Update Progress: 741/2373 symbols completed. ENIC took 39.1s. Estimated remaining: 3h 47m 38s. Rate: 7.2 symbols/min [2025-10-09T18:43:25.004735] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:25.034113] [DEBUG] [LOCAL ] ENS: Loaded 29250 existing records from primary storage. [2025-10-09T18:43:25.034382] [INFO ] [MAIN ] ENS: Loaded 29250 existing records. [2025-10-09T18:43:25.208818] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T18:43:25.214190] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:25.214491] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-09T18:43:25.215289] [INFO ] [REMOTE ] ENO: Full fetch complete (3087 records). [2025-10-09T18:43:25.216073] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-09T18:43:25.216233] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-09T18:43:25.216661] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-09T18:43:25.228542] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-09T18:43:25.613272] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-09T18:43:25.916113] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:25.999289] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-09T18:43:25.999582] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-09T18:43:26.000238] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-09T18:43:26.001319] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-09T18:43:26.001525] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-09T18:43:26.011855] [DEBUG] [LOCAL ] ENO: Trimmed 3087 records to 1899 (keeping 200 days of data) [2025-10-09T18:43:26.024899] [DEBUG] [LOCAL ] ENO: Primary data saved (1899 records). [2025-10-09T18:43:26.024969] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-09T18:43:26.025064] [INFO ] [MAIN ] Update Progress: 742/2373 symbols completed. ENO took 27.4s. Estimated remaining: 3h 47m 14s. Rate: 7.2 symbols/min [2025-10-09T18:43:26.201423] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:26.227998] [DEBUG] [LOCAL ] ENVA: Loaded 25329 existing records from primary storage. [2025-10-09T18:43:26.228270] [INFO ] [MAIN ] ENVA: Loaded 25329 existing records. [2025-10-09T18:43:26.402493] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-09T18:43:26.408853] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:26.409160] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-09T18:43:26.409218] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-09T18:43:26.409461] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-09T18:43:26.409518] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-09T18:43:26.759933] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:26.940180] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T18:43:27.196717] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-09T18:43:27.769109] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T18:43:27.996690] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-09T18:43:28.311978] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T18:43:28.796685] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-09T18:43:29.312108] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:43:29.596781] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-09T18:43:30.401847] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-09T18:43:30.422255] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:43:30.747584] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T18:43:31.196767] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-09T18:43:31.898876] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T18:43:31.996809] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-09T18:43:32.450233] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T18:43:32.796782] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-09T18:43:33.044446] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-09T18:43:33.596778] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-09T18:43:33.907305] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T18:43:34.396719] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-09T18:43:34.983037] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T18:43:35.196697] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-09T18:43:35.623314] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T18:43:35.996732] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-09T18:43:36.457504] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T18:43:36.462594] [INFO ] [REMOTE ] ENOV: Full fetch complete (63316 records). [2025-10-09T18:43:36.462804] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-09T18:43:36.801939] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-09T18:43:36.858492] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-09T18:43:36.858574] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-09T18:43:36.859421] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-09T18:43:36.859486] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-09T18:43:36.862696] [DEBUG] [LOCAL ] ENOV: Trimmed 63316 records to 45067 (keeping 200 days of data) [2025-10-09T18:43:37.087701] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T18:43:37.156144] [DEBUG] [LOCAL ] ENOV: Primary data saved (45067 records). [2025-10-09T18:43:37.156291] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-09T18:43:37.156377] [INFO ] [MAIN ] Update Progress: 743/2373 symbols completed. ENOV took 32.3s. Estimated remaining: 3h 47m 11s. Rate: 7.2 symbols/min [2025-10-09T18:43:37.327430] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:37.342872] [DEBUG] [LOCAL ] EOD: Loaded 14808 existing records from primary storage. [2025-10-09T18:43:37.343091] [INFO ] [MAIN ] EOD: Loaded 14808 existing records. [2025-10-09T18:43:37.519784] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:37.520043] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-09T18:43:37.520110] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-09T18:43:37.520386] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-09T18:43:37.520469] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-09T18:43:37.601889] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-09T18:43:37.891930] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:38.064481] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T18:43:38.396714] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-09T18:43:39.107194] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T18:43:39.196744] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-09T18:43:39.669239] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T18:43:39.845103] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T18:43:39.996736] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-09T18:43:40.796685] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-09T18:43:40.854887] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-09T18:43:41.596724] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-09T18:43:41.781897] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T18:43:42.396723] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-09T18:43:42.911116] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T18:43:43.196700] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-09T18:43:43.327179] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T18:43:43.836424] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T18:43:43.996755] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-09T18:43:44.625017] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T18:43:44.796712] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-09T18:43:45.416096] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-09T18:43:45.596719] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-09T18:43:46.396707] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-09T18:43:46.532826] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T18:43:47.196746] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-09T18:43:47.819585] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T18:43:47.996721] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-09T18:43:48.267114] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T18:43:48.796726] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-09T18:43:49.212411] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T18:43:49.596727] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-09T18:43:49.817391] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T18:43:49.821803] [INFO ] [REMOTE ] ENR: Full fetch complete (59017 records). [2025-10-09T18:43:49.822114] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-09T18:43:50.244994] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-09T18:43:50.245079] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-09T18:43:50.246010] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-09T18:43:50.246078] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-09T18:43:50.247324] [DEBUG] [LOCAL ] ENR: Trimmed 59017 records to 43536 (keeping 200 days of data) [2025-10-09T18:43:50.427139] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-09T18:43:50.520750] [DEBUG] [LOCAL ] ENR: Primary data saved (43536 records). [2025-10-09T18:43:50.520884] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-09T18:43:50.521958] [INFO ] [MAIN ] Update Progress: 744/2373 symbols completed. ENR took 44.1s. Estimated remaining: 3h 47m 14s. Rate: 7.2 symbols/min [2025-10-09T18:43:50.694438] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:50.723335] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T18:43:50.768732] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-09T18:43:50.769057] [INFO ] [MAIN ] EOG: Loaded 53344 existing records. [2025-10-09T18:43:50.943151] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:43:50.943416] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-09T18:43:50.943463] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-09T18:43:50.943833] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-09T18:43:50.943890] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-09T18:43:51.201901] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-09T18:43:51.312606] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:43:51.725249] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-09T18:43:51.996720] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-09T18:43:52.240442] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T18:43:52.796722] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-09T18:43:53.570851] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T18:43:53.596735] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-09T18:43:54.006614] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T18:43:54.396760] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-09T18:43:54.884551] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T18:43:55.196776] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-09T18:43:55.996724] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-09T18:43:56.131084] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:43:56.600015] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T18:43:56.796710] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-09T18:43:56.892015] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-09T18:43:57.596763] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-09T18:43:57.875612] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T18:43:58.377020] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T18:43:58.396664] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-09T18:43:59.191174] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T18:43:59.193541] [INFO ] [REMOTE ] EOD: Full fetch complete (20738 records). [2025-10-09T18:43:59.193624] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-09T18:43:59.205337] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-09T18:43:59.561718] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-09T18:43:59.561806] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-09T18:43:59.562254] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-09T18:43:59.562293] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-09T18:43:59.562939] [DEBUG] [LOCAL ] EOD: Trimmed 20738 records to 14933 (keeping 200 days of data) [2025-10-09T18:43:59.649030] [DEBUG] [LOCAL ] EOD: Primary data saved (14933 records). [2025-10-09T18:43:59.649170] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-09T18:43:59.649254] [INFO ] [MAIN ] Update Progress: 745/2373 symbols completed. EOD took 22.5s. Estimated remaining: 3h 47m 7s. Rate: 7.2 symbols/min [2025-10-09T18:43:59.821997] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:43:59.835169] [DEBUG] [LOCAL ] EOI: Loaded 10829 existing records from primary storage. [2025-10-09T18:43:59.835400] [INFO ] [MAIN ] EOI: Loaded 10829 existing records. [2025-10-09T18:44:00.001886] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-09T18:44:00.017854] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:00.019093] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-09T18:44:00.019148] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-09T18:44:00.019460] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-09T18:44:00.019520] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-09T18:44:00.384358] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:00.796725] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-09T18:44:00.908754] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T18:44:01.500008] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T18:44:01.503065] [INFO ] [REMOTE ] ENS: Full fetch complete (42059 records). [2025-10-09T18:44:01.503148] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-09T18:44:01.598429] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-09T18:44:01.869723] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T18:44:01.941853] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-09T18:44:01.941928] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-09T18:44:01.942557] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-09T18:44:01.942596] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-09T18:44:01.943690] [DEBUG] [LOCAL ] ENS: Trimmed 42059 records to 29440 (keeping 200 days of data) [2025-10-09T18:44:02.127862] [DEBUG] [LOCAL ] ENS: Primary data saved (29440 records). [2025-10-09T18:44:02.128012] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-09T18:44:02.128097] [INFO ] [MAIN ] Update Progress: 746/2373 symbols completed. ENS took 37.3s. Estimated remaining: 3h 46m 46s. Rate: 7.2 symbols/min [2025-10-09T18:44:02.295555] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:02.312870] [DEBUG] [LOCAL ] EOS: Loaded 15423 existing records from primary storage. [2025-10-09T18:44:02.313094] [INFO ] [MAIN ] EOS: Loaded 15423 existing records. [2025-10-09T18:44:02.401959] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-09T18:44:02.502350] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:02.502605] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-09T18:44:02.502683] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-09T18:44:02.502879] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-09T18:44:02.502937] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-09T18:44:02.862710] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:03.196698] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-09T18:44:03.563868] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T18:44:03.693948] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-09T18:44:03.996737] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-09T18:44:04.184194] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T18:44:04.796718] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-09T18:44:05.596687] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-09T18:44:05.720749] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T18:44:05.766402] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T18:44:06.396731] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-09T18:44:06.811532] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T18:44:06.813803] [INFO ] [REMOTE ] ENVA: Full fetch complete (36700 records). [2025-10-09T18:44:06.813879] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-09T18:44:07.175253] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-09T18:44:07.175327] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-09T18:44:07.175886] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-09T18:44:07.175948] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-09T18:44:07.176712] [DEBUG] [LOCAL ] ENVA: Trimmed 36700 records to 25478 (keeping 200 days of data) [2025-10-09T18:44:07.226438] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-09T18:44:07.331340] [DEBUG] [LOCAL ] ENVA: Primary data saved (25478 records). [2025-10-09T18:44:07.331511] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-09T18:44:07.331611] [INFO ] [MAIN ] Update Progress: 747/2373 symbols completed. ENVA took 41.3s. Estimated remaining: 3h 46m 31s. Rate: 7.2 symbols/min [2025-10-09T18:44:07.538214] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:07.547043] [DEBUG] [LOCAL ] EOT: Loaded 6743 existing records from primary storage. [2025-10-09T18:44:07.547231] [INFO ] [MAIN ] EOT: Loaded 6743 existing records. [2025-10-09T18:44:07.720592] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:07.720821] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-09T18:44:07.720869] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-09T18:44:07.721040] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-09T18:44:07.721096] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-09T18:44:08.010760] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-09T18:44:08.098811] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:08.392740] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T18:44:08.658201] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T18:44:08.726034] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T18:44:08.796720] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-09T18:44:09.596742] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-09T18:44:09.778856] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T18:44:10.396728] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-09T18:44:11.076212] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-09T18:44:11.196733] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-09T18:44:11.310882] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T18:44:11.996733] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-09T18:44:12.369609] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T18:44:12.796732] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-09T18:44:13.468328] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T18:44:13.562087] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T18:44:13.596663] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-09T18:44:14.396741] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-09T18:44:14.935915] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T18:44:15.196682] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-09T18:44:15.298437] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T18:44:15.931671] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T18:44:15.996686] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-09T18:44:16.796715] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-09T18:44:17.063475] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T18:44:17.596734] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-09T18:44:17.654034] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T18:44:18.173524] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T18:44:18.396741] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-09T18:44:19.196779] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-09T18:44:19.996693] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-09T18:44:20.221336] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T18:44:20.310981] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:44:20.646117] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T18:44:20.796744] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-09T18:44:21.410921] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T18:44:21.596753] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-09T18:44:22.396721] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-09T18:44:22.734936] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T18:44:22.739757] [INFO ] [REMOTE ] EOG: Full fetch complete (77279 records). [2025-10-09T18:44:22.739879] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-09T18:44:23.140806] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T18:44:23.163979] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-09T18:44:23.164975] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-09T18:44:23.166031] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-09T18:44:23.166140] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-09T18:44:23.167550] [DEBUG] [LOCAL ] EOG: Trimmed 77279 records to 53734 (keeping 200 days of data) [2025-10-09T18:44:23.224692] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-09T18:44:23.516190] [DEBUG] [LOCAL ] EOG: Primary data saved (53734 records). [2025-10-09T18:44:23.516337] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-09T18:44:23.517435] [INFO ] [MAIN ] Update Progress: 748/2373 symbols completed. EOG took 33.0s. Estimated remaining: 3h 46m 40s. Rate: 7.2 symbols/min [2025-10-09T18:44:23.688526] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:23.717164] [DEBUG] [LOCAL ] EPAC: Loaded 26691 existing records from primary storage. [2025-10-09T18:44:23.717421] [INFO ] [MAIN ] EPAC: Loaded 26691 existing records. [2025-10-09T18:44:23.893090] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:23.893314] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-09T18:44:23.893421] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-09T18:44:23.893712] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-09T18:44:23.893770] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-09T18:44:24.001868] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-09T18:44:24.205843] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-09T18:44:24.247887] [INFO ] [REMOTE ] EOS: Full fetch complete (23349 records). [2025-10-09T18:44:24.257104] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-09T18:44:24.289949] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:24.754066] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T18:44:24.796956] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-09T18:44:24.845154] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-09T18:44:24.845280] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-09T18:44:24.846112] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-09T18:44:24.846203] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-09T18:44:24.847516] [DEBUG] [LOCAL ] EOS: Trimmed 23349 records to 15505 (keeping 200 days of data) [2025-10-09T18:44:24.977370] [DEBUG] [LOCAL ] EOS: Primary data saved (15505 records). [2025-10-09T18:44:24.977584] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-09T18:44:24.977742] [INFO ] [MAIN ] Update Progress: 749/2373 symbols completed. EOS took 22.8s. Estimated remaining: 3h 46m 16s. Rate: 7.2 symbols/min [2025-10-09T18:44:25.209757] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:25.253376] [DEBUG] [LOCAL ] EPAM: Loaded 39420 existing records from primary storage. [2025-10-09T18:44:25.253747] [INFO ] [MAIN ] EPAM: Loaded 39420 existing records. [2025-10-09T18:44:25.471213] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:25.471513] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-09T18:44:25.471578] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-09T18:44:25.471936] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-09T18:44:25.471995] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-09T18:44:25.596995] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-09T18:44:25.694808] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T18:44:25.864850] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:26.396687] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-09T18:44:26.685756] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T18:44:27.196778] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-09T18:44:27.222632] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T18:44:27.996725] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-09T18:44:28.675126] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T18:44:28.754508] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T18:44:28.796703] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-09T18:44:29.333079] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-09T18:44:29.596751] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-09T18:44:30.320867] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T18:44:30.396739] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-09T18:44:31.174754] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T18:44:31.196689] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-09T18:44:31.644886] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T18:44:31.996722] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-09T18:44:32.741822] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T18:44:32.796731] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-09T18:44:33.596723] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-09T18:44:34.004610] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T18:44:34.104036] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T18:44:34.396722] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-09T18:44:35.196697] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-09T18:44:35.205131] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T18:44:35.996749] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-09T18:44:36.477609] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:44:36.796730] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-09T18:44:37.078684] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T18:44:37.291593] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T18:44:37.596722] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-09T18:44:38.396712] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-09T18:44:38.493707] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T18:44:39.039383] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T18:44:39.041299] [INFO ] [REMOTE ] EOI: Full fetch complete (16224 records). [2025-10-09T18:44:39.041378] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-09T18:44:39.198685] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-09T18:44:39.414972] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-09T18:44:39.415060] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-09T18:44:39.415576] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-09T18:44:39.415661] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-09T18:44:39.416445] [DEBUG] [LOCAL ] EOI: Trimmed 16224 records to 10887 (keeping 200 days of data) [2025-10-09T18:44:39.483991] [DEBUG] [LOCAL ] EOI: Primary data saved (10887 records). [2025-10-09T18:44:39.484123] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-09T18:44:39.484262] [INFO ] [MAIN ] Update Progress: 750/2373 symbols completed. EOI took 39.8s. Estimated remaining: 3h 46m 21s. Rate: 7.2 symbols/min [2025-10-09T18:44:39.652451] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:39.689171] [DEBUG] [LOCAL ] EPC: Loaded 39795 existing records from primary storage. [2025-10-09T18:44:39.689466] [INFO ] [MAIN ] EPC: Loaded 39795 existing records. [2025-10-09T18:44:39.864190] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:39.864419] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-09T18:44:39.864465] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-09T18:44:39.864937] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-09T18:44:39.864998] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-09T18:44:40.003055] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-09T18:44:40.238114] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:40.337829] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T18:44:40.796756] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-09T18:44:41.436422] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T18:44:41.596728] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-09T18:44:41.999126] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-09T18:44:42.396775] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-09T18:44:42.700439] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T18:44:43.196713] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-09T18:44:43.283367] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T18:44:43.996778] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-09T18:44:44.331557] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T18:44:44.640104] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T18:44:44.796729] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-09T18:44:45.357552] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-09T18:44:45.358805] [INFO ] [REMOTE ] EOT: Full fetch complete (10626 records). [2025-10-09T18:44:45.358875] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-09T18:44:45.602039] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-09T18:44:45.736121] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-09T18:44:45.736560] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-09T18:44:45.736885] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-09T18:44:45.736946] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-09T18:44:45.737407] [DEBUG] [LOCAL ] EOT: Trimmed 10626 records to 6841 (keeping 200 days of data) [2025-10-09T18:44:45.780512] [DEBUG] [LOCAL ] EOT: Primary data saved (6841 records). [2025-10-09T18:44:45.780637] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-09T18:44:45.780763] [INFO ] [MAIN ] Update Progress: 751/2373 symbols completed. EOT took 38.4s. Estimated remaining: 3h 46m 8s. Rate: 7.2 symbols/min [2025-10-09T18:44:45.948597] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:46.000103] [DEBUG] [LOCAL ] EPD: Loaded 53611 existing records from primary storage. [2025-10-09T18:44:46.000451] [INFO ] [MAIN ] EPD: Loaded 53611 existing records. [2025-10-09T18:44:46.176854] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:46.177107] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-09T18:44:46.177168] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-09T18:44:46.177501] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-09T18:44:46.177561] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-09T18:44:46.402009] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-09T18:44:46.552945] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:46.820998] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T18:44:47.196719] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-09T18:44:47.626486] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T18:44:47.996722] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-09T18:44:48.572924] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:44:48.796727] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-09T18:44:49.596683] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-09T18:44:49.958116] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T18:44:50.030112] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:44:50.396741] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-09T18:44:51.196711] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-09T18:44:51.231350] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-09T18:44:51.838506] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:44:51.996709] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-09T18:44:52.753817] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T18:44:52.796690] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-09T18:44:53.602429] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-09T18:44:53.612763] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T18:44:54.396701] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-09T18:44:54.427140] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T18:44:55.019126] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T18:44:55.196763] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-09T18:44:55.589921] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T18:44:55.996723] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-09T18:44:56.315749] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T18:44:56.796764] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-09T18:44:57.596760] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-09T18:44:57.802111] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:44:58.128751] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T18:44:58.396768] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-09T18:44:58.505579] [DEBUG] [REMOTE ] EPAM: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-09T18:44:58.506248] [WARN ] [REMOTE ] EPAM: No data returned for month 2025-07 [2025-10-09T18:44:58.506431] [FATAL] [REMOTE ] EPAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:44:58.506576] [FATAL] [MAIN ] EPAM: Failed to fetch primary data. [2025-10-09T18:44:58.506678] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:44:58.506757] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-09T18:44:58.506841] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-09T18:44:58.506909] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-10-09T18:44:58.507172] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-10-09T18:44:58.507308] [INFO ] [MAIN ] Update Progress: 752/2373 symbols completed. EPAM took 33.5s. Estimated remaining: 3h 46m 9s. Rate: 7.2 symbols/min [2025-10-09T18:44:58.696199] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:44:58.739681] [DEBUG] [LOCAL ] EPR: Loaded 43947 existing records from primary storage. [2025-10-09T18:44:58.739983] [INFO ] [MAIN ] EPR: Loaded 43947 existing records. [2025-10-09T18:44:58.934925] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:44:58.944600] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-09T18:44:58.945178] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-09T18:44:58.945852] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T18:44:58.948124] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-09T18:44:58.952196] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-09T18:44:59.201917] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-09T18:44:59.317749] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:44:59.996744] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-09T18:45:00.788130] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:45:00.797112] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-09T18:45:01.596690] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-09T18:45:02.083160] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T18:45:02.396784] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-09T18:45:03.076958] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-09T18:45:03.095419] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T18:45:03.097937] [INFO ] [REMOTE ] EPAC: Full fetch complete (38765 records). [2025-10-09T18:45:03.098022] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-09T18:45:03.197201] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-09T18:45:03.482197] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-09T18:45:03.482314] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-09T18:45:03.483062] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-09T18:45:03.483127] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-09T18:45:03.484042] [DEBUG] [LOCAL ] EPAC: Trimmed 38765 records to 26880 (keeping 200 days of data) [2025-10-09T18:45:03.661822] [DEBUG] [LOCAL ] EPAC: Primary data saved (26880 records). [2025-10-09T18:45:03.661962] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-09T18:45:03.662068] [INFO ] [MAIN ] Update Progress: 753/2373 symbols completed. EPAC took 40.1s. Estimated remaining: 3h 45m 54s. Rate: 7.2 symbols/min [2025-10-09T18:45:03.833909] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:45:03.893327] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T18:45:03.918419] [DEBUG] [LOCAL ] EPRT: Loaded 48408 existing records from primary storage. [2025-10-09T18:45:03.919315] [INFO ] [MAIN ] EPRT: Loaded 48408 existing records. [2025-10-09T18:45:04.001864] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-09T18:45:04.108314] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:45:04.108602] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-09T18:45:04.108677] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-09T18:45:04.108962] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-09T18:45:04.109022] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-09T18:45:04.457467] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:45:04.758448] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T18:45:04.796672] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-09T18:45:05.596728] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-09T18:45:05.766315] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T18:45:06.335553] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T18:45:06.396719] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-09T18:45:07.196742] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-09T18:45:07.255747] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T18:45:07.479681] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:45:07.483087] [INFO ] [REMOTE ] EPC: Full fetch complete (57057 records). [2025-10-09T18:45:07.483182] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-09T18:45:07.901127] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-09T18:45:07.901216] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-09T18:45:07.902058] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-09T18:45:07.902125] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-09T18:45:07.903410] [DEBUG] [LOCAL ] EPC: Trimmed 57057 records to 40043 (keeping 200 days of data) [2025-10-09T18:45:07.999492] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-09T18:45:08.147743] [DEBUG] [LOCAL ] EPC: Primary data saved (40043 records). [2025-10-09T18:45:08.147906] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-09T18:45:08.148011] [INFO ] [MAIN ] Update Progress: 754/2373 symbols completed. EPC took 28.7s. Estimated remaining: 3h 45m 37s. Rate: 7.2 symbols/min [2025-10-09T18:45:08.313030] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:45:08.324794] [DEBUG] [LOCAL ] EQBK: Loaded 10961 existing records from primary storage. [2025-10-09T18:45:08.324994] [INFO ] [MAIN ] EQBK: Loaded 10961 existing records. [2025-10-09T18:45:08.502995] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:45:08.503309] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-09T18:45:08.503393] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-09T18:45:08.503753] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-09T18:45:08.503891] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-09T18:45:08.805432] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-09T18:45:08.863458] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:45:08.904024] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:45:09.377861] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:45:09.596763] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-09T18:45:10.396726] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-09T18:45:10.721266] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-09T18:45:11.196732] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-09T18:45:11.304315] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T18:45:12.008424] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-09T18:45:12.010838] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T18:45:12.796725] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-09T18:45:12.885972] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T18:45:13.506483] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-09T18:45:13.596712] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-09T18:45:14.396806] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-09T18:45:14.627397] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T18:45:15.196758] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-09T18:45:15.856231] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-09T18:45:15.996672] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-09T18:45:16.031215] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T18:45:16.615789] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T18:45:16.796768] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-09T18:45:17.596812] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-09T18:45:18.030084] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-09T18:45:18.089577] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T18:45:18.396725] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-09T18:45:19.196792] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-09T18:45:19.274354] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T18:45:19.865697] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T18:45:19.939808] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T18:45:19.945190] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-09T18:45:19.945364] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-09T18:45:20.002033] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-09T18:45:20.387612] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-09T18:45:20.387762] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-09T18:45:20.389105] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-09T18:45:20.389185] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-09T18:45:20.390881] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 54001 (keeping 200 days of data) [2025-10-09T18:45:20.728444] [DEBUG] [LOCAL ] EPD: Primary data saved (54001 records). [2025-10-09T18:45:20.728594] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-09T18:45:20.729247] [INFO ] [MAIN ] Update Progress: 755/2373 symbols completed. EPD took 34.9s. Estimated remaining: 3h 45m 38s. Rate: 7.2 symbols/min [2025-10-09T18:45:20.802914] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-09T18:45:20.900440] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:45:20.953397] [DEBUG] [LOCAL ] EQH: Loaded 52650 existing records from primary storage. [2025-10-09T18:45:20.953780] [INFO ] [MAIN ] EQH: Loaded 52650 existing records. [2025-10-09T18:45:21.128636] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:45:21.128883] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-09T18:45:21.128935] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-09T18:45:21.129270] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-09T18:45:21.129327] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-09T18:45:21.493311] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:45:21.596702] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-09T18:45:21.604246] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T18:45:21.939155] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T18:45:22.396722] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-09T18:45:23.029794] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T18:45:23.196744] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-09T18:45:23.991424] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:45:24.001679] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-09T18:45:24.656426] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T18:45:24.796702] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-09T18:45:24.970687] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-09T18:45:25.596720] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-09T18:45:26.396772] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-09T18:45:26.439173] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T18:45:27.012497] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T18:45:27.196769] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-09T18:45:27.305245] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T18:45:27.996743] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-09T18:45:28.425081] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T18:45:28.796742] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-09T18:45:29.596725] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-09T18:45:29.877871] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T18:45:30.315390] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T18:45:30.351204] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T18:45:30.396678] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-09T18:45:31.196724] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-09T18:45:31.902998] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T18:45:31.996665] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-09T18:45:32.703795] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T18:45:32.707545] [INFO ] [REMOTE ] EPR: Full fetch complete (63048 records). [2025-10-09T18:45:32.707681] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-09T18:45:32.804382] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-09T18:45:33.095819] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-09T18:45:33.095898] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-09T18:45:33.096725] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-09T18:45:33.096787] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-09T18:45:33.098034] [DEBUG] [LOCAL ] EPR: Trimmed 63048 records to 44256 (keeping 200 days of data) [2025-10-09T18:45:33.365768] [DEBUG] [LOCAL ] EPR: Primary data saved (44256 records). [2025-10-09T18:45:33.366002] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-09T18:45:33.366101] [INFO ] [MAIN ] Update Progress: 756/2373 symbols completed. EPR took 34.9s. Estimated remaining: 3h 45m 39s. Rate: 7.2 symbols/min [2025-10-09T18:45:33.549369] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:45:33.605084] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-09T18:45:33.620382] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T18:45:33.618862] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T18:45:33.651119] [DEBUG] [LOCAL ] EQNR: Loaded 53032 existing records from primary storage. [2025-10-09T18:45:33.651916] [INFO ] [MAIN ] EQNR: Loaded 53032 existing records. [2025-10-09T18:45:33.827185] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:45:33.827402] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-09T18:45:33.827470] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-09T18:45:33.827998] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-09T18:45:33.828056] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-09T18:45:34.172833] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:45:34.396709] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-09T18:45:34.938529] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T18:45:35.196698] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-09T18:45:35.428514] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T18:45:35.996715] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-09T18:45:36.796691] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-09T18:45:36.985016] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T18:45:37.452683] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T18:45:37.596710] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-09T18:45:38.396713] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-09T18:45:38.699878] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-09T18:45:39.157054] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:45:39.163991] [INFO ] [REMOTE ] EPRT: Full fetch complete (68987 records). [2025-10-09T18:45:39.164254] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-09T18:45:39.201878] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-09T18:45:39.580604] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-09T18:45:39.580778] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-09T18:45:39.581803] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-09T18:45:39.581870] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-09T18:45:39.583359] [DEBUG] [LOCAL ] EPRT: Trimmed 68987 records to 48787 (keeping 200 days of data) [2025-10-09T18:45:39.908403] [DEBUG] [LOCAL ] EPRT: Primary data saved (48787 records). [2025-10-09T18:45:39.908560] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-09T18:45:39.909501] [INFO ] [MAIN ] Update Progress: 757/2373 symbols completed. EPRT took 36.2s. Estimated remaining: 3h 45m 26s. Rate: 7.2 symbols/min [2025-10-09T18:45:39.996702] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-09T18:45:40.157738] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T18:45:40.713009] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T18:45:40.796747] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-09T18:45:40.929258] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T18:45:41.467185] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T18:45:41.596764] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-09T18:45:42.396812] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-09T18:45:43.045469] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T18:45:43.196677] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-09T18:45:43.996744] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-09T18:45:44.033330] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T18:45:44.627347] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T18:45:44.789044] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-09T18:45:44.790505] [INFO ] [REMOTE ] EQBK: Full fetch complete (15481 records). [2025-10-09T18:45:44.790582] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-09T18:45:44.802353] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-09T18:45:45.209818] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-09T18:45:45.209932] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-09T18:45:45.210293] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-09T18:45:45.210332] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-09T18:45:45.210913] [DEBUG] [LOCAL ] EQBK: Trimmed 15481 records to 11036 (keeping 200 days of data) [2025-10-09T18:45:45.280603] [DEBUG] [LOCAL ] EQBK: Primary data saved (11036 records). [2025-10-09T18:45:45.280820] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-09T18:45:45.280914] [INFO ] [MAIN ] Update Progress: 758/2373 symbols completed. EQBK took 37.1s. Estimated remaining: 3h 45m 12s. Rate: 7.2 symbols/min [2025-10-09T18:45:45.596824] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-09T18:45:46.571062] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:45:46.586333] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-09T18:45:47.009037] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T18:45:47.196756] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-09T18:45:48.696765] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-09T18:45:48.708273] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-09T18:45:48.935989] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:45:48.940662] [INFO ] [REMOTE ] EQH: Full fetch complete (76393 records). [2025-10-09T18:45:48.940822] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-09T18:45:49.329146] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-09T18:45:49.329241] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-09T18:45:49.330197] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-09T18:45:49.330266] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-09T18:45:49.331807] [DEBUG] [LOCAL ] EQH: Trimmed 76393 records to 53036 (keeping 200 days of data) [2025-10-09T18:45:49.660787] [DEBUG] [LOCAL ] EQH: Primary data saved (53036 records). [2025-10-09T18:45:49.660963] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-09T18:45:49.661524] [INFO ] [MAIN ] Update Progress: 759/2373 symbols completed. EQH took 28.9s. Estimated remaining: 3h 44m 55s. Rate: 7.2 symbols/min [2025-10-09T18:45:50.444583] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T18:45:50.456238] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-09T18:45:52.093157] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T18:45:52.104210] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-09T18:45:53.734354] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T18:45:53.747353] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-09T18:45:55.391212] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T18:45:55.405185] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-09T18:45:57.309013] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T18:45:57.321026] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-09T18:45:59.301245] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-09T18:45:59.306173] [INFO ] [REMOTE ] EQNR: Full fetch complete (76808 records). [2025-10-09T18:45:59.306316] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-09T18:45:59.704172] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-09T18:45:59.704291] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-09T18:45:59.705369] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-09T18:45:59.705436] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-09T18:45:59.707115] [DEBUG] [LOCAL ] EQNR: Trimmed 76808 records to 53406 (keeping 200 days of data) [2025-10-09T18:46:00.032137] [DEBUG] [LOCAL ] EQNR: Primary data saved (53406 records). [2025-10-09T18:46:00.032297] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-09T18:46:00.032413] [INFO ] [MAIN ] Update Progress: 760/2373 symbols completed. EQNR took 26.7s. Estimated remaining: 3h 44m 51s. Rate: 7.2 symbols/min [2025-10-09T18:46:00.700577] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:00.688243] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:00.730685] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:00.748639] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:00.749583] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-09T18:46:00.749660] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-09T18:46:00.749811] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-09T18:46:00.749859] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-09T18:46:00.749984] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-09T18:46:00.750042] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-09T18:46:00.820520] [DEBUG] [LOCAL ] EQV: Loaded 2709 existing records from primary storage. [2025-10-09T18:46:00.839503] [INFO ] [MAIN ] EQV: Loaded 2709 existing records. [2025-10-09T18:46:01.309058] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-09T18:46:01.315715] [DEBUG] [LOCAL ] EQR: Loaded 51608 existing records from primary storage. [2025-10-09T18:46:01.350829] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-10-09T18:46:01.360153] [INFO ] [MAIN ] EQR: Loaded 51608 existing records. [2025-10-09T18:46:01.359998] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:01.413521] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-09T18:46:01.442377] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-09T18:46:01.624858] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-09T18:46:01.694807] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:01.687368] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-09T18:46:01.781212] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-09T18:46:01.813485] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:01.856588] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-09T18:46:01.877679] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-09T18:46:01.914502] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-09T18:46:01.931204] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-09T18:46:01.925918] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:02.023912] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-09T18:46:02.037939] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-09T18:46:02.095411] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-09T18:46:02.131976] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-09T18:46:02.578031] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T18:46:02.704680] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-09T18:46:02.791050] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:02.817597] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-09T18:46:02.874461] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:02.905744] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-09T18:46:03.023052] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:03.023318] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-09T18:46:03.134151] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-09T18:46:03.135128] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-09T18:46:03.509000] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-09T18:46:03.510456] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-09T18:46:03.628754] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T18:46:03.630986] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-09T18:46:03.815603] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-09T18:46:03.817026] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-09T18:46:04.077874] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-09T18:46:04.079046] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-09T18:46:04.209548] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T18:46:04.212009] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-09T18:46:04.460681] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-09T18:46:04.461846] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-09T18:46:04.731265] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T18:46:04.741192] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-09T18:46:04.798165] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-09T18:46:04.799371] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-09T18:46:04.803840] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T18:46:04.805681] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-09T18:46:04.970257] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-09T18:46:04.981221] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-09T18:46:05.109790] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-09T18:46:05.349873] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T18:46:05.596721] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-09T18:46:06.033454] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T18:46:06.403183] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-09T18:46:06.422824] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T18:46:06.883118] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T18:46:06.987858] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-09T18:46:07.196722] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-09T18:46:07.996733] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-09T18:46:08.796690] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-09T18:46:08.866675] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:46:09.241724] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:46:09.455915] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:46:09.596692] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-09T18:46:10.396780] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-09T18:46:10.853881] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T18:46:11.125719] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T18:46:11.196699] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-09T18:46:11.827746] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T18:46:11.996723] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-09T18:46:12.595215] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T18:46:12.596232] [INFO ] [REMOTE ] EQS: Full fetch complete (2479 records). [2025-10-09T18:46:12.596322] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-09T18:46:12.801979] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-09T18:46:12.806017] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-09T18:46:12.807057] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:46:12.807133] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:46:12.807191] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-09T18:46:12.807246] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-09T18:46:12.807283] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-09T18:46:12.807324] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-09T18:46:12.807385] [INFO ] [MAIN ] Update Progress: 761/2373 symbols completed. EQS took 12.8s. Estimated remaining: 3h 44m 52s. Rate: 7.2 symbols/min [2025-10-09T18:46:12.979770] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:13.028021] [DEBUG] [LOCAL ] ERJ: Loaded 50464 existing records from primary storage. [2025-10-09T18:46:13.028341] [INFO ] [MAIN ] ERJ: Loaded 50464 existing records. [2025-10-09T18:46:13.205178] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:13.205412] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-09T18:46:13.205461] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-09T18:46:13.205816] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-09T18:46:13.205876] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-09T18:46:13.558836] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:13.596674] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-09T18:46:14.066332] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T18:46:14.396746] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-09T18:46:15.018433] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-09T18:46:15.196734] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-09T18:46:15.719084] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T18:46:15.773962] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T18:46:15.996695] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-09T18:46:16.796745] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-09T18:46:17.509068] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T18:46:17.596688] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-09T18:46:18.162873] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T18:46:18.396756] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-09T18:46:19.062295] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T18:46:19.196693] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-09T18:46:19.303873] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T18:46:19.996737] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-09T18:46:20.796749] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-09T18:46:20.857087] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T18:46:21.319377] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:46:21.367683] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T18:46:21.368394] [INFO ] [REMOTE ] EQV: Full fetch complete (5743 records). [2025-10-09T18:46:21.368500] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-09T18:46:21.603970] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-09T18:46:21.721730] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-09T18:46:21.721813] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-09T18:46:21.721977] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-09T18:46:21.722016] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-09T18:46:21.722389] [DEBUG] [LOCAL ] EQV: Trimmed 5743 records to 2713 (keeping 200 days of data) [2025-10-09T18:46:21.738863] [DEBUG] [LOCAL ] EQV: Primary data saved (2713 records). [2025-10-09T18:46:21.738938] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-09T18:46:21.739010] [INFO ] [MAIN ] Update Progress: 762/2373 symbols completed. EQV took 21.7s. Estimated remaining: 3h 44m 45s. Rate: 7.2 symbols/min [2025-10-09T18:46:21.933300] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:21.981005] [DEBUG] [LOCAL ] ERO: Loaded 41514 existing records from primary storage. [2025-10-09T18:46:21.981308] [INFO ] [MAIN ] ERO: Loaded 41514 existing records. [2025-10-09T18:46:22.192525] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:22.192762] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-09T18:46:22.192813] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-09T18:46:22.193093] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-09T18:46:22.193134] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-09T18:46:22.406890] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-09T18:46:22.603119] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:23.015054] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T18:46:23.196723] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-09T18:46:23.996705] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-09T18:46:24.175066] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T18:46:24.726424] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:46:24.796693] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-09T18:46:25.596743] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-09T18:46:25.765673] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T18:46:26.396724] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-09T18:46:26.820254] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-09T18:46:26.890464] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T18:46:27.196709] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-09T18:46:27.908063] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T18:46:27.996682] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-09T18:46:28.796695] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-09T18:46:28.931743] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T18:46:29.596729] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-09T18:46:30.116403] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:46:30.122734] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-09T18:46:30.396729] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-09T18:46:31.197122] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-09T18:46:31.197007] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T18:46:31.439051] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T18:46:31.996723] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-09T18:46:32.699602] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T18:46:32.796738] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-09T18:46:33.585891] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T18:46:33.596954] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-09T18:46:34.286192] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T18:46:34.396705] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-09T18:46:34.917464] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T18:46:34.921911] [INFO ] [REMOTE ] EQR: Full fetch complete (74138 records). [2025-10-09T18:46:34.922019] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-09T18:46:35.201846] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-09T18:46:35.323305] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-09T18:46:35.323384] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-09T18:46:35.324292] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-09T18:46:35.324357] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-09T18:46:35.325810] [DEBUG] [LOCAL ] EQR: Trimmed 74138 records to 51995 (keeping 200 days of data) [2025-10-09T18:46:35.654589] [DEBUG] [LOCAL ] EQR: Primary data saved (51995 records). [2025-10-09T18:46:35.654772] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-09T18:46:35.654862] [INFO ] [MAIN ] Update Progress: 763/2373 symbols completed. EQR took 35.6s. Estimated remaining: 3h 44m 48s. Rate: 7.2 symbols/min [2025-10-09T18:46:35.848721] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:35.901031] [DEBUG] [LOCAL ] ES: Loaded 52628 existing records from primary storage. [2025-10-09T18:46:35.901369] [INFO ] [MAIN ] ES: Loaded 52628 existing records. [2025-10-09T18:46:36.000848] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-09T18:46:36.081065] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:36.081693] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-09T18:46:36.081868] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-09T18:46:36.082342] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-09T18:46:36.082398] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-09T18:46:36.455759] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:36.486621] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-09T18:46:36.804258] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-09T18:46:36.825565] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T18:46:37.275247] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T18:46:37.596810] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-09T18:46:38.394276] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T18:46:38.406243] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-09T18:46:39.196742] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-09T18:46:39.331510] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T18:46:39.811928] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T18:46:39.996695] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-09T18:46:40.773552] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T18:46:40.778048] [INFO ] [REMOTE ] EQT: Full fetch complete (77694 records). [2025-10-09T18:46:40.778159] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-09T18:46:40.808754] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-09T18:46:41.186308] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-09T18:46:41.186420] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-09T18:46:41.187478] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-09T18:46:41.187663] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-09T18:46:41.189495] [DEBUG] [LOCAL ] EQT: Trimmed 77694 records to 54072 (keeping 200 days of data) [2025-10-09T18:46:41.340090] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T18:46:41.555798] [DEBUG] [LOCAL ] EQT: Primary data saved (54072 records). [2025-10-09T18:46:41.555939] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-09T18:46:41.556843] [INFO ] [MAIN ] Update Progress: 764/2373 symbols completed. EQT took 41.5s. Estimated remaining: 3h 44m 34s. Rate: 7.2 symbols/min [2025-10-09T18:46:41.601882] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-09T18:46:41.727503] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:41.757094] [DEBUG] [LOCAL ] ESAB: Loaded 26086 existing records from primary storage. [2025-10-09T18:46:41.757373] [INFO ] [MAIN ] ESAB: Loaded 26086 existing records. [2025-10-09T18:46:41.935552] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:41.935807] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-09T18:46:41.935855] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-09T18:46:41.936065] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-09T18:46:41.936121] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-09T18:46:42.329402] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:42.372371] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T18:46:42.396674] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-09T18:46:42.899435] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T18:46:43.196737] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-09T18:46:43.478859] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T18:46:43.996754] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-09T18:46:44.780082] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T18:46:44.796668] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-09T18:46:45.597157] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-09T18:46:45.597003] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T18:46:45.803873] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T18:46:46.396685] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-09T18:46:46.545564] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-09T18:46:47.196772] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-09T18:46:47.997966] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-09T18:46:48.003209] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T18:46:48.307362] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T18:46:48.796797] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-09T18:46:49.458230] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T18:46:49.596668] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-09T18:46:50.002055] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T18:46:50.396756] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-09T18:46:51.152289] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-09T18:46:51.196746] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-09T18:46:51.941721] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T18:46:51.946322] [INFO ] [REMOTE ] ERO: Full fetch complete (59775 records). [2025-10-09T18:46:51.946475] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-09T18:46:52.007592] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-09T18:46:52.357550] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-09T18:46:52.357634] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-09T18:46:52.358490] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-09T18:46:52.358555] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-09T18:46:52.359812] [DEBUG] [LOCAL ] ERO: Trimmed 59775 records to 41893 (keeping 200 days of data) [2025-10-09T18:46:52.577331] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T18:46:52.582892] [INFO ] [REMOTE ] ERJ: Full fetch complete (72379 records). [2025-10-09T18:46:52.583523] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-09T18:46:52.802333] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-09T18:46:53.006383] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-09T18:46:53.007021] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-09T18:46:53.008244] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-09T18:46:53.008327] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-09T18:46:53.024490] [DEBUG] [LOCAL ] ERJ: Trimmed 72379 records to 50781 (keeping 200 days of data) [2025-10-09T18:46:53.026177] [DEBUG] [LOCAL ] ERO: Primary data saved (41893 records). [2025-10-09T18:46:53.026286] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-09T18:46:53.026578] [INFO ] [MAIN ] Update Progress: 765/2373 symbols completed. ERO took 31.3s. Estimated remaining: 3h 44m 32s. Rate: 7.2 symbols/min [2025-10-09T18:46:53.294845] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:53.319051] [DEBUG] [LOCAL ] ESE: Loaded 16540 existing records from primary storage. [2025-10-09T18:46:53.320082] [INFO ] [MAIN ] ESE: Loaded 16540 existing records. [2025-10-09T18:46:53.514247] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:53.514552] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-09T18:46:53.514709] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-09T18:46:53.514976] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-09T18:46:53.515035] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-09T18:46:53.996891] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:53.998451] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-09T18:46:54.047416] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-09T18:46:54.071069] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T18:46:54.151857] [DEBUG] [LOCAL ] ERJ: Primary data saved (50781 records). [2025-10-09T18:46:54.151997] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-09T18:46:54.152080] [INFO ] [MAIN ] Update Progress: 766/2373 symbols completed. ERJ took 41.3s. Estimated remaining: 3h 44m 9s. Rate: 7.2 symbols/min [2025-10-09T18:46:54.317258] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:46:54.364087] [DEBUG] [LOCAL ] ESI: Loaded 50673 existing records from primary storage. [2025-10-09T18:46:54.364415] [INFO ] [MAIN ] ESI: Loaded 50673 existing records. [2025-10-09T18:46:54.406725] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-09T18:46:54.543039] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:46:54.543217] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-09T18:46:54.543264] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-09T18:46:54.543484] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-09T18:46:54.543541] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-09T18:46:54.852966] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T18:46:54.920931] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:46:55.196695] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-09T18:46:55.533221] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T18:46:55.996748] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-09T18:46:56.271208] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T18:46:56.796774] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-09T18:46:57.596695] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-09T18:46:58.102837] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-09T18:46:58.396732] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-09T18:46:58.456431] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T18:46:58.480891] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T18:46:59.196762] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-09T18:46:59.996766] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-09T18:47:00.230531] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T18:47:00.768900] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T18:47:00.796686] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-09T18:47:01.222547] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:47:01.596784] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-09T18:47:02.396723] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-09T18:47:02.504829] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T18:47:03.196749] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-09T18:47:03.452899] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-09T18:47:03.992170] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T18:47:04.002786] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-09T18:47:04.183243] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T18:47:04.796713] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-09T18:47:05.378281] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:47:05.596755] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-09T18:47:06.396724] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-09T18:47:06.697621] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T18:47:06.796535] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-09T18:47:07.196731] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-09T18:47:07.985584] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T18:47:07.997060] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-09T18:47:08.556815] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T18:47:08.796741] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-09T18:47:09.593155] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-09T18:47:09.598360] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-09T18:47:10.045479] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T18:47:10.048002] [INFO ] [REMOTE ] ESAB: Full fetch complete (35827 records). [2025-10-09T18:47:10.048077] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-09T18:47:10.402001] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-09T18:47:10.444370] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-09T18:47:10.444468] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-09T18:47:10.445217] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-09T18:47:10.445284] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-09T18:47:10.446323] [DEBUG] [LOCAL ] ESAB: Trimmed 35827 records to 26259 (keeping 200 days of data) [2025-10-09T18:47:10.619946] [DEBUG] [LOCAL ] ESAB: Primary data saved (26259 records). [2025-10-09T18:47:10.620088] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-09T18:47:10.620173] [INFO ] [MAIN ] Update Progress: 767/2373 symbols completed. ESAB took 29.1s. Estimated remaining: 3h 44m 17s. Rate: 7.2 symbols/min [2025-10-09T18:47:10.793809] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:10.835582] [DEBUG] [LOCAL ] ESNT: Loaded 38246 existing records from primary storage. [2025-10-09T18:47:10.835900] [INFO ] [MAIN ] ESNT: Loaded 38246 existing records. [2025-10-09T18:47:11.023021] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:11.023437] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-09T18:47:11.023553] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-09T18:47:11.023928] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-09T18:47:11.024023] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-09T18:47:11.223048] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-09T18:47:11.397484] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:11.428315] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T18:47:11.514589] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T18:47:11.996780] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-09T18:47:12.796715] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-09T18:47:12.896314] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T18:47:13.438915] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T18:47:13.596724] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-09T18:47:13.751124] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:47:13.755989] [INFO ] [REMOTE ] ES: Full fetch complete (76239 records). [2025-10-09T18:47:13.756146] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-09T18:47:14.158948] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-09T18:47:14.159041] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-09T18:47:14.159987] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-09T18:47:14.160050] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-09T18:47:14.161477] [DEBUG] [LOCAL ] ES: Trimmed 76239 records to 53014 (keeping 200 days of data) [2025-10-09T18:47:14.396885] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-09T18:47:14.492209] [DEBUG] [LOCAL ] ES: Primary data saved (53014 records). [2025-10-09T18:47:14.492368] [INFO ] [MAIN ] ES: Full history saved. [2025-10-09T18:47:14.492473] [INFO ] [MAIN ] Update Progress: 768/2373 symbols completed. ES took 38.8s. Estimated remaining: 3h 43m 60s. Rate: 7.2 symbols/min [2025-10-09T18:47:14.664438] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:14.705977] [DEBUG] [LOCAL ] ESRT: Loaded 46356 existing records from primary storage. [2025-10-09T18:47:14.706315] [INFO ] [MAIN ] ESRT: Loaded 46356 existing records. [2025-10-09T18:47:14.892791] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:14.893446] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-09T18:47:14.893771] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-09T18:47:14.894134] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-09T18:47:14.894261] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-09T18:47:15.026869] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T18:47:15.202632] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-09T18:47:15.295938] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:15.996750] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-09T18:47:16.803426] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-09T18:47:16.805659] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T18:47:16.901021] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-09T18:47:17.596759] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-09T18:47:17.814866] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T18:47:17.858273] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-09T18:47:18.396760] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-09T18:47:19.196693] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-09T18:47:19.364200] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T18:47:19.466206] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T18:47:19.996848] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-09T18:47:20.464185] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T18:47:20.796859] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-09T18:47:21.353239] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:47:21.357858] [INFO ] [REMOTE ] ESI: Full fetch complete (72859 records). [2025-10-09T18:47:21.358028] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-09T18:47:21.601819] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-09T18:47:21.764942] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-09T18:47:21.765027] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-09T18:47:21.765931] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-09T18:47:21.765995] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-09T18:47:21.767468] [DEBUG] [LOCAL ] ESI: Trimmed 72859 records to 51049 (keeping 200 days of data) [2025-10-09T18:47:22.082886] [DEBUG] [LOCAL ] ESI: Primary data saved (51049 records). [2025-10-09T18:47:22.083019] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-09T18:47:22.083101] [INFO ] [MAIN ] Update Progress: 769/2373 symbols completed. ESI took 27.9s. Estimated remaining: 3h 43m 50s. Rate: 7.2 symbols/min [2025-10-09T18:47:22.280663] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:22.277639] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T18:47:22.318950] [DEBUG] [LOCAL ] ESS: Loaded 29778 existing records from primary storage. [2025-10-09T18:47:22.319240] [INFO ] [MAIN ] ESS: Loaded 29778 existing records. [2025-10-09T18:47:22.401784] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-09T18:47:22.506841] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:22.507169] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-09T18:47:22.507228] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-09T18:47:22.507443] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-09T18:47:22.507501] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-09T18:47:22.831904] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:47:22.898438] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:23.196810] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-09T18:47:23.996744] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-09T18:47:24.141756] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T18:47:24.440821] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:47:24.796793] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-09T18:47:25.104379] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T18:47:25.596778] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-09T18:47:26.295744] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T18:47:26.396726] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-09T18:47:26.790354] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T18:47:27.196777] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-09T18:47:27.370058] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T18:47:27.996743] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-09T18:47:28.659580] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T18:47:28.796739] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-09T18:47:29.603104] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-09T18:47:29.622860] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T18:47:29.988073] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:47:30.396681] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-09T18:47:30.692563] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T18:47:31.196767] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-09T18:47:31.489214] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T18:47:31.996704] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-09T18:47:32.109001] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T18:47:32.110739] [INFO ] [REMOTE ] ESE: Full fetch complete (22428 records). [2025-10-09T18:47:32.110824] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-09T18:47:32.481207] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-09T18:47:32.481290] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-09T18:47:32.481850] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-09T18:47:32.481915] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-09T18:47:32.482563] [DEBUG] [LOCAL ] ESE: Trimmed 22428 records to 16664 (keeping 200 days of data) [2025-10-09T18:47:32.595349] [DEBUG] [LOCAL ] ESE: Primary data saved (16664 records). [2025-10-09T18:47:32.595565] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-09T18:47:32.595727] [INFO ] [MAIN ] Update Progress: 770/2373 symbols completed. ESE took 39.6s. Estimated remaining: 3h 43m 46s. Rate: 7.2 symbols/min [2025-10-09T18:47:32.769892] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:32.796843] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-09T18:47:32.822628] [DEBUG] [LOCAL ] ESTC: Loaded 50106 existing records from primary storage. [2025-10-09T18:47:32.823012] [INFO ] [MAIN ] ESTC: Loaded 50106 existing records. [2025-10-09T18:47:33.033020] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:33.033255] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-09T18:47:33.033302] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-09T18:47:33.033702] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-09T18:47:33.033763] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-09T18:47:33.415855] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:33.601840] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-09T18:47:33.617238] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T18:47:34.163505] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T18:47:34.396720] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-09T18:47:35.078864] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T18:47:35.196751] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-09T18:47:35.691441] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T18:47:35.996752] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-09T18:47:36.766611] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-09T18:47:36.796724] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-09T18:47:37.499894] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T18:47:37.596683] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-09T18:47:37.867489] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T18:47:38.396696] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-09T18:47:38.886174] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T18:47:39.196718] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-09T18:47:39.756956] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T18:47:39.996788] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-09T18:47:40.265292] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T18:47:40.796718] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-09T18:47:41.423191] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T18:47:41.596719] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-09T18:47:41.818898] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T18:47:42.396747] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-09T18:47:42.956489] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:47:42.960181] [INFO ] [REMOTE ] ESNT: Full fetch complete (57147 records). [2025-10-09T18:47:42.960303] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-09T18:47:43.201878] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-09T18:47:43.357045] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-09T18:47:43.357127] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-09T18:47:43.357938] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-09T18:47:43.358003] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-09T18:47:43.359109] [DEBUG] [LOCAL ] ESNT: Trimmed 57147 records to 38557 (keeping 200 days of data) [2025-10-09T18:47:43.609948] [DEBUG] [LOCAL ] ESNT: Primary data saved (38557 records). [2025-10-09T18:47:43.610157] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-09T18:47:43.611165] [INFO ] [MAIN ] Update Progress: 771/2373 symbols completed. ESNT took 33.0s. Estimated remaining: 3h 43m 43s. Rate: 7.2 symbols/min [2025-10-09T18:47:43.792087] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:43.844635] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-09T18:47:43.845063] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-09T18:47:44.021368] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-09T18:47:44.051230] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:44.054622] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:47:44.053065] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-09T18:47:44.064386] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-09T18:47:44.065558] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-09T18:47:44.065623] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-09T18:47:44.439171] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:44.796700] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-09T18:47:44.964987] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T18:47:45.450078] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T18:47:45.596702] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-09T18:47:46.066404] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T18:47:46.396731] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-09T18:47:47.196695] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-09T18:47:47.548200] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T18:47:47.619859] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T18:47:47.996726] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-09T18:47:48.647562] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T18:47:48.651719] [INFO ] [REMOTE ] ESRT: Full fetch complete (66502 records). [2025-10-09T18:47:48.651872] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-09T18:47:48.802483] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-09T18:47:49.048673] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-09T18:47:49.048764] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-09T18:47:49.049589] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-09T18:47:49.049630] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-09T18:47:49.050978] [DEBUG] [LOCAL ] ESRT: Trimmed 66502 records to 46673 (keeping 200 days of data) [2025-10-09T18:47:49.325163] [DEBUG] [LOCAL ] ESRT: Primary data saved (46673 records). [2025-10-09T18:47:49.325297] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-09T18:47:49.325379] [INFO ] [MAIN ] Update Progress: 772/2373 symbols completed. ESRT took 34.8s. Estimated remaining: 3h 43m 29s. Rate: 7.2 symbols/min [2025-10-09T18:47:49.495525] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:47:49.509912] [DEBUG] [LOCAL ] ETB: Loaded 12203 existing records from primary storage. [2025-10-09T18:47:49.510132] [INFO ] [MAIN ] ETB: Loaded 12203 existing records. [2025-10-09T18:47:49.605745] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-09T18:47:49.688896] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:47:49.690236] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-09T18:47:49.690284] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-09T18:47:49.690526] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-09T18:47:49.690583] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-09T18:47:50.047081] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:47:50.076732] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T18:47:50.165811] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T18:47:50.396732] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-09T18:47:51.196724] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-09T18:47:51.375349] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T18:47:51.686226] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-09T18:47:51.996674] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-09T18:47:52.498464] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-09T18:47:52.796716] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-09T18:47:53.374091] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T18:47:53.538183] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T18:47:53.596707] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-09T18:47:54.396722] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-09T18:47:55.196740] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-09T18:47:55.497107] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T18:47:55.996747] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-09T18:47:56.464722] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T18:47:56.548357] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-10-09T18:47:56.796793] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-09T18:47:57.596788] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-09T18:47:58.001989] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T18:47:58.061398] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T18:47:58.396717] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-09T18:47:59.196760] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-09T18:47:59.350096] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T18:47:59.353587] [INFO ] [REMOTE ] ESS: Full fetch complete (43234 records). [2025-10-09T18:47:59.353737] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-09T18:47:59.739378] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-09T18:47:59.739458] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-09T18:47:59.740120] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-09T18:47:59.740183] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-09T18:47:59.741115] [DEBUG] [LOCAL ] ESS: Trimmed 43234 records to 29941 (keeping 200 days of data) [2025-10-09T18:47:59.935334] [DEBUG] [LOCAL ] ESS: Primary data saved (29941 records). [2025-10-09T18:47:59.935781] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-09T18:47:59.935876] [INFO ] [MAIN ] Update Progress: 773/2373 symbols completed. ESS took 37.9s. Estimated remaining: 3h 43m 25s. Rate: 7.2 symbols/min [2025-10-09T18:48:00.002445] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-09T18:48:00.114975] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:00.143021] [DEBUG] [LOCAL ] ETD: Loaded 27379 existing records from primary storage. [2025-10-09T18:48:00.143281] [INFO ] [MAIN ] ETD: Loaded 27379 existing records. [2025-10-09T18:48:00.325796] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:00.326241] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-09T18:48:00.326390] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-09T18:48:00.326947] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-09T18:48:00.327006] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-09T18:48:00.712295] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:00.714949] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-09T18:48:00.796700] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-09T18:48:01.305545] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T18:48:01.596721] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-09T18:48:02.224211] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T18:48:02.303166] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-10-09T18:48:02.396701] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-09T18:48:03.079093] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T18:48:03.196747] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-09T18:48:03.659210] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-09T18:48:03.996727] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-09T18:48:04.656151] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T18:48:04.796772] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-09T18:48:05.519325] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-09T18:48:05.595998] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T18:48:05.598560] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-09T18:48:06.396807] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-09T18:48:07.196759] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-09T18:48:07.257976] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:48:07.336382] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-09T18:48:07.661136] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T18:48:07.996732] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-09T18:48:08.796744] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-09T18:48:09.596700] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-09T18:48:09.643428] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T18:48:09.645254] [INFO ] [REMOTE ] ETB: Full fetch complete (18334 records). [2025-10-09T18:48:09.645439] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-09T18:48:10.039734] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-09T18:48:10.039875] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-09T18:48:10.040483] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-09T18:48:10.040569] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-09T18:48:10.041561] [DEBUG] [LOCAL ] ETB: Trimmed 18334 records to 12264 (keeping 200 days of data) [2025-10-09T18:48:10.109838] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-09T18:48:10.168704] [DEBUG] [LOCAL ] ETB: Primary data saved (12264 records). [2025-10-09T18:48:10.168888] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-09T18:48:10.169004] [INFO ] [MAIN ] Update Progress: 774/2373 symbols completed. ETB took 20.8s. Estimated remaining: 3h 43m 21s. Rate: 7.2 symbols/min [2025-10-09T18:48:10.345958] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:10.365927] [DEBUG] [LOCAL ] ETG: Loaded 16576 existing records from primary storage. [2025-10-09T18:48:10.366271] [INFO ] [MAIN ] ETG: Loaded 16576 existing records. [2025-10-09T18:48:10.401911] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-09T18:48:10.556331] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:10.556567] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-09T18:48:10.556615] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-09T18:48:10.556879] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-09T18:48:10.556939] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-09T18:48:10.921564] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:11.196730] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-09T18:48:11.996748] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-09T18:48:12.873406] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-09T18:48:12.892466] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (3.30 seconds). [2025-10-09T18:48:12.906322] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-09T18:48:12.936598] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T18:48:13.596729] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-09T18:48:13.627721] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-10-09T18:48:14.396685] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-09T18:48:14.562036] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T18:48:15.111194] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T18:48:15.196731] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-09T18:48:15.965508] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T18:48:15.969728] [INFO ] [REMOTE ] ESTC: Full fetch complete (72106 records). [2025-10-09T18:48:15.969821] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-09T18:48:16.001821] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-09T18:48:16.362253] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-09T18:48:16.362364] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-09T18:48:16.363342] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-09T18:48:16.363449] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-09T18:48:16.364936] [DEBUG] [LOCAL ] ESTC: Trimmed 72106 records to 50479 (keeping 200 days of data) [2025-10-09T18:48:16.465792] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T18:48:16.679523] [DEBUG] [LOCAL ] ESTC: Primary data saved (50479 records). [2025-10-09T18:48:16.679690] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-09T18:48:16.679822] [INFO ] [MAIN ] Update Progress: 775/2373 symbols completed. ESTC took 44.1s. Estimated remaining: 3h 43m 8s. Rate: 7.2 symbols/min [2025-10-09T18:48:16.801948] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-09T18:48:16.850512] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:16.868392] [DEBUG] [LOCAL ] ETJ: Loaded 17038 existing records from primary storage. [2025-10-09T18:48:16.868624] [INFO ] [MAIN ] ETJ: Loaded 17038 existing records. [2025-10-09T18:48:17.047255] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:17.047618] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-09T18:48:17.047745] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-09T18:48:17.053074] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-09T18:48:17.058798] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-09T18:48:17.102357] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T18:48:17.408236] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:17.596670] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-09T18:48:18.160085] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T18:48:18.396721] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-09T18:48:18.416846] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T18:48:19.196751] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-09T18:48:19.315261] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T18:48:19.996738] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-09T18:48:20.497975] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T18:48:20.796716] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-09T18:48:21.596737] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-09T18:48:22.070884] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-09T18:48:22.102242] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:48:22.396685] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-09T18:48:23.196748] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-09T18:48:23.228347] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T18:48:23.505135] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T18:48:23.996722] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-09T18:48:24.796703] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-09T18:48:24.839105] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T18:48:25.389109] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-09T18:48:25.393628] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-09T18:48:25.393808] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-09T18:48:25.602326] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-09T18:48:25.785616] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-09T18:48:25.785736] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-09T18:48:25.786735] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-09T18:48:25.786800] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-09T18:48:25.788306] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54179 (keeping 200 days of data) [2025-10-09T18:48:26.130738] [DEBUG] [LOCAL ] ET: Primary data saved (54179 records). [2025-10-09T18:48:26.130878] [INFO ] [MAIN ] ET: Full history saved. [2025-10-09T18:48:26.131424] [INFO ] [MAIN ] Update Progress: 776/2373 symbols completed. ET took 42.5s. Estimated remaining: 3h 43m 2s. Rate: 7.2 symbols/min [2025-10-09T18:48:26.254802] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T18:48:26.325199] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:26.384787] [DEBUG] [LOCAL ] ETN: Loaded 52702 existing records from primary storage. [2025-10-09T18:48:26.385166] [INFO ] [MAIN ] ETN: Loaded 52702 existing records. [2025-10-09T18:48:26.405274] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-09T18:48:26.599372] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:26.599628] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-09T18:48:26.599812] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-09T18:48:26.611364] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-09T18:48:26.611519] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-09T18:48:26.645757] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T18:48:26.981304] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:27.196715] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-09T18:48:27.727340] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T18:48:27.996693] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-09T18:48:28.796731] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-09T18:48:28.924586] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T18:48:29.127183] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:48:29.129858] [INFO ] [REMOTE ] ETD: Full fetch complete (38469 records). [2025-10-09T18:48:29.129942] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-09T18:48:29.492912] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-09T18:48:29.492996] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-09T18:48:29.493635] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-09T18:48:29.493717] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-09T18:48:29.494582] [DEBUG] [LOCAL ] ETD: Trimmed 38469 records to 27570 (keeping 200 days of data) [2025-10-09T18:48:29.597686] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-09T18:48:29.664272] [DEBUG] [LOCAL ] ETD: Primary data saved (27570 records). [2025-10-09T18:48:29.664470] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-09T18:48:29.664567] [INFO ] [MAIN ] Update Progress: 777/2373 symbols completed. ETD took 29.7s. Estimated remaining: 3h 42m 44s. Rate: 7.2 symbols/min [2025-10-09T18:48:29.839480] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:29.852462] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T18:48:29.863269] [DEBUG] [LOCAL ] ETO: Loaded 6764 existing records from primary storage. [2025-10-09T18:48:29.863481] [INFO ] [MAIN ] ETO: Loaded 6764 existing records. [2025-10-09T18:48:30.037535] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:30.037809] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-09T18:48:30.037899] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-09T18:48:30.038167] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-09T18:48:30.038224] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-09T18:48:30.390080] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:30.396681] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-09T18:48:30.997110] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:48:31.196677] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-09T18:48:31.605530] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-09T18:48:31.721957] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-09T18:48:31.996668] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-09T18:48:32.505805] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T18:48:32.796738] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-09T18:48:33.596691] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-09T18:48:33.818061] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T18:48:34.396749] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-09T18:48:35.196685] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-09T18:48:35.799539] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-09T18:48:35.827150] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T18:48:35.961930] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T18:48:35.996670] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-09T18:48:36.796721] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-09T18:48:37.479434] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-09T18:48:37.596733] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-09T18:48:38.056767] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-09T18:48:38.396685] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-09T18:48:38.765832] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T18:48:39.196722] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-09T18:48:39.962120] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T18:48:39.996756] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-09T18:48:40.728054] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T18:48:40.796682] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-09T18:48:41.358085] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T18:48:41.596717] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-09T18:48:42.217127] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T18:48:42.396719] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-09T18:48:42.838733] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-09T18:48:43.196801] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-09T18:48:43.368514] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (4.97 seconds). [2025-10-09T18:48:43.996758] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-09T18:48:44.012161] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T18:48:44.013577] [INFO ] [REMOTE ] ETO: Full fetch complete (9644 records). [2025-10-09T18:48:44.013675] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-09T18:48:44.372369] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-09T18:48:44.372460] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-09T18:48:44.372757] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-09T18:48:44.372822] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-09T18:48:44.373264] [DEBUG] [LOCAL ] ETO: Trimmed 9644 records to 6884 (keeping 200 days of data) [2025-10-09T18:48:44.414847] [DEBUG] [LOCAL ] ETO: Primary data saved (6884 records). [2025-10-09T18:48:44.414964] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-09T18:48:44.415049] [INFO ] [MAIN ] Update Progress: 778/2373 symbols completed. ETO took 14.8s. Estimated remaining: 3h 42m 49s. Rate: 7.2 symbols/min [2025-10-09T18:48:44.593495] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:44.675124] [DEBUG] [LOCAL ] ETR: Loaded 53231 existing records from primary storage. [2025-10-09T18:48:44.675774] [INFO ] [MAIN ] ETR: Loaded 53231 existing records. [2025-10-09T18:48:44.802011] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-09T18:48:44.954841] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:44.956764] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-09T18:48:44.956677] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T18:48:44.956928] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-09T18:48:44.963173] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-09T18:48:44.963243] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-09T18:48:45.315764] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:45.596792] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-09T18:48:45.723443] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-09T18:48:46.396706] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-09T18:48:47.196709] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-09T18:48:47.225139] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T18:48:47.357586] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T18:48:47.996763] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-09T18:48:48.796701] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-09T18:48:49.208863] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T18:48:49.353895] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T18:48:49.596765] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-09T18:48:49.701988] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T18:48:50.396769] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-09T18:48:51.196702] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-09T18:48:51.329347] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T18:48:51.996745] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-09T18:48:52.269487] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:48:52.579481] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T18:48:52.796772] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-09T18:48:53.596763] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-09T18:48:53.817863] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T18:48:54.190086] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:48:54.222334] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T18:48:54.396775] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-09T18:48:55.196741] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-09T18:48:55.522387] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T18:48:55.996723] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-09T18:48:56.220956] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T18:48:56.796749] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-09T18:48:57.596714] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-09T18:48:57.756577] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T18:48:57.759719] [INFO ] [REMOTE ] ETG: Full fetch complete (24767 records). [2025-10-09T18:48:57.759805] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-09T18:48:58.154080] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-09T18:48:58.262119] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-09T18:48:58.262200] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-09T18:48:58.262804] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-09T18:48:58.262894] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-09T18:48:58.263718] [DEBUG] [LOCAL ] ETG: Trimmed 24767 records to 16668 (keeping 200 days of data) [2025-10-09T18:48:58.386227] [DEBUG] [LOCAL ] ETG: Primary data saved (16668 records). [2025-10-09T18:48:58.386377] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-09T18:48:58.386517] [INFO ] [MAIN ] Update Progress: 779/2373 symbols completed. ETG took 48.2s. Estimated remaining: 3h 42m 52s. Rate: 7.2 symbols/min [2025-10-09T18:48:58.401939] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-09T18:48:58.582732] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:58.605204] [DEBUG] [LOCAL ] ETV: Loaded 22112 existing records from primary storage. [2025-10-09T18:48:58.605438] [INFO ] [MAIN ] ETV: Loaded 22112 existing records. [2025-10-09T18:48:58.783235] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:48:58.783439] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-09T18:48:58.783487] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-09T18:48:58.784289] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-09T18:48:58.784349] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-09T18:48:59.141382] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:48:59.196686] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-09T18:48:59.251099] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T18:48:59.253409] [INFO ] [REMOTE ] ETJ: Full fetch complete (25568 records). [2025-10-09T18:48:59.253482] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-09T18:48:59.641081] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-09T18:48:59.641264] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-09T18:48:59.642024] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-09T18:48:59.642167] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-09T18:48:59.643507] [DEBUG] [LOCAL ] ETJ: Trimmed 25568 records to 17098 (keeping 200 days of data) [2025-10-09T18:48:59.752124] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-09T18:48:59.791814] [DEBUG] [LOCAL ] ETJ: Primary data saved (17098 records). [2025-10-09T18:48:59.791960] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-09T18:48:59.792042] [INFO ] [MAIN ] Update Progress: 780/2373 symbols completed. ETJ took 43.1s. Estimated remaining: 3h 42m 29s. Rate: 7.2 symbols/min [2025-10-09T18:48:59.960775] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:48:59.986086] [DEBUG] [LOCAL ] ETW: Loaded 25426 existing records from primary storage. [2025-10-09T18:48:59.986361] [INFO ] [MAIN ] ETW: Loaded 25426 existing records. [2025-10-09T18:49:00.007113] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-09T18:49:00.178378] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:00.178625] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-09T18:49:00.178732] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-09T18:49:00.179884] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-09T18:49:00.179951] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-09T18:49:00.414844] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T18:49:00.580696] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:00.796744] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-09T18:49:01.596754] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-09T18:49:02.067774] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T18:49:02.396761] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-09T18:49:02.474147] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T18:49:03.144497] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T18:49:03.172427] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T18:49:03.196686] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-09T18:49:03.996752] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-09T18:49:04.796802] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-09T18:49:04.873566] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-09T18:49:04.937307] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-09T18:49:05.596733] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-09T18:49:05.887793] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T18:49:06.396691] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-09T18:49:06.416011] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T18:49:07.196727] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-09T18:49:07.964012] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T18:49:07.996740] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-09T18:49:08.284332] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-09T18:49:08.796731] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-09T18:49:09.594123] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T18:49:09.598716] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-09T18:49:10.124789] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-09T18:49:10.396704] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-09T18:49:10.817866] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T18:49:11.196699] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-09T18:49:11.280473] [DEBUG] [REMOTE ] ETV: Error fetching primary data for 2025-05: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-09T18:49:11.280629] [WARN ] [REMOTE ] ETV: No data returned for month 2025-05 [2025-10-09T18:49:11.280748] [FATAL] [REMOTE ] ETV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:49:11.280817] [FATAL] [MAIN ] ETV: Failed to fetch primary data. [2025-10-09T18:49:11.280884] [WARN ] [MAIN ] ETV: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:49:11.280958] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-09T18:49:11.281029] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-09T18:49:11.281078] [INFO ] [LOCAL ] ETV: Starting deletion of derivative data. [2025-10-09T18:49:11.281329] [DEBUG] [LOCAL ] ETV: Deleted derivative data file. [2025-10-09T18:49:11.281403] [INFO ] [MAIN ] Update Progress: 781/2373 symbols completed. ETV took 12.9s. Estimated remaining: 3h 42m 27s. Rate: 7.2 symbols/min [2025-10-09T18:49:11.448671] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:11.455320] [DEBUG] [LOCAL ] ETX: Loaded 5220 existing records from primary storage. [2025-10-09T18:49:11.455488] [INFO ] [MAIN ] ETX: Loaded 5220 existing records. [2025-10-09T18:49:11.628223] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:11.628453] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-09T18:49:11.628536] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-09T18:49:11.628824] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-09T18:49:11.628881] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-09T18:49:11.980676] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:11.996674] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-09T18:49:12.796712] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-09T18:49:12.878970] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T18:49:13.064605] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T18:49:13.068985] [INFO ] [REMOTE ] ETN: Full fetch complete (76518 records). [2025-10-09T18:49:13.069108] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-09T18:49:13.475953] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-09T18:49:13.476147] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-09T18:49:13.477092] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-09T18:49:13.477156] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-09T18:49:13.478625] [DEBUG] [LOCAL ] ETN: Trimmed 76518 records to 53075 (keeping 200 days of data) [2025-10-09T18:49:13.597288] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-09T18:49:13.826361] [DEBUG] [LOCAL ] ETN: Primary data saved (53075 records). [2025-10-09T18:49:13.826506] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-09T18:49:13.826633] [INFO ] [MAIN ] Update Progress: 782/2373 symbols completed. ETN took 47.7s. Estimated remaining: 3h 42m 7s. Rate: 7.2 symbols/min [2025-10-09T18:49:13.999023] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:14.022057] [DEBUG] [LOCAL ] ETY: Loaded 23084 existing records from primary storage. [2025-10-09T18:49:14.022311] [INFO ] [MAIN ] ETY: Loaded 23084 existing records. [2025-10-09T18:49:14.209779] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:14.210160] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-09T18:49:14.210304] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-09T18:49:14.211261] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-09T18:49:14.211327] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-09T18:49:14.409262] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-09T18:49:14.438102] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T18:49:14.651059] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:14.682260] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T18:49:14.796016] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-09T18:49:15.196718] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-09T18:49:15.996697] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-09T18:49:16.523958] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T18:49:16.796731] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-09T18:49:16.878274] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T18:49:17.596702] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-09T18:49:17.776903] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T18:49:18.396717] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-09T18:49:19.196755] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-09T18:49:19.272331] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T18:49:19.276846] [INFO ] [REMOTE ] ETR: Full fetch complete (77087 records). [2025-10-09T18:49:19.276966] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-09T18:49:19.396463] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-09T18:49:19.698126] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-09T18:49:19.698221] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-09T18:49:19.699835] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-09T18:49:19.701187] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-09T18:49:19.701255] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-09T18:49:19.702731] [DEBUG] [LOCAL ] ETR: Trimmed 77087 records to 53610 (keeping 200 days of data) [2025-10-09T18:49:20.017030] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-09T18:49:20.072756] [DEBUG] [LOCAL ] ETR: Primary data saved (53610 records). [2025-10-09T18:49:20.072879] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-09T18:49:20.072995] [INFO ] [MAIN ] Update Progress: 783/2373 symbols completed. ETR took 35.7s. Estimated remaining: 3h 41m 54s. Rate: 7.2 symbols/min [2025-10-09T18:49:20.272996] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:20.291759] [DEBUG] [LOCAL ] EVC: Loaded 18236 existing records from primary storage. [2025-10-09T18:49:20.292007] [INFO ] [MAIN ] EVC: Loaded 18236 existing records. [2025-10-09T18:49:20.508232] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:20.508439] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-09T18:49:20.508489] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-09T18:49:20.509110] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-09T18:49:20.509171] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-09T18:49:20.635492] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T18:49:20.801973] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-09T18:49:20.943204] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:21.586680] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T18:49:21.596666] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-09T18:49:22.396693] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-09T18:49:22.717162] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T18:49:22.955563] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T18:49:23.196728] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-09T18:49:23.996729] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-09T18:49:24.407387] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T18:49:24.796681] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-09T18:49:24.952524] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T18:49:25.516821] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T18:49:25.596716] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-09T18:49:26.396691] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-09T18:49:26.426580] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T18:49:27.196745] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-09T18:49:27.695041] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T18:49:27.996739] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-09T18:49:28.166683] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-09T18:49:28.796675] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-09T18:49:28.860185] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-09T18:49:29.596737] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-09T18:49:29.812067] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T18:49:30.396688] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-09T18:49:30.504374] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T18:49:30.949503] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-09T18:49:31.196723] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-09T18:49:31.996755] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-09T18:49:32.796688] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-09T18:49:32.972696] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T18:49:33.056403] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T18:49:33.535402] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T18:49:33.596787] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-09T18:49:34.169584] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T18:49:34.396716] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-09T18:49:35.196746] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-09T18:49:35.514501] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T18:49:35.996715] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-09T18:49:36.796736] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-09T18:49:37.103963] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T18:49:37.596771] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-09T18:49:38.396740] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-09T18:49:38.498364] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T18:49:38.985031] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T18:49:38.986132] [INFO ] [REMOTE ] ETX: Full fetch complete (6990 records). [2025-10-09T18:49:38.986201] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-09T18:49:39.200053] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-09T18:49:39.264668] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (4.07 seconds). [2025-10-09T18:49:39.382852] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-09T18:49:39.382936] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-09T18:49:39.383155] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-09T18:49:39.383199] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-09T18:49:39.383614] [DEBUG] [LOCAL ] ETX: Trimmed 6990 records to 5243 (keeping 200 days of data) [2025-10-09T18:49:39.419662] [DEBUG] [LOCAL ] ETX: Primary data saved (5243 records). [2025-10-09T18:49:39.419790] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-09T18:49:39.419876] [INFO ] [MAIN ] Update Progress: 784/2373 symbols completed. ETX took 28.1s. Estimated remaining: 3h 42m 8s. Rate: 7.2 symbols/min [2025-10-09T18:49:39.607193] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:39.646628] [DEBUG] [LOCAL ] EVEX: Loaded 31368 existing records from primary storage. [2025-10-09T18:49:39.646930] [INFO ] [MAIN ] EVEX: Loaded 31368 existing records. [2025-10-09T18:49:39.851377] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-09T18:49:39.850856] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:39.856377] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-09T18:49:39.856798] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-09T18:49:39.857087] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-09T18:49:39.857145] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-09T18:49:40.001881] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-09T18:49:40.224639] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:40.329676] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:49:40.332389] [INFO ] [REMOTE ] ETW: Full fetch complete (36629 records). [2025-10-09T18:49:40.332465] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-09T18:49:40.719158] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-09T18:49:40.719424] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-09T18:49:40.720562] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-09T18:49:40.720677] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-09T18:49:40.721776] [DEBUG] [LOCAL ] ETW: Trimmed 36629 records to 25618 (keeping 200 days of data) [2025-10-09T18:49:40.809690] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-09T18:49:40.893559] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T18:49:40.906916] [DEBUG] [LOCAL ] ETW: Primary data saved (25618 records). [2025-10-09T18:49:40.907075] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-09T18:49:40.907167] [INFO ] [MAIN ] Update Progress: 785/2373 symbols completed. ETW took 41.1s. Estimated remaining: 3h 41m 46s. Rate: 7.2 symbols/min [2025-10-09T18:49:41.077667] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:41.088565] [DEBUG] [LOCAL ] EVF: Loaded 9735 existing records from primary storage. [2025-10-09T18:49:41.088823] [INFO ] [MAIN ] EVF: Loaded 9735 existing records. [2025-10-09T18:49:41.262965] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:41.263198] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-09T18:49:41.263264] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-09T18:49:41.263822] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-09T18:49:41.263881] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-09T18:49:41.597277] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-09T18:49:41.628421] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:41.641184] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T18:49:42.396768] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-09T18:49:42.653731] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T18:49:42.993694] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:49:43.196741] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-09T18:49:43.996744] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-09T18:49:44.145940] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T18:49:44.610660] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T18:49:44.796755] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-09T18:49:45.596684] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-09T18:49:45.694622] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T18:49:46.371363] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-09T18:49:46.373823] [INFO ] [REMOTE ] ETY: Full fetch complete (34261 records). [2025-10-09T18:49:46.373912] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-09T18:49:46.402958] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-09T18:49:46.746865] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-09T18:49:46.746940] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-09T18:49:46.747578] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-09T18:49:46.747619] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-09T18:49:46.748596] [DEBUG] [LOCAL ] ETY: Trimmed 34261 records to 23191 (keeping 200 days of data) [2025-10-09T18:49:46.890099] [DEBUG] [LOCAL ] ETY: Primary data saved (23191 records). [2025-10-09T18:49:46.890259] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-09T18:49:46.890374] [INFO ] [MAIN ] Update Progress: 786/2373 symbols completed. ETY took 33.1s. Estimated remaining: 3h 41m 32s. Rate: 7.2 symbols/min [2025-10-09T18:49:47.061920] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:47.069673] [DEBUG] [LOCAL ] EVG: Loaded 5983 existing records from primary storage. [2025-10-09T18:49:47.069876] [INFO ] [MAIN ] EVG: Loaded 5983 existing records. [2025-10-09T18:49:47.206913] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-09T18:49:47.250219] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:47.250694] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-09T18:49:47.250765] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-09T18:49:47.251140] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-09T18:49:47.251203] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-09T18:49:47.548074] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T18:49:47.634404] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:47.822828] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T18:49:47.996800] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-09T18:49:48.796710] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-09T18:49:49.099165] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T18:49:49.596731] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-09T18:49:49.642526] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-09T18:49:50.396692] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-09T18:49:50.421879] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T18:49:51.002625] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T18:49:51.196760] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-09T18:49:51.996712] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-09T18:49:52.318697] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T18:49:52.796690] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-09T18:49:52.907300] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T18:49:53.441542] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T18:49:53.443147] [INFO ] [REMOTE ] EVC: Full fetch complete (29314 records). [2025-10-09T18:49:53.443222] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-09T18:49:53.600066] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-09T18:49:53.814006] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-09T18:49:53.814089] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-09T18:49:53.814633] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-09T18:49:53.814751] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-09T18:49:53.815504] [DEBUG] [LOCAL ] EVC: Trimmed 29314 records to 18310 (keeping 200 days of data) [2025-10-09T18:49:53.926683] [DEBUG] [LOCAL ] EVC: Primary data saved (18310 records). [2025-10-09T18:49:53.926899] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-09T18:49:53.927002] [INFO ] [MAIN ] Update Progress: 787/2373 symbols completed. EVC took 33.9s. Estimated remaining: 3h 41m 21s. Rate: 7.2 symbols/min [2025-10-09T18:49:54.097088] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:49:54.143982] [DEBUG] [LOCAL ] EVH: Loaded 49565 existing records from primary storage. [2025-10-09T18:49:54.144299] [INFO ] [MAIN ] EVH: Loaded 49565 existing records. [2025-10-09T18:49:54.248702] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T18:49:54.326282] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:49:54.326527] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-09T18:49:54.326575] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-09T18:49:54.326812] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-09T18:49:54.326872] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-09T18:49:54.401922] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-09T18:49:54.675771] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:49:55.196738] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-09T18:49:55.454962] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T18:49:55.668327] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T18:49:55.996731] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-09T18:49:56.752547] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T18:49:56.796674] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-09T18:49:57.345212] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T18:49:57.596723] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-09T18:49:58.126266] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-09T18:49:58.396748] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-09T18:49:58.982391] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T18:49:59.196763] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-09T18:49:59.970806] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T18:49:59.996724] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-09T18:50:00.431054] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T18:50:00.796758] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-09T18:50:01.299041] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-09T18:50:01.596736] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-09T18:50:02.202961] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T18:50:02.396792] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-09T18:50:03.036056] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-09T18:50:03.196715] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-09T18:50:03.996727] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-09T18:50:04.714021] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T18:50:04.750595] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:50:04.796754] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-09T18:50:05.342213] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T18:50:05.343567] [INFO ] [REMOTE ] EVG: Full fetch complete (8174 records). [2025-10-09T18:50:05.343661] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-09T18:50:05.601795] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-09T18:50:05.785767] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-09T18:50:05.785843] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-09T18:50:05.786078] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-09T18:50:05.786131] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-09T18:50:05.786548] [DEBUG] [LOCAL ] EVG: Trimmed 8174 records to 6026 (keeping 200 days of data) [2025-10-09T18:50:05.827689] [DEBUG] [LOCAL ] EVG: Primary data saved (6026 records). [2025-10-09T18:50:05.827826] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-09T18:50:05.827937] [INFO ] [MAIN ] Update Progress: 788/2373 symbols completed. EVG took 18.9s. Estimated remaining: 3h 41m 20s. Rate: 7.2 symbols/min [2025-10-09T18:50:06.042337] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:50:06.056396] [DEBUG] [LOCAL ] EVN: Loaded 11115 existing records from primary storage. [2025-10-09T18:50:06.056600] [INFO ] [MAIN ] EVN: Loaded 11115 existing records. [2025-10-09T18:50:06.272045] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:50:06.272328] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-09T18:50:06.272387] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-09T18:50:06.272612] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-09T18:50:06.272717] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-09T18:50:06.401865] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-09T18:50:06.636778] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:50:06.735090] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T18:50:07.196721] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-09T18:50:07.857702] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T18:50:07.996701] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-09T18:50:08.080189] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T18:50:08.796741] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-09T18:50:09.596702] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-09T18:50:09.798102] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T18:50:10.302983] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-09T18:50:10.396723] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-09T18:50:11.196702] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-09T18:50:11.455283] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T18:50:11.575032] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T18:50:11.769624] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T18:50:11.996706] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-09T18:50:12.796714] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-09T18:50:13.484119] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T18:50:13.596817] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-09T18:50:14.143579] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T18:50:14.172983] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T18:50:14.396735] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-09T18:50:15.196764] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-09T18:50:15.589809] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T18:50:15.996724] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-09T18:50:16.327244] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T18:50:16.796795] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-09T18:50:17.601832] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-09T18:50:17.620361] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T18:50:18.159804] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T18:50:18.398399] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-09T18:50:18.403118] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T18:50:19.196695] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-09T18:50:19.252477] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T18:50:19.996776] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-09T18:50:20.471876] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T18:50:20.473639] [INFO ] [REMOTE ] EVF: Full fetch complete (12696 records). [2025-10-09T18:50:20.473751] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-09T18:50:20.801795] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-09T18:50:20.844774] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-09T18:50:20.844856] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-09T18:50:20.845227] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-09T18:50:20.845265] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-09T18:50:20.845918] [DEBUG] [LOCAL ] EVF: Trimmed 12696 records to 9843 (keeping 200 days of data) [2025-10-09T18:50:20.902947] [DEBUG] [LOCAL ] EVF: Primary data saved (9843 records). [2025-10-09T18:50:20.903079] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-09T18:50:20.903164] [INFO ] [MAIN ] Update Progress: 789/2373 symbols completed. EVF took 40.0s. Estimated remaining: 3h 41m 25s. Rate: 7.2 symbols/min [2025-10-09T18:50:21.070700] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:50:21.105906] [DEBUG] [LOCAL ] EVR: Loaded 34583 existing records from primary storage. [2025-10-09T18:50:21.106248] [INFO ] [MAIN ] EVR: Loaded 34583 existing records. [2025-10-09T18:50:21.287264] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:50:21.287477] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-09T18:50:21.287524] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-09T18:50:21.288673] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-09T18:50:21.288735] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-09T18:50:21.600125] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-09T18:50:21.671563] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:50:21.699824] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T18:50:22.396710] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-09T18:50:22.472244] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:50:22.512445] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T18:50:23.196715] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-09T18:50:23.510878] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-09T18:50:23.996724] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-09T18:50:24.796695] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-09T18:50:24.863078] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T18:50:25.596726] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-09T18:50:25.626136] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T18:50:25.630477] [INFO ] [REMOTE ] EVEX: Full fetch complete (42778 records). [2025-10-09T18:50:25.630609] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-09T18:50:26.006509] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-09T18:50:26.006667] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-09T18:50:26.007332] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-09T18:50:26.007376] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-09T18:50:26.008414] [DEBUG] [LOCAL ] EVEX: Trimmed 42778 records to 31707 (keeping 200 days of data) [2025-10-09T18:50:26.129193] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T18:50:26.152839] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T18:50:26.249509] [DEBUG] [LOCAL ] EVEX: Primary data saved (31707 records). [2025-10-09T18:50:26.249671] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-09T18:50:26.250805] [INFO ] [MAIN ] Update Progress: 790/2373 symbols completed. EVEX took 46.8s. Estimated remaining: 3h 41m 11s. Rate: 7.2 symbols/min [2025-10-09T18:50:26.401821] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-09T18:50:26.461405] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:50:26.480758] [DEBUG] [LOCAL ] EVT: Loaded 16893 existing records from primary storage. [2025-10-09T18:50:26.481024] [INFO ] [MAIN ] EVT: Loaded 16893 existing records. [2025-10-09T18:50:26.668575] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:50:26.668829] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-09T18:50:26.668881] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-09T18:50:26.669434] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-09T18:50:26.669543] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-09T18:50:27.037746] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:50:27.196731] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-09T18:50:27.206776] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T18:50:27.996704] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-09T18:50:28.054923] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T18:50:28.673627] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T18:50:28.796726] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-09T18:50:29.596795] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-09T18:50:30.293151] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-09T18:50:30.396753] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-09T18:50:30.865774] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T18:50:31.196711] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-09T18:50:31.243838] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T18:50:31.996758] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-09T18:50:32.227987] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T18:50:32.796685] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-09T18:50:32.916958] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T18:50:32.918841] [INFO ] [REMOTE ] EVN: Full fetch complete (17622 records). [2025-10-09T18:50:32.918912] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-09T18:50:33.291636] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-09T18:50:33.291741] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-09T18:50:33.292128] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-09T18:50:33.292168] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-09T18:50:33.292696] [DEBUG] [LOCAL ] EVN: Trimmed 17622 records to 11172 (keeping 200 days of data) [2025-10-09T18:50:33.359218] [DEBUG] [LOCAL ] EVN: Primary data saved (11172 records). [2025-10-09T18:50:33.359353] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-09T18:50:33.359437] [INFO ] [MAIN ] Update Progress: 791/2373 symbols completed. EVN took 27.5s. Estimated remaining: 3h 40m 60s. Rate: 7.2 symbols/min [2025-10-09T18:50:33.529053] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:50:33.540552] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T18:50:33.569036] [DEBUG] [LOCAL ] EVTC: Loaded 26384 existing records from primary storage. [2025-10-09T18:50:33.569326] [INFO ] [MAIN ] EVTC: Loaded 26384 existing records. [2025-10-09T18:50:33.601984] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-09T18:50:33.751008] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:50:33.751236] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-09T18:50:33.751284] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-09T18:50:33.752113] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-09T18:50:33.752174] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-09T18:50:34.095758] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:50:34.396703] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-09T18:50:35.196677] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-09T18:50:35.300621] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-09T18:50:35.360453] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T18:50:35.982763] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T18:50:35.996674] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-09T18:50:36.796738] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-09T18:50:36.912727] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T18:50:37.596687] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-09T18:50:37.914599] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T18:50:38.396753] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-09T18:50:38.988537] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T18:50:38.992861] [INFO ] [REMOTE ] EVH: Full fetch complete (71745 records). [2025-10-09T18:50:38.992971] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-09T18:50:39.204110] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-09T18:50:39.323352] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T18:50:39.421328] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-09T18:50:39.421404] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-09T18:50:39.422297] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-09T18:50:39.422365] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-09T18:50:39.423875] [DEBUG] [LOCAL ] EVH: Trimmed 71745 records to 49927 (keeping 200 days of data) [2025-10-09T18:50:39.708699] [DEBUG] [LOCAL ] EVH: Primary data saved (49927 records). [2025-10-09T18:50:39.708842] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-09T18:50:39.708928] [INFO ] [MAIN ] Update Progress: 792/2373 symbols completed. EVH took 45.8s. Estimated remaining: 3h 40m 47s. Rate: 7.2 symbols/min [2025-10-09T18:50:39.875086] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:50:39.909954] [DEBUG] [LOCAL ] EVTL: Loaded 39239 existing records from primary storage. [2025-10-09T18:50:39.910253] [INFO ] [MAIN ] EVTL: Loaded 39239 existing records. [2025-10-09T18:50:40.002798] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-09T18:50:40.091439] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:50:40.091688] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-09T18:50:40.091747] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-09T18:50:40.092779] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-09T18:50:40.092839] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-09T18:50:40.453991] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:50:40.491637] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T18:50:40.796684] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-09T18:50:41.117128] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T18:50:41.596720] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-09T18:50:42.396685] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-09T18:50:42.430400] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T18:50:42.944551] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T18:50:43.196708] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-09T18:50:43.633763] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T18:50:43.996699] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-09T18:50:44.133700] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-09T18:50:44.595747] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T18:50:44.796722] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-09T18:50:45.596724] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-09T18:50:45.866789] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T18:50:46.401766] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-09T18:50:46.411846] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T18:50:47.196718] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-09T18:50:47.982090] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T18:50:48.006383] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-09T18:50:48.008960] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T18:50:48.796781] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-09T18:50:49.502269] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T18:50:49.596703] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-09T18:50:49.726141] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T18:50:50.396730] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-09T18:50:50.692138] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T18:50:51.196747] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-09T18:50:51.335822] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-09T18:50:51.996726] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-09T18:50:52.411312] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T18:50:52.741251] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T18:50:52.796700] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-09T18:50:53.596714] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-09T18:50:53.934960] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T18:50:54.396762] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-09T18:50:54.859070] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T18:50:55.196777] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-09T18:50:55.988570] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T18:50:55.996779] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-09T18:50:56.583043] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T18:50:56.796728] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-09T18:50:57.123391] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T18:50:57.596697] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-09T18:50:57.939601] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T18:50:58.396770] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-09T18:50:59.196778] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-09T18:50:59.265670] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:50:59.559352] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:50:59.562207] [INFO ] [REMOTE ] EVTC: Full fetch complete (38100 records). [2025-10-09T18:50:59.562296] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-09T18:50:59.935524] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-09T18:50:59.935710] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-09T18:50:59.936422] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-09T18:50:59.936514] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-09T18:50:59.937595] [DEBUG] [LOCAL ] EVTC: Trimmed 38100 records to 26578 (keeping 200 days of data) [2025-10-09T18:50:59.997520] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-09T18:51:00.109311] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T18:51:00.124969] [DEBUG] [LOCAL ] EVTC: Primary data saved (26578 records). [2025-10-09T18:51:00.125064] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-09T18:51:00.125139] [INFO ] [MAIN ] Update Progress: 793/2373 symbols completed. EVTC took 26.8s. Estimated remaining: 3h 41m 3s. Rate: 7.1 symbols/min [2025-10-09T18:51:00.293066] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:00.315781] [DEBUG] [LOCAL ] EVTR: Loaded 24255 existing records from primary storage. [2025-10-09T18:51:00.316035] [INFO ] [MAIN ] EVTR: Loaded 24255 existing records. [2025-10-09T18:51:00.497077] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:00.497314] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-09T18:51:00.497362] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-09T18:51:00.498313] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-09T18:51:00.498373] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-09T18:51:00.801975] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-09T18:51:00.859833] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:01.277591] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T18:51:01.596728] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-09T18:51:01.766694] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T18:51:01.768905] [INFO ] [REMOTE ] EVT: Full fetch complete (25196 records). [2025-10-09T18:51:01.768986] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-09T18:51:02.144761] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-09T18:51:02.144849] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-09T18:51:02.145334] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-09T18:51:02.145373] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-09T18:51:02.146124] [DEBUG] [LOCAL ] EVT: Trimmed 25196 records to 16976 (keeping 200 days of data) [2025-10-09T18:51:02.259368] [DEBUG] [LOCAL ] EVT: Primary data saved (16976 records). [2025-10-09T18:51:02.259524] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-09T18:51:02.259611] [INFO ] [MAIN ] Update Progress: 794/2373 symbols completed. EVT took 36.0s. Estimated remaining: 3h 40m 42s. Rate: 7.2 symbols/min [2025-10-09T18:51:02.405738] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-09T18:51:02.440257] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:02.500999] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-09T18:51:02.501447] [INFO ] [MAIN ] EW: Loaded 53402 existing records. [2025-10-09T18:51:02.696900] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:02.697232] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-09T18:51:02.697296] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-09T18:51:02.698613] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-09T18:51:02.698703] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-09T18:51:02.988492] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T18:51:03.023342] [INFO ] [REMOTE ] EVR: Full fetch complete (50650 records). [2025-10-09T18:51:03.052741] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-09T18:51:03.091125] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:03.201881] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-09T18:51:03.537007] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-09T18:51:03.537522] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T18:51:03.537599] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-09T18:51:03.542602] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-09T18:51:03.543246] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-09T18:51:03.544418] [DEBUG] [LOCAL ] EVR: Trimmed 50650 records to 34827 (keeping 200 days of data) [2025-10-09T18:51:03.774059] [DEBUG] [LOCAL ] EVR: Primary data saved (34827 records). [2025-10-09T18:51:03.774216] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-09T18:51:03.774302] [INFO ] [MAIN ] Update Progress: 795/2373 symbols completed. EVR took 42.9s. Estimated remaining: 3h 40m 20s. Rate: 7.2 symbols/min [2025-10-09T18:51:03.946306] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:03.984858] [DEBUG] [LOCAL ] EXG: Loaded 34256 existing records from primary storage. [2025-10-09T18:51:03.985134] [INFO ] [MAIN ] EXG: Loaded 34256 existing records. [2025-10-09T18:51:04.005912] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-09T18:51:04.168021] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:04.168244] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-09T18:51:04.168298] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-09T18:51:04.169346] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-09T18:51:04.169405] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-09T18:51:04.533051] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:04.796698] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-09T18:51:05.023762] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T18:51:05.201684] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T18:51:05.596723] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-09T18:51:06.176533] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:51:06.396822] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-09T18:51:06.677661] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T18:51:07.196786] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-09T18:51:07.996720] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-09T18:51:08.095843] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T18:51:08.183182] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T18:51:08.796731] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-09T18:51:09.339182] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T18:51:09.596690] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-09T18:51:09.836805] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T18:51:10.396717] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-09T18:51:10.969621] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T18:51:11.196707] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-09T18:51:11.472116] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T18:51:11.996727] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-09T18:51:12.796697] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-09T18:51:12.872489] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T18:51:13.596705] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-09T18:51:13.644759] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T18:51:13.671396] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T18:51:14.396784] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-09T18:51:15.196697] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-09T18:51:15.549521] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-09T18:51:15.553902] [INFO ] [REMOTE ] EVTL: Full fetch complete (53545 records). [2025-10-09T18:51:15.554006] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-09T18:51:15.936465] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-09T18:51:15.936572] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-09T18:51:15.937373] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-09T18:51:15.937474] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-09T18:51:15.938990] [DEBUG] [LOCAL ] EVTL: Trimmed 53545 records to 39616 (keeping 200 days of data) [2025-10-09T18:51:16.020270] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-09T18:51:16.056099] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T18:51:16.210043] [DEBUG] [LOCAL ] EVTL: Primary data saved (39616 records). [2025-10-09T18:51:16.210189] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-09T18:51:16.210272] [INFO ] [MAIN ] Update Progress: 796/2373 symbols completed. EVTL took 36.5s. Estimated remaining: 3h 40m 20s. Rate: 7.2 symbols/min [2025-10-09T18:51:16.387666] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:16.400982] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T18:51:16.454312] [DEBUG] [LOCAL ] EXK: Loaded 53142 existing records from primary storage. [2025-10-09T18:51:16.454621] [INFO ] [MAIN ] EXK: Loaded 53142 existing records. [2025-10-09T18:51:16.630289] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:16.630520] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-09T18:51:16.630567] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-09T18:51:16.631803] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-09T18:51:16.631862] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-09T18:51:16.803784] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-09T18:51:16.999176] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:17.322332] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T18:51:17.596754] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-09T18:51:17.810818] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T18:51:18.396733] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-09T18:51:19.178549] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T18:51:19.196663] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-09T18:51:19.704472] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T18:51:19.996730] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-09T18:51:20.793479] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T18:51:20.803064] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-09T18:51:21.596686] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-09T18:51:21.796677] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T18:51:21.816521] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T18:51:21.819729] [INFO ] [REMOTE ] EVTR: Full fetch complete (32912 records). [2025-10-09T18:51:21.819848] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-09T18:51:22.204085] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-09T18:51:22.204258] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-09T18:51:22.204931] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-09T18:51:22.204994] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-09T18:51:22.205813] [DEBUG] [LOCAL ] EVTR: Trimmed 32912 records to 24504 (keeping 200 days of data) [2025-10-09T18:51:22.365448] [DEBUG] [LOCAL ] EVTR: Primary data saved (24504 records). [2025-10-09T18:51:22.365595] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-09T18:51:22.365748] [INFO ] [MAIN ] Update Progress: 797/2373 symbols completed. EVTR took 22.2s. Estimated remaining: 3h 40m 7s. Rate: 7.2 symbols/min [2025-10-09T18:51:22.396703] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-09T18:51:23.206971] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-09T18:51:23.209554] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T18:51:23.673584] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T18:51:23.996728] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-09T18:51:24.796706] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-09T18:51:25.032598] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T18:51:25.596725] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-09T18:51:26.348854] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-09T18:51:26.396774] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-09T18:51:26.599670] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T18:51:26.957952] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T18:51:27.196751] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-09T18:51:27.407563] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T18:51:27.996859] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-09T18:51:28.622888] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T18:51:28.796766] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-09T18:51:28.938241] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T18:51:29.596705] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-09T18:51:30.396706] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-09T18:51:30.626534] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T18:51:31.086381] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T18:51:31.196739] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-09T18:51:31.423877] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T18:51:31.996767] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-09T18:51:32.801453] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-09T18:51:32.806991] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T18:51:33.596790] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-09T18:51:33.793574] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T18:51:33.826150] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T18:51:34.396764] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-09T18:51:35.196689] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-09T18:51:35.316042] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:51:35.669724] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T18:51:35.996733] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-09T18:51:36.796762] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-09T18:51:36.928700] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-09T18:51:36.933276] [INFO ] [REMOTE ] EW: Full fetch complete (77352 records). [2025-10-09T18:51:36.933403] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-09T18:51:37.321777] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-09T18:51:37.321860] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-09T18:51:37.322817] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-09T18:51:37.322883] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-09T18:51:37.324398] [DEBUG] [LOCAL ] EW: Trimmed 77352 records to 53791 (keeping 200 days of data) [2025-10-09T18:51:37.587339] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T18:51:37.601873] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-09T18:51:37.699237] [DEBUG] [LOCAL ] EW: Primary data saved (53791 records). [2025-10-09T18:51:37.699400] [INFO ] [MAIN ] EW: Full history saved. [2025-10-09T18:51:37.700621] [INFO ] [MAIN ] Update Progress: 798/2373 symbols completed. EW took 35.4s. Estimated remaining: 3h 40m 12s. Rate: 7.2 symbols/min [2025-10-09T18:51:38.278927] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T18:51:38.396725] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-09T18:51:39.487515] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T18:51:39.499017] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-09T18:51:39.629403] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T18:51:39.632447] [INFO ] [REMOTE ] EXG: Full fetch complete (49792 records). [2025-10-09T18:51:39.632550] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-09T18:51:40.030996] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-09T18:51:40.031078] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-09T18:51:40.031908] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-09T18:51:40.031975] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-09T18:51:40.033114] [DEBUG] [LOCAL ] EXG: Trimmed 49792 records to 34445 (keeping 200 days of data) [2025-10-09T18:51:40.243539] [DEBUG] [LOCAL ] EXG: Primary data saved (34445 records). [2025-10-09T18:51:40.243719] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-09T18:51:40.243824] [INFO ] [MAIN ] Update Progress: 799/2373 symbols completed. EXG took 36.5s. Estimated remaining: 3h 39m 52s. Rate: 7.2 symbols/min [2025-10-09T18:51:41.508667] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-09T18:51:41.520354] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-09T18:51:43.199587] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T18:51:43.204098] [INFO ] [REMOTE ] EXK: Full fetch complete (76585 records). [2025-10-09T18:51:43.204207] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-09T18:51:43.598850] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-09T18:51:43.598932] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-09T18:51:43.599875] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-09T18:51:43.599939] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-09T18:51:43.601346] [DEBUG] [LOCAL ] EXK: Trimmed 76585 records to 53532 (keeping 200 days of data) [2025-10-09T18:51:43.909424] [DEBUG] [LOCAL ] EXK: Primary data saved (53532 records). [2025-10-09T18:51:43.909562] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-09T18:51:43.909668] [INFO ] [MAIN ] Update Progress: 800/2373 symbols completed. EXK took 27.7s. Estimated remaining: 3h 39m 35s. Rate: 7.2 symbols/min [2025-10-09T18:51:44.589686] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:44.640095] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:44.690358] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:44.686381] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:51:44.746892] [DEBUG] [LOCAL ] EXP: Loaded 29620 existing records from primary storage. [2025-10-09T18:51:44.747270] [INFO ] [MAIN ] EXP: Loaded 29620 existing records. [2025-10-09T18:51:44.864157] [DEBUG] [LOCAL ] EXR: Loaded 45251 existing records from primary storage. [2025-10-09T18:51:44.895402] [INFO ] [MAIN ] EXR: Loaded 45251 existing records. [2025-10-09T18:51:44.912148] [DEBUG] [LOCAL ] EXPD: Loaded 47841 existing records from primary storage. [2025-10-09T18:51:44.991839] [INFO ] [MAIN ] EXPD: Loaded 47841 existing records. [2025-10-09T18:51:45.147617] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-09T18:51:45.146327] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:45.172148] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-09T18:51:45.187882] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-09T18:51:45.218722] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-09T18:51:45.348034] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-09T18:51:45.406735] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-09T18:51:45.401721] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:45.497499] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-09T18:51:45.544417] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-09T18:51:45.552898] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:45.605536] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-09T18:51:45.574952] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-09T18:51:45.616106] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-09T18:51:45.634177] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-09T18:51:45.639410] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-09T18:51:45.728136] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-09T18:51:45.816198] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:51:45.923070] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-09T18:51:45.983349] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-09T18:51:46.055588] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-09T18:51:46.072400] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-09T18:51:46.593218] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:46.656888] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-09T18:51:46.984099] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:47.011841] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:47.029091] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-09T18:51:47.023123] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-09T18:51:47.121341] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:51:47.121701] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-09T18:51:48.188490] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T18:51:48.194950] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-09T18:51:48.374917] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T18:51:48.384464] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-09T18:51:48.597247] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T18:51:48.606136] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-09T18:51:49.164287] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T18:51:49.175528] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-09T18:51:49.308018] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T18:51:49.314995] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-09T18:51:49.619523] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T18:51:49.628963] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-09T18:51:50.229486] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T18:51:50.239359] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-09T18:51:50.268960] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T18:51:50.275043] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-09T18:51:51.242796] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-09T18:51:51.253471] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-09T18:51:51.307008] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T18:51:51.317038] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-09T18:51:51.548545] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T18:51:51.796979] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T18:51:51.996695] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-09T18:51:52.766800] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T18:51:52.796695] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-09T18:51:52.899704] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T18:51:53.036347] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-09T18:51:53.596732] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-09T18:51:54.174216] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:51:54.396754] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-09T18:51:54.672606] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T18:51:55.196740] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-09T18:51:55.996682] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-09T18:51:56.159475] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T18:51:56.192437] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T18:51:56.796699] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-09T18:51:57.596732] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-09T18:51:58.240798] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T18:51:58.396745] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-09T18:51:58.465814] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-09T18:51:59.200399] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-09T18:51:59.208981] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T18:51:59.606614] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T18:51:59.996713] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-09T18:52:00.403345] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T18:52:00.796775] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-09T18:52:01.595124] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T18:52:01.604633] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-09T18:52:02.396771] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-09T18:52:02.988262] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-09T18:52:03.050318] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T18:52:03.196683] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-09T18:52:03.696162] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T18:52:03.996722] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-09T18:52:04.796768] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-09T18:52:04.840225] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T18:52:05.114066] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T18:52:05.116757] [INFO ] [REMOTE ] EXP: Full fetch complete (42798 records). [2025-10-09T18:52:05.116878] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-09T18:52:05.567125] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-09T18:52:05.567213] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-09T18:52:05.568074] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-09T18:52:05.568141] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-09T18:52:05.569412] [DEBUG] [LOCAL ] EXP: Trimmed 42798 records to 29811 (keeping 200 days of data) [2025-10-09T18:52:05.627753] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-09T18:52:05.761766] [DEBUG] [LOCAL ] EXP: Primary data saved (29811 records). [2025-10-09T18:52:05.761874] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-09T18:52:05.761958] [INFO ] [MAIN ] Update Progress: 801/2373 symbols completed. EXP took 21.8s. Estimated remaining: 3h 39m 53s. Rate: 7.1 symbols/min [2025-10-09T18:52:05.930872] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:05.968346] [DEBUG] [LOCAL ] FAF: Loaded 41546 existing records from primary storage. [2025-10-09T18:52:05.968693] [INFO ] [MAIN ] FAF: Loaded 41546 existing records. [2025-10-09T18:52:06.143611] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:06.143854] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-09T18:52:06.143899] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-09T18:52:06.144230] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-09T18:52:06.144287] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-09T18:52:06.411081] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-09T18:52:06.515966] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:07.196701] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-09T18:52:07.289431] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T18:52:07.405082] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-09T18:52:07.859406] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:52:07.996717] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-09T18:52:08.633745] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T18:52:08.796692] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-09T18:52:09.596844] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-09T18:52:10.098361] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T18:52:10.380812] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-09T18:52:10.396677] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-09T18:52:10.792328] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T18:52:10.796505] [INFO ] [REMOTE ] EXPD: Full fetch complete (69307 records). [2025-10-09T18:52:10.796635] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-09T18:52:11.202618] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-09T18:52:11.203348] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-09T18:52:11.203424] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-09T18:52:11.204357] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-09T18:52:11.205409] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-09T18:52:11.206963] [DEBUG] [LOCAL ] EXPD: Trimmed 69307 records to 48219 (keeping 200 days of data) [2025-10-09T18:52:11.506428] [DEBUG] [LOCAL ] EXPD: Primary data saved (48219 records). [2025-10-09T18:52:11.506582] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-09T18:52:11.506787] [INFO ] [MAIN ] Update Progress: 802/2373 symbols completed. EXPD took 27.6s. Estimated remaining: 3h 39m 39s. Rate: 7.2 symbols/min [2025-10-09T18:52:11.681373] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:11.727893] [DEBUG] [LOCAL ] FBIN: Loaded 50379 existing records from primary storage. [2025-10-09T18:52:11.728250] [INFO ] [MAIN ] FBIN: Loaded 50379 existing records. [2025-10-09T18:52:11.911987] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:11.912202] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-09T18:52:11.912249] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-09T18:52:11.912681] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-09T18:52:11.912745] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-09T18:52:12.011698] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-09T18:52:12.293451] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:12.400533] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T18:52:12.796720] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-09T18:52:12.984323] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-09T18:52:13.272077] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-09T18:52:13.596731] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-09T18:52:13.867430] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T18:52:14.396720] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-09T18:52:15.196718] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-09T18:52:15.996757] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-09T18:52:16.070496] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-09T18:52:16.120367] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T18:52:16.796743] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-09T18:52:16.852076] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T18:52:17.579561] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T18:52:17.596724] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-09T18:52:18.396711] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-09T18:52:18.669844] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T18:52:19.113748] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T18:52:19.196716] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-09T18:52:19.996691] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-09T18:52:20.098453] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T18:52:20.588112] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T18:52:20.796728] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-09T18:52:21.596697] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-09T18:52:21.641408] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-09T18:52:22.121217] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T18:52:22.396729] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-09T18:52:23.196719] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-09T18:52:23.786420] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-09T18:52:23.791958] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-09T18:52:23.792150] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-09T18:52:23.999131] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-09T18:52:24.305069] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T18:52:24.305397] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-09T18:52:24.314791] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-09T18:52:24.316526] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-09T18:52:24.317035] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-09T18:52:24.318509] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54210 (keeping 200 days of data) [2025-10-09T18:52:24.459772] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T18:52:24.697118] [DEBUG] [LOCAL ] F: Primary data saved (54210 records). [2025-10-09T18:52:24.697264] [INFO ] [MAIN ] F: Full history saved. [2025-10-09T18:52:24.697371] [INFO ] [MAIN ] Update Progress: 803/2373 symbols completed. F took 40.8s. Estimated remaining: 3h 39m 40s. Rate: 7.1 symbols/min [2025-10-09T18:52:24.801825] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-09T18:52:24.867427] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:24.896801] [DEBUG] [LOCAL ] FBK: Loaded 26718 existing records from primary storage. [2025-10-09T18:52:24.897084] [INFO ] [MAIN ] FBK: Loaded 26718 existing records. [2025-10-09T18:52:25.074340] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:25.074689] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-09T18:52:25.074757] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-09T18:52:25.075134] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-09T18:52:25.075192] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-09T18:52:25.433940] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:25.460130] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T18:52:25.596685] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-09T18:52:26.396758] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-09T18:52:26.546173] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T18:52:26.592356] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T18:52:27.196725] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-09T18:52:27.659184] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T18:52:27.663636] [INFO ] [REMOTE ] EXR: Full fetch complete (65898 records). [2025-10-09T18:52:27.663828] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-09T18:52:28.003577] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-09T18:52:28.078324] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T18:52:28.078703] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-09T18:52:28.082727] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-09T18:52:28.084750] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-09T18:52:28.084820] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-09T18:52:28.086150] [DEBUG] [LOCAL ] EXR: Trimmed 65898 records to 45561 (keeping 200 days of data) [2025-10-09T18:52:28.376514] [DEBUG] [LOCAL ] EXR: Primary data saved (45561 records). [2025-10-09T18:52:28.376714] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-09T18:52:28.376819] [INFO ] [MAIN ] Update Progress: 804/2373 symbols completed. EXR took 44.4s. Estimated remaining: 3h 39m 22s. Rate: 7.2 symbols/min [2025-10-09T18:52:28.548717] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:28.593212] [DEBUG] [LOCAL ] FBP: Loaded 45763 existing records from primary storage. [2025-10-09T18:52:28.593541] [INFO ] [MAIN ] FBP: Loaded 45763 existing records. [2025-10-09T18:52:28.768117] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:28.768319] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-09T18:52:28.768366] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-09T18:52:28.768612] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-09T18:52:28.768707] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-09T18:52:28.801986] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-09T18:52:29.122452] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:29.452721] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T18:52:29.596708] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-09T18:52:29.968564] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:52:30.396720] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-09T18:52:31.196693] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-09T18:52:31.234803] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T18:52:31.370371] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T18:52:31.996731] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-09T18:52:32.796708] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-09T18:52:32.849222] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T18:52:32.852979] [INFO ] [REMOTE ] FAF: Full fetch complete (57718 records). [2025-10-09T18:52:32.853089] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-09T18:52:33.192912] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T18:52:33.272506] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-09T18:52:33.272605] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-09T18:52:33.273493] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-09T18:52:33.274268] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-09T18:52:33.275451] [DEBUG] [LOCAL ] FAF: Trimmed 57718 records to 41815 (keeping 200 days of data) [2025-10-09T18:52:33.537391] [DEBUG] [LOCAL ] FAF: Primary data saved (41815 records). [2025-10-09T18:52:33.537526] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-09T18:52:33.538422] [INFO ] [MAIN ] Update Progress: 805/2373 symbols completed. FAF took 27.8s. Estimated remaining: 3h 39m 8s. Rate: 7.2 symbols/min [2025-10-09T18:52:33.601824] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-09T18:52:33.706591] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:33.746879] [DEBUG] [LOCAL ] FBRT: Loaded 35080 existing records from primary storage. [2025-10-09T18:52:33.747167] [INFO ] [MAIN ] FBRT: Loaded 35080 existing records. [2025-10-09T18:52:33.919110] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:33.919357] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-09T18:52:33.919423] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-09T18:52:33.919808] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-09T18:52:33.919866] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-09T18:52:34.268176] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:34.396810] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-09T18:52:35.156851] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T18:52:35.196691] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-09T18:52:35.355735] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T18:52:35.996699] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-09T18:52:36.554452] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-09T18:52:36.796790] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-09T18:52:37.448389] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T18:52:37.491345] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (4.69 seconds). [2025-10-09T18:52:37.520442] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T18:52:37.596729] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-09T18:52:38.396747] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-09T18:52:38.833629] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T18:52:39.196759] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-09T18:52:39.967816] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T18:52:39.996668] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-09T18:52:40.186085] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T18:52:40.796733] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-09T18:52:41.358544] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T18:52:41.596742] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-09T18:52:42.252393] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-09T18:52:42.396679] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-09T18:52:42.849619] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T18:52:43.196724] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-09T18:52:43.760333] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:52:43.764489] [INFO ] [REMOTE ] FBIN: Full fetch complete (72726 records). [2025-10-09T18:52:43.764612] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-09T18:52:44.002956] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-09T18:52:44.163937] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-09T18:52:44.164030] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-09T18:52:44.165003] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-09T18:52:44.165066] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-09T18:52:44.166480] [DEBUG] [LOCAL ] FBIN: Trimmed 72726 records to 50714 (keeping 200 days of data) [2025-10-09T18:52:44.473577] [DEBUG] [LOCAL ] FBIN: Primary data saved (50714 records). [2025-10-09T18:52:44.473747] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-09T18:52:44.474565] [INFO ] [MAIN ] Update Progress: 806/2373 symbols completed. FBIN took 33.0s. Estimated remaining: 3h 39m 4s. Rate: 7.2 symbols/min [2025-10-09T18:52:44.610177] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T18:52:44.683919] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:44.702190] [DEBUG] [LOCAL ] FC: Loaded 15157 existing records from primary storage. [2025-10-09T18:52:44.702435] [INFO ] [MAIN ] FC: Loaded 15157 existing records. [2025-10-09T18:52:44.801867] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-09T18:52:44.882084] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:44.882301] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-09T18:52:44.882347] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-09T18:52:44.882532] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-09T18:52:44.882589] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-09T18:52:45.250383] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:45.343475] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T18:52:45.596742] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-09T18:52:46.106511] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T18:52:46.396716] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-09T18:52:46.655738] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T18:52:47.196750] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-09T18:52:47.754574] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-09T18:52:47.826591] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T18:52:47.996741] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-09T18:52:48.796798] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-09T18:52:49.584090] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T18:52:49.596721] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-09T18:52:49.702079] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T18:52:50.396762] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-09T18:52:50.476274] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T18:52:50.480204] [INFO ] [REMOTE ] FBK: Full fetch complete (34279 records). [2025-10-09T18:52:50.480363] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-09T18:52:50.959475] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-09T18:52:50.959607] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-09T18:52:50.960798] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-09T18:52:50.960891] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-09T18:52:50.962532] [DEBUG] [LOCAL ] FBK: Trimmed 34279 records to 26942 (keeping 200 days of data) [2025-10-09T18:52:51.201301] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-09T18:52:51.213335] [DEBUG] [LOCAL ] FBK: Primary data saved (26942 records). [2025-10-09T18:52:51.213605] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-09T18:52:51.213767] [INFO ] [MAIN ] Update Progress: 807/2373 symbols completed. FBK took 26.5s. Estimated remaining: 3h 38m 53s. Rate: 7.2 symbols/min [2025-10-09T18:52:51.470571] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:52:51.528838] [DEBUG] [LOCAL ] FCF: Loaded 39188 existing records from primary storage. [2025-10-09T18:52:51.529267] [INFO ] [MAIN ] FCF: Loaded 39188 existing records. [2025-10-09T18:52:51.803937] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:52:51.804247] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-09T18:52:51.804477] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-09T18:52:51.804971] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-09T18:52:51.805048] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-09T18:52:51.998855] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-09T18:52:52.131849] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:52:52.235095] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T18:52:52.234589] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:52:52.796773] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-09T18:52:53.450106] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:52:53.596729] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-09T18:52:54.038030] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T18:52:54.396729] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-09T18:52:54.909470] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:52:55.196727] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-09T18:52:55.532976] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T18:52:55.996752] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-09T18:52:56.315913] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T18:52:56.796801] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-09T18:52:57.453755] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T18:52:57.596714] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-09T18:52:57.633622] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T18:52:58.396747] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-09T18:52:58.953870] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T18:52:59.196747] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-09T18:52:59.406997] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T18:52:59.996761] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-09T18:53:00.435032] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:53:00.796774] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-09T18:53:01.388277] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T18:53:01.596780] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-09T18:53:01.952968] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T18:53:02.396748] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-09T18:53:02.700997] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T18:53:03.196700] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-09T18:53:03.996697] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-09T18:53:04.066731] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T18:53:04.337674] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-09T18:53:04.796736] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-09T18:53:05.301062] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T18:53:05.596732] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-09T18:53:06.154233] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:53:06.157878] [INFO ] [REMOTE ] FBRT: Full fetch complete (49269 records). [2025-10-09T18:53:06.157957] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-09T18:53:06.405909] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-09T18:53:06.493831] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T18:53:06.588069] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-09T18:53:06.588152] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-09T18:53:06.589031] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-09T18:53:06.589097] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-09T18:53:06.590333] [DEBUG] [LOCAL ] FBRT: Trimmed 49269 records to 35372 (keeping 200 days of data) [2025-10-09T18:53:06.808661] [DEBUG] [LOCAL ] FBRT: Primary data saved (35372 records). [2025-10-09T18:53:06.808815] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-09T18:53:06.809363] [INFO ] [MAIN ] Update Progress: 808/2373 symbols completed. FBRT took 33.3s. Estimated remaining: 3h 38m 58s. Rate: 7.1 symbols/min [2025-10-09T18:53:06.977329] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:07.007575] [DEBUG] [LOCAL ] FCN: Loaded 26003 existing records from primary storage. [2025-10-09T18:53:07.007895] [INFO ] [MAIN ] FCN: Loaded 26003 existing records. [2025-10-09T18:53:07.182167] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:07.182359] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-09T18:53:07.182405] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-09T18:53:07.182703] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-09T18:53:07.182760] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-09T18:53:07.202785] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-09T18:53:07.538873] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:07.996699] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-09T18:53:08.050523] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T18:53:08.353791] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T18:53:08.796721] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-09T18:53:09.189889] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T18:53:09.596775] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-09T18:53:10.113057] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T18:53:10.132307] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-09T18:53:10.396715] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-09T18:53:11.196734] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-09T18:53:11.496774] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T18:53:11.996725] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-09T18:53:12.547828] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-09T18:53:12.796716] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-09T18:53:13.193862] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T18:53:13.596686] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-09T18:53:13.833141] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T18:53:14.396754] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-09T18:53:14.830490] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T18:53:15.196768] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-09T18:53:15.932973] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T18:53:15.936890] [INFO ] [REMOTE ] FBP: Full fetch complete (66373 records). [2025-10-09T18:53:15.936995] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-09T18:53:16.006904] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-09T18:53:16.348587] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-09T18:53:16.348763] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-09T18:53:16.349842] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-09T18:53:16.349908] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-09T18:53:16.351318] [DEBUG] [LOCAL ] FBP: Trimmed 66373 records to 46095 (keeping 200 days of data) [2025-10-09T18:53:16.637523] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T18:53:16.667489] [DEBUG] [LOCAL ] FBP: Primary data saved (46095 records). [2025-10-09T18:53:16.667660] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-09T18:53:16.667759] [INFO ] [MAIN ] Update Progress: 809/2373 symbols completed. FBP took 48.3s. Estimated remaining: 3h 38m 53s. Rate: 7.1 symbols/min [2025-10-09T18:53:16.801773] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-09T18:53:16.845960] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:16.882855] [DEBUG] [LOCAL ] FCPT: Loaded 37317 existing records from primary storage. [2025-10-09T18:53:16.883137] [INFO ] [MAIN ] FCPT: Loaded 37317 existing records. [2025-10-09T18:53:17.080234] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:17.080569] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-09T18:53:17.080742] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-09T18:53:17.080987] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-09T18:53:17.081044] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-09T18:53:17.418796] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:53:17.467887] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:17.596719] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-09T18:53:17.900914] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T18:53:18.396686] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-09T18:53:18.822026] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T18:53:19.078115] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-09T18:53:19.196680] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-09T18:53:19.996750] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-09T18:53:20.017128] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T18:53:20.018768] [INFO ] [REMOTE ] FC: Full fetch complete (21758 records). [2025-10-09T18:53:20.018841] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-09T18:53:20.395581] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-09T18:53:20.395702] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-09T18:53:20.396273] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-09T18:53:20.396336] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-09T18:53:20.396982] [DEBUG] [LOCAL ] FC: Trimmed 21758 records to 15218 (keeping 200 days of data) [2025-10-09T18:53:20.490100] [DEBUG] [LOCAL ] FC: Primary data saved (15218 records). [2025-10-09T18:53:20.490248] [INFO ] [MAIN ] FC: Full history saved. [2025-10-09T18:53:20.490338] [INFO ] [MAIN ] Update Progress: 810/2373 symbols completed. FC took 36.0s. Estimated remaining: 3h 38m 36s. Rate: 7.2 symbols/min [2025-10-09T18:53:20.664236] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:20.664395] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-09T18:53:20.664433] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-09T18:53:20.664547] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-09T18:53:20.664590] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-09T18:53:20.664634] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-09T18:53:20.664708] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-09T18:53:20.806966] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-09T18:53:21.035325] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:21.322188] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T18:53:21.596722] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-09T18:53:22.182294] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T18:53:22.396703] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-09T18:53:22.868191] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-09T18:53:23.196734] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-09T18:53:23.501994] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T18:53:23.505491] [INFO ] [REMOTE ] FCF: Full fetch complete (58041 records). [2025-10-09T18:53:23.505638] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-09T18:53:23.894225] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-09T18:53:23.894318] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-09T18:53:23.895122] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-09T18:53:23.895191] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-09T18:53:23.896680] [DEBUG] [LOCAL ] FCF: Trimmed 58041 records to 39430 (keeping 200 days of data) [2025-10-09T18:53:23.998675] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-09T18:53:24.137974] [DEBUG] [LOCAL ] FCF: Primary data saved (39430 records). [2025-10-09T18:53:24.138109] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-09T18:53:24.138191] [INFO ] [MAIN ] Update Progress: 811/2373 symbols completed. FCF took 32.9s. Estimated remaining: 3h 38m 18s. Rate: 7.2 symbols/min [2025-10-09T18:53:24.320205] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:24.347912] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-09T18:53:24.349515] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-09T18:53:24.367359] [DEBUG] [LOCAL ] FCT: Loaded 14779 existing records from primary storage. [2025-10-09T18:53:24.367595] [INFO ] [MAIN ] FCT: Loaded 14779 existing records. [2025-10-09T18:53:24.561478] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:24.561857] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-09T18:53:24.561944] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-09T18:53:24.562180] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-09T18:53:24.562251] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-09T18:53:24.803620] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-09T18:53:24.985757] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:25.276790] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T18:53:25.596714] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-09T18:53:26.396778] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-09T18:53:26.814741] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-09T18:53:27.003920] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:53:27.196753] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-09T18:53:27.996761] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-09T18:53:28.638902] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:53:28.796762] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-09T18:53:29.011094] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T18:53:29.596794] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-09T18:53:29.945372] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T18:53:30.396692] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-09T18:53:30.591334] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T18:53:30.727792] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-09T18:53:31.196765] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-09T18:53:31.996785] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-09T18:53:32.417632] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T18:53:32.725248] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:53:32.796759] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-09T18:53:33.596720] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-09T18:53:33.840508] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:53:34.157039] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T18:53:34.396773] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-09T18:53:34.738723] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-09T18:53:35.196732] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-09T18:53:35.608742] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-09T18:53:35.996723] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-09T18:53:36.313275] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-09T18:53:36.796770] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-09T18:53:37.596746] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-09T18:53:38.009132] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T18:53:38.396742] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-09T18:53:38.991921] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T18:53:39.196690] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-09T18:53:39.252144] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T18:53:39.996722] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-09T18:53:40.581680] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T18:53:40.778028] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T18:53:40.796666] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-09T18:53:41.596752] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-09T18:53:41.679415] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-09T18:53:41.931852] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-09T18:53:42.396693] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-09T18:53:43.196703] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-09T18:53:43.552302] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T18:53:43.997692] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-09T18:53:44.004027] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T18:53:44.796765] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-09T18:53:45.095580] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:53:45.098163] [INFO ] [REMOTE ] FCN: Full fetch complete (35681 records). [2025-10-09T18:53:45.098242] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-09T18:53:45.467659] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-09T18:53:45.467747] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-09T18:53:45.468362] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-09T18:53:45.468418] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-09T18:53:45.469240] [DEBUG] [LOCAL ] FCN: Trimmed 35681 records to 26164 (keeping 200 days of data) [2025-10-09T18:53:45.610129] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-09T18:53:45.631987] [DEBUG] [LOCAL ] FCN: Primary data saved (26164 records). [2025-10-09T18:53:45.632103] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-09T18:53:45.632213] [INFO ] [MAIN ] Update Progress: 812/2373 symbols completed. FCN took 38.8s. Estimated remaining: 3h 38m 35s. Rate: 7.1 symbols/min [2025-10-09T18:53:45.742118] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T18:53:45.813665] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:45.862094] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-09T18:53:45.862400] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-10-09T18:53:46.050301] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:46.050506] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-09T18:53:46.050553] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-09T18:53:46.050825] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-09T18:53:46.050883] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-09T18:53:46.401899] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-09T18:53:46.432922] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:46.911969] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-09T18:53:47.051208] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T18:53:47.196697] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-09T18:53:47.996727] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-09T18:53:48.273294] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:53:48.277286] [INFO ] [REMOTE ] FCPT: Full fetch complete (53836 records). [2025-10-09T18:53:48.277390] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-09T18:53:48.705208] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-09T18:53:48.705295] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-09T18:53:48.706094] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-09T18:53:48.706166] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-09T18:53:48.707389] [DEBUG] [LOCAL ] FCPT: Trimmed 53836 records to 37591 (keeping 200 days of data) [2025-10-09T18:53:48.796992] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-09T18:53:48.931224] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T18:53:48.970175] [DEBUG] [LOCAL ] FCPT: Primary data saved (37591 records). [2025-10-09T18:53:48.970333] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-09T18:53:48.970430] [INFO ] [MAIN ] Update Progress: 813/2373 symbols completed. FCPT took 32.3s. Estimated remaining: 3h 38m 17s. Rate: 7.1 symbols/min [2025-10-09T18:53:49.137800] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:49.169405] [DEBUG] [LOCAL ] FDP: Loaded 30061 existing records from primary storage. [2025-10-09T18:53:49.169696] [INFO ] [MAIN ] FDP: Loaded 30061 existing records. [2025-10-09T18:53:49.298929] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T18:53:49.322672] [INFO ] [REMOTE ] FCRX: Full fetch complete (1669 records). [2025-10-09T18:53:49.331635] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-09T18:53:49.434589] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:49.455767] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-09T18:53:49.456191] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-09T18:53:49.495133] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-09T18:53:49.514430] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-09T18:53:49.600884] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-09T18:53:49.613261] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-09T18:53:49.636482] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:53:49.647495] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:53:49.659101] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-09T18:53:49.688535] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-09T18:53:49.693774] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-09T18:53:49.699411] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-09T18:53:49.699565] [INFO ] [MAIN ] Update Progress: 814/2373 symbols completed. FCRX took 29.2s. Estimated remaining: 3h 37m 54s. Rate: 7.2 symbols/min [2025-10-09T18:53:50.082609] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:53:50.104005] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:50.131385] [DEBUG] [LOCAL ] FDS: Loaded 26941 existing records from primary storage. [2025-10-09T18:53:50.131705] [INFO ] [MAIN ] FDS: Loaded 26941 existing records. [2025-10-09T18:53:50.306531] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:53:50.306778] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-09T18:53:50.306830] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-09T18:53:50.307156] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-09T18:53:50.307213] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-09T18:53:50.403158] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-09T18:53:50.664235] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T18:53:50.676714] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:53:51.196800] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-09T18:53:51.996686] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-09T18:53:52.312243] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T18:53:52.514048] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-09T18:53:52.802248] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-09T18:53:52.810877] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T18:53:53.596727] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-09T18:53:54.396704] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-09T18:53:54.781251] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T18:53:54.930325] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T18:53:54.969240] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T18:53:55.196730] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-09T18:53:55.996703] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-09T18:53:56.346535] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T18:53:56.796799] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-09T18:53:56.846042] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T18:53:57.596677] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-09T18:53:57.915540] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T18:53:58.396756] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-09T18:53:59.196770] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-09T18:53:59.415790] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:53:59.580824] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T18:53:59.996788] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-09T18:54:00.347371] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T18:54:00.796724] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-09T18:54:01.173473] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T18:54:01.531049] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-09T18:54:01.596719] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-09T18:54:02.396722] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-09T18:54:02.869597] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-09T18:54:03.196780] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-09T18:54:03.559756] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T18:54:03.562098] [INFO ] [REMOTE ] FCT: Full fetch complete (21165 records). [2025-10-09T18:54:03.562200] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-09T18:54:03.939729] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-09T18:54:03.939825] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-09T18:54:03.940395] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-09T18:54:03.940435] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-09T18:54:03.941066] [DEBUG] [LOCAL ] FCT: Trimmed 21165 records to 14880 (keeping 200 days of data) [2025-10-09T18:54:04.005552] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-09T18:54:04.034361] [DEBUG] [LOCAL ] FCT: Primary data saved (14880 records). [2025-10-09T18:54:04.034511] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-09T18:54:04.034610] [INFO ] [MAIN ] Update Progress: 815/2373 symbols completed. FCT took 39.9s. Estimated remaining: 3h 37m 57s. Rate: 7.1 symbols/min [2025-10-09T18:54:04.199562] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:04.252361] [DEBUG] [LOCAL ] FDX: Loaded 51462 existing records from primary storage. [2025-10-09T18:54:04.252722] [INFO ] [MAIN ] FDX: Loaded 51462 existing records. [2025-10-09T18:54:04.430333] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:04.430736] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-09T18:54:04.430802] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-09T18:54:04.431351] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-09T18:54:04.431409] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-09T18:54:04.812575] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-09T18:54:04.816820] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:04.839147] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T18:54:05.118367] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T18:54:05.596721] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-09T18:54:06.396745] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-09T18:54:06.739799] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T18:54:06.932578] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T18:54:07.196722] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-09T18:54:07.737505] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T18:54:07.996780] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-09T18:54:08.480620] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T18:54:08.796696] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-09T18:54:08.837915] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T18:54:09.596714] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-09T18:54:10.396745] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-09T18:54:10.702791] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T18:54:11.196735] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-09T18:54:11.771726] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T18:54:11.814220] [INFO ] [REMOTE ] FDS: Full fetch complete (38092 records). [2025-10-09T18:54:11.814594] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-09T18:54:11.825228] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-09T18:54:12.001932] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-09T18:54:12.236615] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-09T18:54:12.236731] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-09T18:54:12.237381] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-09T18:54:12.237423] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-09T18:54:12.238398] [DEBUG] [LOCAL ] FDS: Trimmed 38092 records to 27281 (keeping 200 days of data) [2025-10-09T18:54:12.416706] [DEBUG] [LOCAL ] FDS: Primary data saved (27281 records). [2025-10-09T18:54:12.416864] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-09T18:54:12.416952] [INFO ] [MAIN ] Update Progress: 816/2373 symbols completed. FDS took 22.7s. Estimated remaining: 3h 37m 48s. Rate: 7.1 symbols/min [2025-10-09T18:54:12.589093] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:12.642066] [DEBUG] [LOCAL ] FE: Loaded 53433 existing records from primary storage. [2025-10-09T18:54:12.642391] [INFO ] [MAIN ] FE: Loaded 53433 existing records. [2025-10-09T18:54:12.807493] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-09T18:54:12.830936] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:12.831217] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-09T18:54:12.831279] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-09T18:54:12.831536] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-09T18:54:12.831594] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-09T18:54:13.231452] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:13.236603] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T18:54:13.278228] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-09T18:54:13.596744] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-09T18:54:14.396716] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-09T18:54:14.630558] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T18:54:14.659258] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T18:54:15.196788] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-09T18:54:15.996759] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-09T18:54:16.213781] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T18:54:16.796723] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-09T18:54:17.129907] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T18:54:17.596707] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-09T18:54:18.396686] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-09T18:54:18.555951] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:54:18.771302] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-10-09T18:54:19.196742] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-09T18:54:19.996737] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-09T18:54:20.653740] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-09T18:54:20.681388] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T18:54:20.780477] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-10-09T18:54:20.796690] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-09T18:54:21.596688] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-09T18:54:21.674839] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T18:54:22.396796] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-09T18:54:22.458717] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:54:23.086639] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T18:54:23.196705] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-09T18:54:23.634512] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T18:54:23.996736] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-09T18:54:24.796694] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-09T18:54:25.132411] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-09T18:54:25.596758] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-09T18:54:25.808476] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T18:54:26.396709] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-09T18:54:26.538482] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:54:27.196713] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-09T18:54:27.426846] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-09T18:54:27.996683] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-09T18:54:28.157289] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T18:54:28.796817] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-09T18:54:29.177305] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-09T18:54:29.181828] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-09T18:54:29.181960] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-09T18:54:29.590817] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-09T18:54:29.591009] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-09T18:54:29.592315] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-09T18:54:29.592468] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-09T18:54:29.594358] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 54090 (keeping 200 days of data) [2025-10-09T18:54:29.596699] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-09T18:54:29.723278] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T18:54:29.746594] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T18:54:29.750876] [INFO ] [REMOTE ] FDP: Full fetch complete (42883 records). [2025-10-09T18:54:29.751226] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-09T18:54:30.154637] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-09T18:54:30.155261] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-09T18:54:30.156305] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-09T18:54:30.156390] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-09T18:54:30.160194] [DEBUG] [LOCAL ] FDP: Trimmed 42883 records to 30266 (keeping 200 days of data) [2025-10-09T18:54:30.398076] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-09T18:54:30.577684] [DEBUG] [LOCAL ] FDP: Primary data saved (30266 records). [2025-10-09T18:54:30.578376] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-09T18:54:30.578818] [INFO ] [MAIN ] Update Progress: 817/2373 symbols completed. FDP took 41.6s. Estimated remaining: 3h 37m 58s. Rate: 7.1 symbols/min [2025-10-09T18:54:30.765215] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:30.765914] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-09T18:54:30.766495] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-09T18:54:30.766941] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-09T18:54:30.769610] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-09T18:54:30.769721] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-09T18:54:30.772630] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-09T18:54:30.772567] [DEBUG] [LOCAL ] FCX: Primary data saved (54090 records). [2025-10-09T18:54:30.772764] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-09T18:54:30.807610] [INFO ] [MAIN ] Update Progress: 818/2373 symbols completed. FCX took 45.2s. Estimated remaining: 3h 37m 35s. Rate: 7.1 symbols/min [2025-10-09T18:54:31.258087] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:31.343212] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:31.343836] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-09T18:54:31.384188] [DEBUG] [LOCAL ] FERG: Loaded 48754 existing records from primary storage. [2025-10-09T18:54:31.384523] [INFO ] [MAIN ] FERG: Loaded 48754 existing records. [2025-10-09T18:54:31.572111] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:31.572531] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-09T18:54:31.572692] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-09T18:54:31.583806] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-09T18:54:31.589035] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-09T18:54:31.679930] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-09T18:54:31.721626] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-09T18:54:31.984197] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:31.996668] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-09T18:54:32.214694] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T18:54:32.796779] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-09T18:54:33.115814] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-09T18:54:33.596746] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-09T18:54:33.760368] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T18:54:33.858898] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-09T18:54:34.396762] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-09T18:54:35.196807] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-09T18:54:35.738021] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:54:35.996756] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-09T18:54:36.414929] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T18:54:36.540519] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T18:54:36.796719] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-09T18:54:37.596788] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-09T18:54:38.065715] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-09T18:54:38.396771] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-09T18:54:38.552752] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-09T18:54:38.828353] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-09T18:54:39.196788] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-09T18:54:39.542062] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T18:54:39.996872] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-09T18:54:40.796740] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-09T18:54:41.134997] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-09T18:54:41.596772] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-09T18:54:41.862336] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T18:54:41.866522] [INFO ] [REMOTE ] FDX: Full fetch complete (74362 records). [2025-10-09T18:54:41.866639] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-09T18:54:41.979457] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-09T18:54:42.271437] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-09T18:54:42.271535] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-09T18:54:42.272471] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-09T18:54:42.272535] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-09T18:54:42.273986] [DEBUG] [LOCAL ] FDX: Trimmed 74362 records to 51817 (keeping 200 days of data) [2025-10-09T18:54:42.397553] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-09T18:54:42.600801] [DEBUG] [LOCAL ] FDX: Primary data saved (51817 records). [2025-10-09T18:54:42.600946] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-09T18:54:42.601030] [INFO ] [MAIN ] Update Progress: 819/2373 symbols completed. FDX took 38.6s. Estimated remaining: 3h 37m 33s. Rate: 7.1 symbols/min [2025-10-09T18:54:42.767453] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:42.783161] [DEBUG] [LOCAL ] FET: Loaded 12811 existing records from primary storage. [2025-10-09T18:54:42.783383] [INFO ] [MAIN ] FET: Loaded 12811 existing records. [2025-10-09T18:54:42.969052] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:42.969344] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-09T18:54:42.969402] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-09T18:54:42.969680] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-09T18:54:42.969751] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-09T18:54:43.206020] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-09T18:54:43.320966] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:43.773715] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T18:54:43.996760] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-09T18:54:44.132799] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T18:54:44.691748] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T18:54:44.796709] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-09T18:54:45.596742] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-09T18:54:46.130768] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T18:54:46.396766] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-09T18:54:47.196789] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-09T18:54:47.234692] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T18:54:47.664454] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T18:54:47.665202] [INFO ] [REMOTE ] FENG: Full fetch complete (2259 records). [2025-10-09T18:54:47.665269] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-09T18:54:47.848055] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T18:54:47.848377] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-09T18:54:47.848517] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-09T18:54:47.848612] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-09T18:54:47.848742] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-09T18:54:47.848805] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-09T18:54:47.848851] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-09T18:54:47.848911] [INFO ] [MAIN ] Update Progress: 820/2373 symbols completed. FENG took 17.3s. Estimated remaining: 3h 37m 18s. Rate: 7.1 symbols/min [2025-10-09T18:54:47.999817] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-09T18:54:48.025514] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:48.050875] [DEBUG] [LOCAL ] FF: Loaded 24514 existing records from primary storage. [2025-10-09T18:54:48.051148] [INFO ] [MAIN ] FF: Loaded 24514 existing records. [2025-10-09T18:54:48.233623] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:48.233888] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-09T18:54:48.234058] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-09T18:54:48.234450] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-09T18:54:48.234513] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-09T18:54:48.370091] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-09T18:54:48.644486] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:48.796726] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-09T18:54:48.816383] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T18:54:49.596784] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-09T18:54:50.380199] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T18:54:50.396677] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-09T18:54:51.196783] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-09T18:54:51.362460] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T18:54:51.367401] [INFO ] [REMOTE ] FE: Full fetch complete (77283 records). [2025-10-09T18:54:51.367568] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-09T18:54:52.015152] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-09T18:54:52.017382] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-09T18:54:52.022151] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-09T18:54:52.072063] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-09T18:54:52.089535] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-09T18:54:52.113171] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T18:54:52.115901] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T18:54:52.138814] [DEBUG] [LOCAL ] FE: Trimmed 77283 records to 53823 (keeping 200 days of data) [2025-10-09T18:54:52.600508] [DEBUG] [LOCAL ] FE: Primary data saved (53823 records). [2025-10-09T18:54:52.600780] [INFO ] [MAIN ] FE: Full history saved. [2025-10-09T18:54:52.602043] [INFO ] [MAIN ] Update Progress: 821/2373 symbols completed. FE took 40.2s. Estimated remaining: 3h 37m 3s. Rate: 7.2 symbols/min [2025-10-09T18:54:52.803214] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-09T18:54:52.833959] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:54:52.846561] [DEBUG] [LOCAL ] FFA: Loaded 6060 existing records from primary storage. [2025-10-09T18:54:52.855143] [INFO ] [MAIN ] FFA: Loaded 6060 existing records. [2025-10-09T18:54:52.889093] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T18:54:53.054637] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:54:53.054933] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-09T18:54:53.054998] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-09T18:54:53.055309] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-09T18:54:53.055381] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-09T18:54:53.401633] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:54:53.596692] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-09T18:54:53.829385] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T18:54:54.196320] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T18:54:54.396774] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-09T18:54:54.911980] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T18:54:55.196756] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-09T18:54:55.925922] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T18:54:55.996736] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-09T18:54:56.796701] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-09T18:54:56.883958] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T18:54:57.186783] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-09T18:54:57.596773] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-09T18:54:58.386724] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T18:54:58.396672] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-09T18:54:59.196737] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-09T18:54:59.739890] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T18:54:59.996775] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-09T18:55:00.610943] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T18:55:00.796713] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-09T18:55:00.885686] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T18:55:01.423315] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T18:55:01.596920] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-09T18:55:02.396768] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-09T18:55:02.446127] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T18:55:03.196769] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-09T18:55:03.886096] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-09T18:55:03.996714] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-09T18:55:04.192721] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T18:55:04.741335] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T18:55:04.796673] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-09T18:55:05.596737] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-09T18:55:05.625939] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T18:55:06.396723] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-09T18:55:07.043105] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T18:55:07.196748] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-09T18:55:07.284904] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T18:55:07.996792] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-09T18:55:08.026519] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T18:55:08.796728] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-09T18:55:09.277765] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-09T18:55:09.481771] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T18:55:09.596708] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-09T18:55:10.396702] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-09T18:55:10.669123] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T18:55:10.851251] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T18:55:11.196744] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-09T18:55:11.785700] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-09T18:55:11.996730] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-09T18:55:12.796691] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-09T18:55:12.924436] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T18:55:13.341016] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-09T18:55:13.596725] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-09T18:55:14.396714] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-09T18:55:14.525252] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T18:55:15.196719] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-09T18:55:15.800916] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T18:55:15.996721] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-09T18:55:16.228954] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T18:55:16.796728] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-09T18:55:17.596687] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-09T18:55:17.804200] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T18:55:17.805918] [INFO ] [REMOTE ] FFA: Full fetch complete (8735 records). [2025-10-09T18:55:17.805990] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-09T18:55:18.045839] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-09T18:55:18.241664] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-09T18:55:18.241789] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-09T18:55:18.242006] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-09T18:55:18.242046] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-09T18:55:18.242483] [DEBUG] [LOCAL ] FFA: Trimmed 8735 records to 6118 (keeping 200 days of data) [2025-10-09T18:55:18.280805] [DEBUG] [LOCAL ] FFA: Primary data saved (6118 records). [2025-10-09T18:55:18.280907] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-09T18:55:18.280986] [INFO ] [MAIN ] Update Progress: 822/2373 symbols completed. FFA took 25.7s. Estimated remaining: 3h 37m 27s. Rate: 7.1 symbols/min [2025-10-09T18:55:18.401321] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-09T18:55:18.438703] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T18:55:18.467612] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:18.486869] [DEBUG] [LOCAL ] FFC: Loaded 16723 existing records from primary storage. [2025-10-09T18:55:18.487097] [INFO ] [MAIN ] FFC: Loaded 16723 existing records. [2025-10-09T18:55:18.659019] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:18.659205] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-09T18:55:18.659253] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-09T18:55:18.659422] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-09T18:55:18.659482] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-09T18:55:19.007417] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:19.196688] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-09T18:55:19.335833] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T18:55:19.337599] [INFO ] [REMOTE ] FET: Full fetch complete (18239 records). [2025-10-09T18:55:19.337697] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-09T18:55:19.710088] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-09T18:55:19.710174] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-09T18:55:19.710616] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-09T18:55:19.710714] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-09T18:55:19.711456] [DEBUG] [LOCAL ] FET: Trimmed 18239 records to 12879 (keeping 200 days of data) [2025-10-09T18:55:19.791146] [DEBUG] [LOCAL ] FET: Primary data saved (12879 records). [2025-10-09T18:55:19.791295] [INFO ] [MAIN ] FET: Full history saved. [2025-10-09T18:55:19.791379] [INFO ] [MAIN ] Update Progress: 823/2373 symbols completed. FET took 37.2s. Estimated remaining: 3h 37m 6s. Rate: 7.1 symbols/min [2025-10-09T18:55:19.969892] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:19.996939] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-09T18:55:20.008520] [DEBUG] [LOCAL ] FFWM: Loaded 35821 existing records from primary storage. [2025-10-09T18:55:20.008871] [INFO ] [MAIN ] FFWM: Loaded 35821 existing records. [2025-10-09T18:55:20.127856] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T18:55:20.172227] [INFO ] [REMOTE ] FF: Full fetch complete (36470 records). [2025-10-09T18:55:20.179918] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-09T18:55:20.233673] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:20.277485] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-09T18:55:20.293494] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-09T18:55:20.304282] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-09T18:55:20.304409] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-09T18:55:20.808592] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-09T18:55:20.962494] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:20.962711] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-09T18:55:20.962789] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-09T18:55:20.963571] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-09T18:55:20.963630] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-09T18:55:20.964397] [DEBUG] [LOCAL ] FF: Trimmed 36470 records to 24629 (keeping 200 days of data) [2025-10-09T18:55:21.112355] [DEBUG] [LOCAL ] FF: Primary data saved (24629 records). [2025-10-09T18:55:21.112488] [INFO ] [MAIN ] FF: Full history saved. [2025-10-09T18:55:21.112571] [INFO ] [MAIN ] Update Progress: 824/2373 symbols completed. FF took 33.3s. Estimated remaining: 3h 36m 44s. Rate: 7.1 symbols/min [2025-10-09T18:55:21.279417] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:21.302153] [DEBUG] [LOCAL ] FG: Loaded 22742 existing records from primary storage. [2025-10-09T18:55:21.302396] [INFO ] [MAIN ] FG: Loaded 22742 existing records. [2025-10-09T18:55:21.481128] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:21.481366] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-09T18:55:21.481586] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-09T18:55:21.481907] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-09T18:55:21.481982] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-09T18:55:21.633312] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-09T18:55:21.680326] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T18:55:21.762830] [INFO ] [REMOTE ] FERG: Full fetch complete (70851 records). [2025-10-09T18:55:21.791180] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-09T18:55:21.957568] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:22.028334] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T18:55:22.299452] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-09T18:55:22.299530] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-09T18:55:22.300393] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-09T18:55:22.300457] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-09T18:55:22.301782] [DEBUG] [LOCAL ] FERG: Trimmed 70851 records to 49116 (keeping 200 days of data) [2025-10-09T18:55:22.396818] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-09T18:55:22.628384] [DEBUG] [LOCAL ] FERG: Primary data saved (49116 records). [2025-10-09T18:55:22.628537] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-09T18:55:22.628664] [INFO ] [MAIN ] Update Progress: 825/2373 symbols completed. FERG took 51.8s. Estimated remaining: 3h 36m 23s. Rate: 7.2 symbols/min [2025-10-09T18:55:22.802900] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:22.823998] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-09T18:55:22.833875] [DEBUG] [LOCAL ] FGN: Loaded 3793 existing records from primary storage. [2025-10-09T18:55:22.834055] [INFO ] [MAIN ] FGN: Loaded 3793 existing records. [2025-10-09T18:55:23.007496] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:23.007705] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-09T18:55:23.007765] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-09T18:55:23.008015] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-09T18:55:23.008072] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-09T18:55:23.162988] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T18:55:23.204386] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-09T18:55:23.377729] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:23.996712] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-09T18:55:24.070192] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-09T18:55:24.796695] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-09T18:55:25.096803] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T18:55:25.596710] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-09T18:55:25.805856] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T18:55:26.396735] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-09T18:55:26.918343] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:55:26.966570] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T18:55:27.196769] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-09T18:55:27.758579] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T18:55:27.996727] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-09T18:55:28.796723] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-09T18:55:28.866364] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T18:55:29.596721] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-09T18:55:30.135218] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T18:55:30.396706] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-09T18:55:30.514745] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-09T18:55:30.715110] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T18:55:31.196707] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-09T18:55:31.996717] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-09T18:55:32.546308] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-09T18:55:32.716019] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T18:55:32.796669] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-09T18:55:33.596731] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-09T18:55:34.244894] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T18:55:34.313747] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-09T18:55:34.396679] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-09T18:55:35.196770] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-09T18:55:35.710686] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T18:55:35.996709] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-09T18:55:36.519162] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-09T18:55:36.554372] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T18:55:36.796730] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-09T18:55:37.107176] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-09T18:55:37.596780] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-09T18:55:38.396760] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-09T18:55:38.488972] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T18:55:38.949955] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T18:55:39.196713] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-09T18:55:39.996732] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-09T18:55:40.097467] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T18:55:40.429493] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T18:55:40.796726] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-09T18:55:41.351016] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T18:55:41.596724] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-09T18:55:42.396755] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-09T18:55:42.582780] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T18:55:42.686148] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-09T18:55:43.196777] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-09T18:55:43.996737] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-09T18:55:44.124045] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-09T18:55:44.654224] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T18:55:44.796779] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-09T18:55:45.596736] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-09T18:55:45.965661] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T18:55:46.040255] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T18:55:46.041342] [INFO ] [REMOTE ] FGN: Full fetch complete (5664 records). [2025-10-09T18:55:46.041426] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-09T18:55:46.405436] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-09T18:55:46.407391] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-09T18:55:46.407479] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-09T18:55:46.407752] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-09T18:55:46.407865] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-09T18:55:46.408393] [DEBUG] [LOCAL ] FGN: Trimmed 5664 records to 3810 (keeping 200 days of data) [2025-10-09T18:55:46.432845] [DEBUG] [LOCAL ] FGN: Primary data saved (3810 records). [2025-10-09T18:55:46.432915] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-09T18:55:46.433024] [INFO ] [MAIN ] Update Progress: 826/2373 symbols completed. FGN took 23.8s. Estimated remaining: 3h 36m 43s. Rate: 7.1 symbols/min [2025-10-09T18:55:46.600530] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:46.600721] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-09T18:55:46.600811] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-09T18:55:46.600894] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-09T18:55:46.600931] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-09T18:55:46.601031] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-09T18:55:46.601080] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-09T18:55:46.950709] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:47.117903] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T18:55:47.196723] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-09T18:55:47.996725] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-09T18:55:48.174527] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T18:55:48.418842] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:55:48.419177] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-09T18:55:48.419292] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:55:48.419348] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-09T18:55:48.419406] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:55:48.419480] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-09T18:55:48.419548] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-09T18:55:48.419606] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-09T18:55:48.419723] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-09T18:55:48.419805] [INFO ] [MAIN ] Update Progress: 827/2373 symbols completed. FGSN took 2.0s. Estimated remaining: 3h 36m 23s. Rate: 7.1 symbols/min [2025-10-09T18:55:48.601767] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:48.601957] [DEBUG] [LOCAL ] FHI: No existing data file found in primary storage. [2025-10-09T18:55:48.602015] [WARN ] [MAIN ] FHI: No existing data found, performing full refresh instead. [2025-10-09T18:55:48.602178] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-09T18:55:48.602256] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-09T18:55:48.602317] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-10-09T18:55:48.602351] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-09T18:55:48.801846] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-09T18:55:48.962537] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:49.596732] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-09T18:55:50.187242] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T18:55:50.396749] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-09T18:55:50.504249] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-09T18:55:51.196697] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-09T18:55:51.512119] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-09T18:55:51.996718] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-09T18:55:52.252678] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T18:55:52.796743] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-09T18:55:52.945021] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T18:55:53.596726] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-09T18:55:53.974532] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T18:55:53.977753] [INFO ] [REMOTE ] FFWM: Full fetch complete (51790 records). [2025-10-09T18:55:53.977899] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-09T18:55:54.366694] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-09T18:55:54.366801] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-09T18:55:54.367664] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-09T18:55:54.367729] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-09T18:55:54.369036] [DEBUG] [LOCAL ] FFWM: Trimmed 51790 records to 36030 (keeping 200 days of data) [2025-10-09T18:55:54.415863] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-09T18:55:54.582028] [DEBUG] [LOCAL ] FFWM: Primary data saved (36030 records). [2025-10-09T18:55:54.582189] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-09T18:55:54.582319] [INFO ] [MAIN ] Update Progress: 828/2373 symbols completed. FFWM took 34.8s. Estimated remaining: 3h 36m 10s. Rate: 7.1 symbols/min [2025-10-09T18:55:54.766304] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:54.816215] [DEBUG] [LOCAL ] FHN: Loaded 53373 existing records from primary storage. [2025-10-09T18:55:54.816552] [INFO ] [MAIN ] FHN: Loaded 53373 existing records. [2025-10-09T18:55:55.013061] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:55.013522] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-09T18:55:55.013667] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-09T18:55:55.014138] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-09T18:55:55.014204] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-09T18:55:55.199566] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-09T18:55:55.207635] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T18:55:55.446888] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:55.462249] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T18:55:55.885961] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-09T18:55:55.996735] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-09T18:55:56.796726] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-09T18:55:57.596708] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-09T18:55:57.674005] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T18:55:57.675705] [INFO ] [REMOTE ] FFC: Full fetch complete (24651 records). [2025-10-09T18:55:57.675778] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-09T18:55:57.833926] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-09T18:55:58.092328] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-09T18:55:58.092403] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-09T18:55:58.092917] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-09T18:55:58.092979] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-09T18:55:58.093584] [DEBUG] [LOCAL ] FFC: Trimmed 24651 records to 16860 (keeping 200 days of data) [2025-10-09T18:55:58.198948] [DEBUG] [LOCAL ] FFC: Primary data saved (16860 records). [2025-10-09T18:55:58.199094] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-09T18:55:58.199179] [INFO ] [MAIN ] Update Progress: 829/2373 symbols completed. FFC took 39.9s. Estimated remaining: 3h 35m 53s. Rate: 7.2 symbols/min [2025-10-09T18:55:58.367813] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:55:58.396929] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-09T18:55:58.421360] [DEBUG] [LOCAL ] FI: Loaded 53534 existing records from primary storage. [2025-10-09T18:55:58.421713] [INFO ] [MAIN ] FI: Loaded 53534 existing records. [2025-10-09T18:55:58.599688] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:55:58.600052] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-09T18:55:58.600123] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-09T18:55:58.600385] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-09T18:55:58.600446] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-09T18:55:58.966931] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:55:58.992105] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T18:55:59.196759] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-09T18:55:59.543022] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T18:55:59.996741] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-09T18:56:00.613670] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T18:56:00.773498] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T18:56:00.775561] [INFO ] [REMOTE ] FG: Full fetch complete (28112 records). [2025-10-09T18:56:00.775630] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-09T18:56:00.801945] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-09T18:56:01.156494] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-09T18:56:01.156575] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-09T18:56:01.157194] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-09T18:56:01.157259] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-09T18:56:01.158073] [DEBUG] [LOCAL ] FG: Trimmed 28112 records to 22863 (keeping 200 days of data) [2025-10-09T18:56:01.302075] [DEBUG] [LOCAL ] FG: Primary data saved (22863 records). [2025-10-09T18:56:01.302209] [INFO ] [MAIN ] FG: Full history saved. [2025-10-09T18:56:01.302293] [INFO ] [MAIN ] Update Progress: 830/2373 symbols completed. FG took 40.2s. Estimated remaining: 3h 35m 35s. Rate: 7.2 symbols/min [2025-10-09T18:56:01.494745] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:01.517901] [DEBUG] [LOCAL ] FICO: Loaded 21409 existing records from primary storage. [2025-10-09T18:56:01.518159] [INFO ] [MAIN ] FICO: Loaded 21409 existing records. [2025-10-09T18:56:01.601883] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-09T18:56:01.706181] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:01.706502] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-09T18:56:01.706564] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-09T18:56:01.706889] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-09T18:56:01.706953] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-09T18:56:02.061131] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:02.340315] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T18:56:02.396666] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-09T18:56:03.083442] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T18:56:03.196725] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-09T18:56:03.948936] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T18:56:03.996742] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-09T18:56:04.224036] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T18:56:04.796730] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-09T18:56:05.599464] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-09T18:56:05.605360] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T18:56:05.814413] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T18:56:06.396813] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-09T18:56:07.131121] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:56:07.196667] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-09T18:56:07.645970] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T18:56:07.996700] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-09T18:56:08.219933] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T18:56:08.796739] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-09T18:56:08.882250] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T18:56:09.596721] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-09T18:56:10.316228] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T18:56:10.396672] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-09T18:56:11.205566] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-09T18:56:11.208484] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T18:56:11.996712] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-09T18:56:12.359723] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T18:56:12.741911] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T18:56:12.796664] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-09T18:56:12.852544] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T18:56:13.596768] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-09T18:56:14.339416] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T18:56:14.396704] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-09T18:56:14.986314] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T18:56:15.196730] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-09T18:56:15.938693] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T18:56:15.996710] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-09T18:56:16.793332] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T18:56:16.797633] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-09T18:56:17.239474] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T18:56:17.596731] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-09T18:56:18.148478] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T18:56:18.151553] [INFO ] [REMOTE ] FHI: Full fetch complete (57485 records). [2025-10-09T18:56:18.151672] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-09T18:56:18.406618] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-09T18:56:18.543249] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-09T18:56:18.543338] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-09T18:56:18.544146] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-09T18:56:18.544208] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-09T18:56:18.545413] [DEBUG] [LOCAL ] FHI: Trimmed 57485 records to 40145 (keeping 200 days of data) [2025-10-09T18:56:18.788746] [DEBUG] [LOCAL ] FHI: Primary data saved (40145 records). [2025-10-09T18:56:18.788875] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-09T18:56:18.788965] [INFO ] [MAIN ] Update Progress: 831/2373 symbols completed. FHI took 30.4s. Estimated remaining: 3h 35m 43s. Rate: 7.1 symbols/min [2025-10-09T18:56:18.966230] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:18.966480] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-09T18:56:18.966538] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-09T18:56:18.966706] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-09T18:56:18.966766] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-09T18:56:18.966814] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-09T18:56:18.966848] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-09T18:56:19.213842] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-09T18:56:19.362390] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:19.391365] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T18:56:19.529785] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T18:56:19.996724] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-09T18:56:20.796740] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-09T18:56:21.205521] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-09T18:56:21.280103] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-09T18:56:21.409611] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T18:56:21.596774] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-09T18:56:22.396761] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-09T18:56:22.895969] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T18:56:23.196764] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-09T18:56:23.423726] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-09T18:56:23.996690] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-09T18:56:24.263170] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T18:56:24.318053] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T18:56:24.796714] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-09T18:56:25.596693] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-09T18:56:25.970709] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T18:56:26.396769] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-09T18:56:27.196801] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-09T18:56:27.265071] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T18:56:27.536014] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-09T18:56:27.996721] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-09T18:56:28.042867] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T18:56:28.796736] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-09T18:56:29.596708] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-09T18:56:30.043691] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:56:30.076576] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-09T18:56:30.130078] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T18:56:30.396726] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-09T18:56:30.696247] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-09T18:56:31.196729] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-09T18:56:31.996776] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-09T18:56:32.229924] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:56:32.230172] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-09T18:56:32.230263] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:56:32.230338] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-09T18:56:32.230401] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:56:32.230482] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-09T18:56:32.230555] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-09T18:56:32.230611] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-09T18:56:32.230701] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-09T18:56:32.230770] [INFO ] [MAIN ] Update Progress: 832/2373 symbols completed. FIG took 13.4s. Estimated remaining: 3h 35m 44s. Rate: 7.1 symbols/min [2025-10-09T18:56:32.401176] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:32.443676] [DEBUG] [LOCAL ] FIGS: Loaded 48743 existing records from primary storage. [2025-10-09T18:56:32.444002] [INFO ] [MAIN ] FIGS: Loaded 48743 existing records. [2025-10-09T18:56:32.623867] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:32.624072] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-09T18:56:32.624121] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-09T18:56:32.624354] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-09T18:56:32.624411] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-09T18:56:32.805550] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-09T18:56:32.997999] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:33.072635] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-09T18:56:33.596753] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-09T18:56:33.882847] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T18:56:33.885897] [INFO ] [REMOTE ] FICO: Full fetch complete (29450 records). [2025-10-09T18:56:33.885971] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-09T18:56:34.260104] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-09T18:56:34.260261] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-09T18:56:34.260963] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-09T18:56:34.261031] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-09T18:56:34.261843] [DEBUG] [LOCAL ] FICO: Trimmed 29450 records to 21632 (keeping 200 days of data) [2025-10-09T18:56:34.397043] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-09T18:56:34.400906] [DEBUG] [LOCAL ] FICO: Primary data saved (21632 records). [2025-10-09T18:56:34.400972] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-09T18:56:34.401051] [INFO ] [MAIN ] Update Progress: 833/2373 symbols completed. FICO took 33.1s. Estimated remaining: 3h 35m 24s. Rate: 7.1 symbols/min [2025-10-09T18:56:34.580328] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:34.623054] [DEBUG] [LOCAL ] FIHL: Loaded 39645 existing records from primary storage. [2025-10-09T18:56:34.623335] [INFO ] [MAIN ] FIHL: Loaded 39645 existing records. [2025-10-09T18:56:34.813454] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:34.813759] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-09T18:56:34.813816] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-09T18:56:34.814043] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-09T18:56:34.814108] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-09T18:56:35.170446] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:35.196671] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-09T18:56:35.336146] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:56:35.996683] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-09T18:56:36.092537] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T18:56:36.545775] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T18:56:36.796815] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-09T18:56:37.596702] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-09T18:56:37.662276] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T18:56:38.161048] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T18:56:38.165594] [INFO ] [REMOTE ] FHN: Full fetch complete (77294 records). [2025-10-09T18:56:38.165751] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-09T18:56:38.401918] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-09T18:56:38.570885] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-09T18:56:38.570964] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-09T18:56:38.571884] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-09T18:56:38.571947] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-09T18:56:38.573364] [DEBUG] [LOCAL ] FHN: Trimmed 77294 records to 53763 (keeping 200 days of data) [2025-10-09T18:56:38.904427] [DEBUG] [LOCAL ] FHN: Primary data saved (53763 records). [2025-10-09T18:56:38.904552] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-09T18:56:38.904632] [INFO ] [MAIN ] Update Progress: 834/2373 symbols completed. FHN took 44.3s. Estimated remaining: 3h 35m 9s. Rate: 7.2 symbols/min [2025-10-09T18:56:39.072773] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:39.083351] [DEBUG] [LOCAL ] FINS: Loaded 8304 existing records from primary storage. [2025-10-09T18:56:39.083554] [INFO ] [MAIN ] FINS: Loaded 8304 existing records. [2025-10-09T18:56:39.201819] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-09T18:56:39.266388] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:39.266961] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-09T18:56:39.267131] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-09T18:56:39.267417] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-09T18:56:39.267482] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-09T18:56:39.706137] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:39.709130] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-09T18:56:39.996701] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-09T18:56:40.140506] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T18:56:40.543371] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T18:56:40.713798] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T18:56:40.720077] [INFO ] [REMOTE ] FI: Full fetch complete (77216 records). [2025-10-09T18:56:40.720255] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-09T18:56:40.801811] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-09T18:56:41.121931] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-09T18:56:41.122051] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-09T18:56:41.123076] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-09T18:56:41.123155] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-09T18:56:41.124748] [DEBUG] [LOCAL ] FI: Trimmed 77216 records to 53923 (keeping 200 days of data) [2025-10-09T18:56:41.456250] [DEBUG] [LOCAL ] FI: Primary data saved (53923 records). [2025-10-09T18:56:41.456387] [INFO ] [MAIN ] FI: Full history saved. [2025-10-09T18:56:41.457334] [INFO ] [MAIN ] Update Progress: 835/2373 symbols completed. FI took 43.3s. Estimated remaining: 3h 34m 50s. Rate: 7.2 symbols/min [2025-10-09T18:56:41.599282] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-09T18:56:41.633995] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:41.680967] [DEBUG] [LOCAL ] FINV: Loaded 45214 existing records from primary storage. [2025-10-09T18:56:41.681298] [INFO ] [MAIN ] FINV: Loaded 45214 existing records. [2025-10-09T18:56:41.869964] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T18:56:41.869350] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:41.871347] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-09T18:56:41.873904] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-09T18:56:41.874211] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-09T18:56:41.874269] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-09T18:56:42.223823] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:42.396701] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-09T18:56:42.993830] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T18:56:43.196715] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-09T18:56:43.787318] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T18:56:43.996721] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-09T18:56:44.014291] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T18:56:44.796743] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-09T18:56:45.101185] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T18:56:45.483398] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T18:56:45.596697] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-09T18:56:46.396808] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-09T18:56:46.991965] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T18:56:47.027557] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T18:56:47.196751] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-09T18:56:47.943070] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T18:56:47.996739] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-09T18:56:48.763732] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T18:56:48.796667] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-09T18:56:49.329237] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T18:56:49.596756] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-09T18:56:50.396702] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-09T18:56:50.905542] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T18:56:51.196769] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-09T18:56:51.493198] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T18:56:51.755310] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T18:56:51.996728] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-09T18:56:52.796699] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-09T18:56:53.095312] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T18:56:53.596727] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-09T18:56:54.232921] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T18:56:54.294883] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T18:56:54.396721] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-09T18:56:55.180011] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T18:56:55.196671] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-09T18:56:55.891218] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T18:56:55.892245] [INFO ] [REMOTE ] FINS: Full fetch complete (11891 records). [2025-10-09T18:56:55.892314] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-09T18:56:55.996806] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-09T18:56:56.265583] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-09T18:56:56.265683] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-09T18:56:56.265958] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-09T18:56:56.265998] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-09T18:56:56.266435] [DEBUG] [LOCAL ] FINS: Trimmed 11891 records to 8357 (keeping 200 days of data) [2025-10-09T18:56:56.318995] [DEBUG] [LOCAL ] FINS: Primary data saved (8357 records). [2025-10-09T18:56:56.319106] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-09T18:56:56.319182] [INFO ] [MAIN ] Update Progress: 836/2373 symbols completed. FINS took 17.4s. Estimated remaining: 3h 34m 53s. Rate: 7.2 symbols/min [2025-10-09T18:56:56.485214] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:56:56.535052] [DEBUG] [LOCAL ] FIS: Loaded 53350 existing records from primary storage. [2025-10-09T18:56:56.535404] [INFO ] [MAIN ] FIS: Loaded 53350 existing records. [2025-10-09T18:56:56.721211] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:56:56.721449] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-09T18:56:56.721504] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-09T18:56:56.721833] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-09T18:56:56.721892] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-09T18:56:56.801841] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-09T18:56:57.074045] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:56:57.534000] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T18:56:57.596688] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-09T18:56:58.396685] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-09T18:56:58.502371] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T18:56:58.705124] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T18:56:59.196720] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-09T18:56:59.996731] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-09T18:57:00.125866] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T18:57:00.749128] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-09T18:57:00.796669] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-09T18:57:01.096855] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T18:57:01.596751] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-09T18:57:02.401842] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-09T18:57:02.418850] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T18:57:03.022351] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T18:57:03.196723] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-09T18:57:03.996718] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-09T18:57:04.085101] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T18:57:04.666024] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T18:57:04.796700] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-09T18:57:05.596783] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-09T18:57:05.665333] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T18:57:06.092249] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-09T18:57:06.396793] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-09T18:57:07.113792] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T18:57:07.196698] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-09T18:57:07.996678] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-09T18:57:08.266099] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T18:57:08.429907] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-09T18:57:08.796719] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-09T18:57:09.596690] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-09T18:57:09.683878] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T18:57:10.367983] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T18:57:10.372271] [INFO ] [REMOTE ] FINV: Full fetch complete (63916 records). [2025-10-09T18:57:10.372378] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-09T18:57:10.405526] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-09T18:57:10.761974] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-09T18:57:10.762060] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-09T18:57:10.762940] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-09T18:57:10.763003] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-09T18:57:10.764351] [DEBUG] [LOCAL ] FINV: Trimmed 63916 records to 45581 (keeping 200 days of data) [2025-10-09T18:57:11.031473] [DEBUG] [LOCAL ] FINV: Primary data saved (45581 records). [2025-10-09T18:57:11.031639] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-09T18:57:11.033067] [INFO ] [MAIN ] Update Progress: 837/2373 symbols completed. FINV took 29.6s. Estimated remaining: 3h 34m 56s. Rate: 7.1 symbols/min [2025-10-09T18:57:11.196719] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-09T18:57:11.557309] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T18:57:11.996768] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-09T18:57:12.063322] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T18:57:12.642432] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T18:57:12.796741] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-09T18:57:13.596758] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-09T18:57:13.873433] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T18:57:14.296832] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T18:57:14.396734] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-09T18:57:14.847243] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T18:57:15.196743] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-09T18:57:15.493290] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T18:57:15.497505] [INFO ] [REMOTE ] FIGS: Full fetch complete (70810 records). [2025-10-09T18:57:15.497620] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-09T18:57:15.887090] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-09T18:57:15.887177] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-09T18:57:15.888132] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-09T18:57:15.888206] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-09T18:57:15.889738] [DEBUG] [LOCAL ] FIGS: Trimmed 70810 records to 49061 (keeping 200 days of data) [2025-10-09T18:57:15.996868] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-09T18:57:16.174138] [DEBUG] [LOCAL ] FIGS: Primary data saved (49061 records). [2025-10-09T18:57:16.174279] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-09T18:57:16.175188] [INFO ] [MAIN ] Update Progress: 838/2373 symbols completed. FIGS took 43.9s. Estimated remaining: 3h 34m 42s. Rate: 7.1 symbols/min [2025-10-09T18:57:16.699604] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T18:57:16.796697] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-09T18:57:17.425698] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T18:57:17.596779] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-09T18:57:17.760022] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T18:57:18.396729] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-09T18:57:19.409537] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T18:57:19.421393] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-09T18:57:19.686285] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T18:57:19.689912] [INFO ] [REMOTE ] FIHL: Full fetch complete (56070 records). [2025-10-09T18:57:19.690028] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-09T18:57:20.076222] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-09T18:57:20.076304] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-09T18:57:20.077116] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-09T18:57:20.077181] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-09T18:57:20.078347] [DEBUG] [LOCAL ] FIHL: Trimmed 56070 records to 39903 (keeping 200 days of data) [2025-10-09T18:57:20.325450] [DEBUG] [LOCAL ] FIHL: Primary data saved (39903 records). [2025-10-09T18:57:20.325594] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-09T18:57:20.325711] [INFO ] [MAIN ] Update Progress: 839/2373 symbols completed. FIHL took 45.9s. Estimated remaining: 3h 34m 26s. Rate: 7.2 symbols/min [2025-10-09T18:57:21.183078] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T18:57:21.195175] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-09T18:57:22.855420] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-09T18:57:22.868579] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-09T18:57:24.249904] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-09T18:57:24.254392] [INFO ] [REMOTE ] FIS: Full fetch complete (77178 records). [2025-10-09T18:57:24.254525] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-09T18:57:24.672053] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-09T18:57:24.672170] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-09T18:57:24.673194] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-09T18:57:24.673266] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-09T18:57:24.675084] [DEBUG] [LOCAL ] FIS: Trimmed 77178 records to 53737 (keeping 200 days of data) [2025-10-09T18:57:25.015187] [DEBUG] [LOCAL ] FIS: Primary data saved (53737 records). [2025-10-09T18:57:25.015328] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-09T18:57:25.015458] [INFO ] [MAIN ] Update Progress: 840/2373 symbols completed. FIS took 28.7s. Estimated remaining: 3h 34m 11s. Rate: 7.2 symbols/min [2025-10-09T18:57:25.652448] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:25.644283] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:25.714424] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-09T18:57:25.699780] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:25.717923] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:25.718237] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-09T18:57:25.718879] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-09T18:57:25.718927] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-09T18:57:25.718970] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-09T18:57:25.719003] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-09T18:57:25.830218] [DEBUG] [LOCAL ] FLC: Loaded 5366 existing records from primary storage. [2025-10-09T18:57:25.842233] [INFO ] [MAIN ] FLC: Loaded 5366 existing records. [2025-10-09T18:57:26.048852] [DEBUG] [LOCAL ] FIX: Loaded 29294 existing records from primary storage. [2025-10-09T18:57:26.068888] [INFO ] [MAIN ] FIX: Loaded 29294 existing records. [2025-10-09T18:57:26.319520] [DEBUG] [LOCAL ] FLG: Loaded 53325 existing records from primary storage. [2025-10-09T18:57:26.372278] [INFO ] [MAIN ] FLG: Loaded 53325 existing records. [2025-10-09T18:57:26.495961] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:26.520937] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-09T18:57:26.521064] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-09T18:57:26.632259] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:26.642857] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-09T18:57:26.693467] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-09T18:57:26.693557] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-09T18:57:26.751427] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-09T18:57:26.780044] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:26.880525] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-09T18:57:26.864027] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-09T18:57:26.948202] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-09T18:57:26.947932] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:26.998143] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-09T18:57:27.052965] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-09T18:57:27.161161] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-09T18:57:27.223533] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-09T18:57:27.233090] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:57:27.260119] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-09T18:57:27.346401] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:57:27.408150] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-09T18:57:27.423252] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:57:27.533781] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-09T18:57:27.573130] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-09T18:57:27.572860] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:27.587320] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-09T18:57:27.612401] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-09T18:57:27.662066] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-09T18:57:27.733672] [INFO ] [MAIN ] Update Progress: 841/2373 symbols completed. FIXT took 2.7s. Estimated remaining: 3h 33m 52s. Rate: 7.2 symbols/min [2025-10-09T18:57:27.911528] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:27.973548] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-09T18:57:28.119533] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:28.143381] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-09T18:57:28.175919] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:28.209949] [DEBUG] [LOCAL ] FLNG: Loaded 33564 existing records from primary storage. [2025-10-09T18:57:28.210243] [INFO ] [MAIN ] FLNG: Loaded 33564 existing records. [2025-10-09T18:57:28.393721] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T18:57:28.397277] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:28.399386] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-09T18:57:28.399563] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-09T18:57:28.400306] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-09T18:57:28.400522] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-09T18:57:28.400578] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-09T18:57:28.757629] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:28.758004] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-09T18:57:29.138550] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T18:57:29.140849] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-09T18:57:29.324587] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T18:57:29.330482] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-09T18:57:29.762177] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T18:57:29.763804] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-09T18:57:29.836530] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T18:57:29.847411] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-09T18:57:30.153193] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-09T18:57:30.155189] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-09T18:57:30.259103] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T18:57:30.396672] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-09T18:57:30.588212] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T18:57:30.620445] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-09T18:57:31.196697] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-09T18:57:31.379770] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T18:57:31.749154] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T18:57:31.791416] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T18:57:31.996712] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-09T18:57:32.540596] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-09T18:57:32.796716] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-09T18:57:33.310400] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-09T18:57:33.596801] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-09T18:57:34.270320] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-09T18:57:34.396689] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-09T18:57:34.795634] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-09T18:57:35.196700] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-09T18:57:35.996791] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-09T18:57:36.779303] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T18:57:36.780205] [INFO ] [REMOTE ] FLC: Full fetch complete (7788 records). [2025-10-09T18:57:36.780273] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-09T18:57:36.802019] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-09T18:57:36.906692] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T18:57:37.169967] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-09T18:57:37.170057] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-09T18:57:37.170287] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-09T18:57:37.170327] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-09T18:57:37.170746] [DEBUG] [LOCAL ] FLC: Trimmed 7788 records to 5406 (keeping 200 days of data) [2025-10-09T18:57:37.204244] [DEBUG] [LOCAL ] FLC: Primary data saved (5406 records). [2025-10-09T18:57:37.204342] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-09T18:57:37.204424] [INFO ] [MAIN ] Update Progress: 842/2373 symbols completed. FLC took 12.2s. Estimated remaining: 3h 33m 46s. Rate: 7.2 symbols/min [2025-10-09T18:57:37.370924] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:37.422418] [DEBUG] [LOCAL ] FLO: Loaded 51950 existing records from primary storage. [2025-10-09T18:57:37.422791] [INFO ] [MAIN ] FLO: Loaded 51950 existing records. [2025-10-09T18:57:37.601215] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:37.598451] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-09T18:57:37.601577] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-09T18:57:37.602550] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-09T18:57:37.602853] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-09T18:57:37.602925] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-09T18:57:37.959160] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:38.348753] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T18:57:38.396696] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-09T18:57:39.109132] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T18:57:39.196691] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-09T18:57:39.974006] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T18:57:39.996718] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-09T18:57:40.796690] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-09T18:57:40.917048] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T18:57:41.260587] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-09T18:57:41.596726] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-09T18:57:42.396689] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-09T18:57:42.471037] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T18:57:43.176619] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T18:57:43.196691] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-09T18:57:43.788228] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T18:57:43.996763] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-09T18:57:44.796787] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-09T18:57:44.994076] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T18:57:45.355984] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T18:57:45.596752] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-09T18:57:46.396725] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-09T18:57:46.443984] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T18:57:46.743969] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T18:57:47.196698] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-09T18:57:47.777809] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:57:47.996769] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-09T18:57:48.599504] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T18:57:48.796675] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-09T18:57:48.851481] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T18:57:49.596749] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-09T18:57:50.396739] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-09T18:57:50.518006] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T18:57:50.597687] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T18:57:51.196716] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-09T18:57:51.768922] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T18:57:51.996711] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-09T18:57:52.594282] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T18:57:52.796745] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-09T18:57:53.596777] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-09T18:57:53.704412] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T18:57:53.982099] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T18:57:54.396765] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-09T18:57:55.196713] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-09T18:57:55.336454] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T18:57:55.996714] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-09T18:57:56.796773] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-09T18:57:56.868893] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-09T18:57:57.539569] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-09T18:57:57.560071] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T18:57:57.565550] [INFO ] [REMOTE ] FLG: Full fetch complete (77284 records). [2025-10-09T18:57:57.565725] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-09T18:57:57.601818] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-09T18:57:57.967831] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-09T18:57:57.968071] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-09T18:57:57.969218] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-09T18:57:57.969439] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-09T18:57:57.971213] [DEBUG] [LOCAL ] FLG: Trimmed 77284 records to 53704 (keeping 200 days of data) [2025-10-09T18:57:58.182866] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T18:57:58.342188] [DEBUG] [LOCAL ] FLG: Primary data saved (53704 records). [2025-10-09T18:57:58.342327] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-09T18:57:58.342429] [INFO ] [MAIN ] Update Progress: 843/2373 symbols completed. FLG took 33.3s. Estimated remaining: 3h 34m 0s. Rate: 7.1 symbols/min [2025-10-09T18:57:58.404517] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-09T18:57:58.511126] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:58.511323] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-09T18:57:58.511459] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-09T18:57:58.511578] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-09T18:57:58.511620] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-09T18:57:58.511704] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-09T18:57:58.511760] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-09T18:57:58.862674] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:57:59.196229] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T18:57:59.204164] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-09T18:57:59.422850] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T18:57:59.423151] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-09T18:57:59.423254] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T18:57:59.423324] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-09T18:57:59.423390] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T18:57:59.423460] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-09T18:57:59.423539] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-09T18:57:59.423594] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-09T18:57:59.423673] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-09T18:57:59.423756] [INFO ] [MAIN ] Update Progress: 844/2373 symbols completed. FLOC took 1.1s. Estimated remaining: 3h 33m 39s. Rate: 7.2 symbols/min [2025-10-09T18:57:59.589334] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:57:59.637574] [DEBUG] [LOCAL ] FLR: Loaded 53168 existing records from primary storage. [2025-10-09T18:57:59.637975] [INFO ] [MAIN ] FLR: Loaded 53168 existing records. [2025-10-09T18:57:59.814047] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:57:59.814269] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-09T18:57:59.814315] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-09T18:57:59.814529] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-09T18:57:59.814585] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-09T18:57:59.996802] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-09T18:58:00.184359] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:00.228529] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T18:58:00.796749] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-09T18:58:01.596732] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-09T18:58:01.662381] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T18:58:02.216395] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T18:58:02.396707] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-09T18:58:02.758368] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T18:58:03.196715] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-09T18:58:03.838536] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T18:58:03.996721] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-09T18:58:04.233852] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T18:58:04.236633] [INFO ] [REMOTE ] FLNG: Full fetch complete (50273 records). [2025-10-09T18:58:04.236754] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-09T18:58:04.622936] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-09T18:58:04.623039] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-09T18:58:04.623817] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-09T18:58:04.623881] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-09T18:58:04.624949] [DEBUG] [LOCAL ] FLNG: Trimmed 50273 records to 33806 (keeping 200 days of data) [2025-10-09T18:58:04.812461] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-09T18:58:04.839239] [DEBUG] [LOCAL ] FLNG: Primary data saved (33806 records). [2025-10-09T18:58:04.839379] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-09T18:58:04.839505] [INFO ] [MAIN ] Update Progress: 845/2373 symbols completed. FLNG took 37.0s. Estimated remaining: 3h 33m 25s. Rate: 7.2 symbols/min [2025-10-09T18:58:05.008251] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:05.057672] [DEBUG] [LOCAL ] FLS: Loaded 50253 existing records from primary storage. [2025-10-09T18:58:05.058060] [INFO ] [MAIN ] FLS: Loaded 50253 existing records. [2025-10-09T18:58:05.243194] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:05.243401] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-09T18:58:05.243449] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-09T18:58:05.243712] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-09T18:58:05.243778] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-09T18:58:05.598705] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-09T18:58:05.711788] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:05.730563] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-09T18:58:06.396700] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-09T18:58:06.580694] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T18:58:06.940378] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T18:58:06.943197] [INFO ] [REMOTE ] FIX: Full fetch complete (45265 records). [2025-10-09T18:58:06.943296] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-09T18:58:07.201957] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-09T18:58:07.326207] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-09T18:58:07.326307] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-09T18:58:07.327091] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-09T18:58:07.327153] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-09T18:58:07.328278] [DEBUG] [LOCAL ] FIX: Trimmed 45265 records to 29455 (keeping 200 days of data) [2025-10-09T18:58:07.523614] [DEBUG] [LOCAL ] FIX: Primary data saved (29455 records). [2025-10-09T18:58:07.523774] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-09T18:58:07.523872] [INFO ] [MAIN ] Update Progress: 846/2373 symbols completed. FIX took 42.5s. Estimated remaining: 3h 33m 6s. Rate: 7.2 symbols/min [2025-10-09T18:58:07.691668] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:07.739334] [DEBUG] [LOCAL ] FLUT: Loaded 50781 existing records from primary storage. [2025-10-09T18:58:07.739634] [INFO ] [MAIN ] FLUT: Loaded 50781 existing records. [2025-10-09T18:58:07.921609] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:07.921863] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-09T18:58:07.921908] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-09T18:58:07.922148] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-09T18:58:07.922205] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-09T18:58:08.018963] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-09T18:58:08.307729] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:08.309812] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T18:58:08.499946] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T18:58:08.796722] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-09T18:58:09.596694] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-09T18:58:09.694136] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T18:58:10.396787] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-09T18:58:10.466316] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T18:58:10.741462] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-09T18:58:11.196686] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-09T18:58:11.996794] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-09T18:58:12.058147] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T18:58:12.796703] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-09T18:58:12.914338] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T18:58:13.405816] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T18:58:13.596784] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-09T18:58:14.396696] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-09T18:58:14.521038] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T18:58:15.196696] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-09T18:58:15.396661] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T18:58:15.996711] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-09T18:58:16.179838] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T18:58:16.450002] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T18:58:16.796708] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-09T18:58:17.596743] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-09T18:58:17.734795] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T18:58:17.739196] [INFO ] [REMOTE ] FLO: Full fetch complete (75070 records). [2025-10-09T18:58:17.739305] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-09T18:58:18.133324] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-09T18:58:18.133498] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-09T18:58:18.134532] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-09T18:58:18.134615] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-09T18:58:18.136218] [DEBUG] [LOCAL ] FLO: Trimmed 75070 records to 52335 (keeping 200 days of data) [2025-10-09T18:58:18.262692] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T18:58:18.397430] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-09T18:58:18.502856] [DEBUG] [LOCAL ] FLO: Primary data saved (52335 records). [2025-10-09T18:58:18.502993] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-09T18:58:18.503099] [INFO ] [MAIN ] Update Progress: 847/2373 symbols completed. FLO took 41.3s. Estimated remaining: 3h 33m 3s. Rate: 7.2 symbols/min [2025-10-09T18:58:18.668249] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:18.689252] [DEBUG] [LOCAL ] FLXR: Loaded 20757 existing records from primary storage. [2025-10-09T18:58:18.689482] [INFO ] [MAIN ] FLXR: Loaded 20757 existing records. [2025-10-09T18:58:18.864615] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:18.864815] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-09T18:58:18.864862] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-09T18:58:18.865071] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-09T18:58:18.865127] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-09T18:58:19.205851] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-09T18:58:19.245442] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:19.278521] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T18:58:19.996816] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-09T18:58:20.357972] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-09T18:58:20.736207] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T18:58:20.796708] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-09T18:58:20.860698] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:58:21.530498] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T18:58:21.596738] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-09T18:58:22.396745] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-09T18:58:22.397148] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T18:58:23.196753] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-09T18:58:23.982388] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T18:58:23.996669] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-09T18:58:24.679152] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T18:58:24.796711] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-09T18:58:25.596773] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-09T18:58:25.779996] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T18:58:26.289602] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T18:58:26.396674] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-09T18:58:26.921326] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T18:58:27.196756] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-09T18:58:27.962391] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T18:58:27.996707] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-09T18:58:28.796716] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-09T18:58:28.981717] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T18:58:29.498111] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T18:58:29.502505] [INFO ] [REMOTE ] FLR: Full fetch complete (76480 records). [2025-10-09T18:58:29.502598] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-09T18:58:29.598016] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-09T18:58:29.851448] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T18:58:29.930462] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-09T18:58:29.930538] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-09T18:58:29.931464] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-09T18:58:29.931528] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-09T18:58:29.932938] [DEBUG] [LOCAL ] FLR: Trimmed 76480 records to 53555 (keeping 200 days of data) [2025-10-09T18:58:30.252795] [DEBUG] [LOCAL ] FLR: Primary data saved (53555 records). [2025-10-09T18:58:30.252963] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-09T18:58:30.253075] [INFO ] [MAIN ] Update Progress: 848/2373 symbols completed. FLR took 30.8s. Estimated remaining: 3h 33m 0s. Rate: 7.2 symbols/min [2025-10-09T18:58:30.402544] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-09T18:58:30.429527] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:30.475994] [DEBUG] [LOCAL ] FMC: Loaded 51801 existing records from primary storage. [2025-10-09T18:58:30.476300] [INFO ] [MAIN ] FMC: Loaded 51801 existing records. [2025-10-09T18:58:30.660211] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:30.660415] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-09T18:58:30.660464] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-09T18:58:30.660735] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-09T18:58:30.660793] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-09T18:58:31.029902] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:31.041338] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T18:58:31.196682] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-09T18:58:31.325861] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T18:58:31.996733] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-09T18:58:32.796758] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-09T18:58:32.824094] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T18:58:32.908419] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T18:58:33.596747] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-09T18:58:34.133056] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T18:58:34.396691] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-09T18:58:34.641192] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T18:58:35.196746] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-09T18:58:35.996789] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-09T18:58:36.045489] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T18:58:36.796686] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-09T18:58:36.934256] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T18:58:37.581371] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T18:58:37.596699] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-09T18:58:38.023330] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T18:58:38.396700] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-09T18:58:39.028967] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T18:58:39.033362] [INFO ] [REMOTE ] FLS: Full fetch complete (71860 records). [2025-10-09T18:58:39.033497] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-09T18:58:39.206711] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-09T18:58:39.429812] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-09T18:58:39.429899] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-09T18:58:39.430876] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-09T18:58:39.430942] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-09T18:58:39.432309] [DEBUG] [LOCAL ] FLS: Trimmed 71860 records to 50642 (keeping 200 days of data) [2025-10-09T18:58:39.754146] [DEBUG] [LOCAL ] FLS: Primary data saved (50642 records). [2025-10-09T18:58:39.754285] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-09T18:58:39.754996] [INFO ] [MAIN ] Update Progress: 849/2373 symbols completed. FLS took 34.9s. Estimated remaining: 3h 32m 54s. Rate: 7.2 symbols/min [2025-10-09T18:58:39.932704] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:39.941781] [DEBUG] [LOCAL ] FMN: Loaded 5285 existing records from primary storage. [2025-10-09T18:58:39.942076] [INFO ] [MAIN ] FMN: Loaded 5285 existing records. [2025-10-09T18:58:40.002479] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-09T18:58:40.148981] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:40.149295] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-09T18:58:40.149491] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-09T18:58:40.149795] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-09T18:58:40.149938] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-09T18:58:40.461769] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-09T18:58:40.549385] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:40.796746] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-09T18:58:41.080538] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T18:58:41.135236] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T18:58:41.280317] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-09T18:58:41.596702] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-09T18:58:42.381635] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T18:58:42.396664] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-09T18:58:43.120590] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T18:58:43.196715] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-09T18:58:43.996780] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-09T18:58:44.796758] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-09T18:58:44.867578] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T18:58:45.032976] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T18:58:45.463925] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T18:58:45.596719] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-09T18:58:46.396741] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-09T18:58:47.187732] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T18:58:47.196672] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-09T18:58:47.646276] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T18:58:47.681860] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T18:58:47.996704] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-09T18:58:48.582379] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T18:58:48.796703] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-09T18:58:49.596741] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-09T18:58:49.909820] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-09T18:58:50.396727] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-09T18:58:51.072428] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T18:58:51.143516] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T18:58:51.196676] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-09T18:58:51.996713] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-09T18:58:52.796735] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-09T18:58:52.947504] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T18:58:53.085784] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T18:58:53.088320] [INFO ] [REMOTE ] FLXR: Full fetch complete (26320 records). [2025-10-09T18:58:53.088390] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-09T18:58:53.449938] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-09T18:58:53.450016] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-09T18:58:53.450567] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-09T18:58:53.450618] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-09T18:58:53.451507] [DEBUG] [LOCAL ] FLXR: Trimmed 26320 records to 20932 (keeping 200 days of data) [2025-10-09T18:58:53.577197] [DEBUG] [LOCAL ] FLXR: Primary data saved (20932 records). [2025-10-09T18:58:53.577321] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-09T18:58:53.577398] [INFO ] [MAIN ] Update Progress: 850/2373 symbols completed. FLXR took 35.1s. Estimated remaining: 3h 32m 55s. Rate: 7.2 symbols/min [2025-10-09T18:58:53.606800] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-09T18:58:53.760319] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:53.793613] [DEBUG] [LOCAL ] FMS: Loaded 29995 existing records from primary storage. [2025-10-09T18:58:53.793956] [INFO ] [MAIN ] FMS: Loaded 29995 existing records. [2025-10-09T18:58:53.985871] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:53.986143] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-09T18:58:53.986220] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-09T18:58:53.986498] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-09T18:58:53.986557] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-09T18:58:54.354830] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T18:58:54.383600] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:54.396674] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-09T18:58:54.493183] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T18:58:54.499104] [INFO ] [REMOTE ] FLUT: Full fetch complete (73033 records). [2025-10-09T18:58:54.499251] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-09T18:58:54.882447] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-09T18:58:54.882540] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-09T18:58:54.883553] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-09T18:58:54.883625] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-09T18:58:54.885343] [DEBUG] [LOCAL ] FLUT: Trimmed 73033 records to 51157 (keeping 200 days of data) [2025-10-09T18:58:55.196806] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-09T18:58:55.208545] [DEBUG] [LOCAL ] FLUT: Primary data saved (51157 records). [2025-10-09T18:58:55.208749] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-09T18:58:55.209977] [INFO ] [MAIN ] Update Progress: 851/2373 symbols completed. FLUT took 47.7s. Estimated remaining: 3h 32m 35s. Rate: 7.2 symbols/min [2025-10-09T18:58:55.377563] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:55.418296] [DEBUG] [LOCAL ] FMX: Loaded 40585 existing records from primary storage. [2025-10-09T18:58:55.418593] [INFO ] [MAIN ] FMX: Loaded 40585 existing records. [2025-10-09T18:58:55.604183] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:55.619878] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-09T18:58:55.620380] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-09T18:58:55.620584] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-09T18:58:55.626822] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-09T18:58:55.626881] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-09T18:58:55.808534] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T18:58:55.988322] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:55.996665] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-09T18:58:56.796718] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-09T18:58:57.420173] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-09T18:58:57.431763] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T18:58:57.432911] [INFO ] [REMOTE ] FMN: Full fetch complete (9994 records). [2025-10-09T18:58:57.432981] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-09T18:58:57.602272] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-09T18:58:57.792262] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-09T18:58:57.792354] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-09T18:58:57.792696] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-09T18:58:57.792761] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-09T18:58:57.793414] [DEBUG] [LOCAL ] FMN: Trimmed 9994 records to 5363 (keeping 200 days of data) [2025-10-09T18:58:57.830925] [DEBUG] [LOCAL ] FMN: Primary data saved (5363 records). [2025-10-09T18:58:57.831076] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-09T18:58:57.831165] [INFO ] [MAIN ] Update Progress: 852/2373 symbols completed. FMN took 18.1s. Estimated remaining: 3h 32m 16s. Rate: 7.2 symbols/min [2025-10-09T18:58:57.995133] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:58:57.999296] [DEBUG] [LOCAL ] FMY: Loaded 1384 existing records from primary storage. [2025-10-09T18:58:57.999450] [INFO ] [MAIN ] FMY: Loaded 1384 existing records. [2025-10-09T18:58:58.170935] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:58:58.171159] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-09T18:58:58.171206] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-09T18:58:58.171525] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-09T18:58:58.171583] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-09T18:58:58.406020] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-09T18:58:58.523160] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:58:58.917461] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T18:58:59.196749] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-09T18:58:59.557266] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-09T18:58:59.996741] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-09T18:59:00.124276] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T18:59:00.356999] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-09T18:59:00.796735] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-09T18:59:01.596733] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-09T18:59:02.262040] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T18:59:02.396716] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-09T18:59:03.070036] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T18:59:03.196686] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-09T18:59:03.884355] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T18:59:03.996709] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-09T18:59:04.796686] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-09T18:59:04.913083] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T18:59:05.117297] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-09T18:59:05.120197] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T18:59:05.596728] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-09T18:59:06.396715] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-09T18:59:06.709525] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-09T18:59:06.761273] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T18:59:07.196749] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-09T18:59:07.645593] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T18:59:07.996726] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-09T18:59:08.345753] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-09T18:59:08.796704] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-09T18:59:09.596764] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-09T18:59:10.158110] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T18:59:10.396706] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-09T18:59:11.196687] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-09T18:59:11.237517] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T18:59:11.449031] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T18:59:11.511896] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T18:59:11.996717] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-09T18:59:12.796725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-09T18:59:13.183807] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-09T18:59:13.529077] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T18:59:13.596683] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-09T18:59:14.396710] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-09T18:59:15.196724] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-09T18:59:15.370333] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T18:59:15.901137] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T18:59:15.996676] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-09T18:59:16.488056] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T18:59:16.796725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-09T18:59:17.249100] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T18:59:17.535768] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T18:59:17.596695] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-09T18:59:17.954113] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T18:59:18.396702] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-09T18:59:18.833902] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T18:59:18.834562] [INFO ] [REMOTE ] FMY: Full fetch complete (1968 records). [2025-10-09T18:59:18.834629] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-09T18:59:19.186154] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-09T18:59:19.186232] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-09T18:59:19.186325] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-09T18:59:19.186363] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-09T18:59:19.186711] [DEBUG] [LOCAL ] FMY: Trimmed 1968 records to 1393 (keeping 200 days of data) [2025-10-09T18:59:19.195878] [DEBUG] [LOCAL ] FMY: Primary data saved (1393 records). [2025-10-09T18:59:19.195944] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-09T18:59:19.196011] [INFO ] [MAIN ] Update Progress: 853/2373 symbols completed. FMY took 21.4s. Estimated remaining: 3h 32m 31s. Rate: 7.2 symbols/min [2025-10-09T18:59:19.206626] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-09T18:59:19.370741] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:19.416678] [DEBUG] [LOCAL ] FN: Loaded 38138 existing records from primary storage. [2025-10-09T18:59:19.417005] [INFO ] [MAIN ] FN: Loaded 38138 existing records. [2025-10-09T18:59:19.595355] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:19.595608] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-09T18:59:19.595686] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-09T18:59:19.596010] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-09T18:59:19.596074] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-09T18:59:19.955762] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:19.996756] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-09T18:59:20.642823] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T18:59:20.796731] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-09T18:59:21.596737] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-09T18:59:21.813681] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T18:59:21.830488] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T18:59:21.835219] [INFO ] [REMOTE ] FMC: Full fetch complete (75143 records). [2025-10-09T18:59:21.835335] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-09T18:59:22.226779] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-09T18:59:22.226867] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-09T18:59:22.227801] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-09T18:59:22.227869] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-09T18:59:22.229295] [DEBUG] [LOCAL ] FMC: Trimmed 75143 records to 52191 (keeping 200 days of data) [2025-10-09T18:59:22.420460] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-09T18:59:22.573570] [DEBUG] [LOCAL ] FMC: Primary data saved (52191 records). [2025-10-09T18:59:22.573743] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-09T18:59:22.573834] [INFO ] [MAIN ] Update Progress: 854/2373 symbols completed. FMC took 52.3s. Estimated remaining: 3h 32m 14s. Rate: 7.2 symbols/min [2025-10-09T18:59:22.755467] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:22.776439] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T18:59:22.832558] [DEBUG] [LOCAL ] FNB: Loaded 52530 existing records from primary storage. [2025-10-09T18:59:22.832953] [INFO ] [MAIN ] FNB: Loaded 52530 existing records. [2025-10-09T18:59:23.017489] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:23.017761] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-09T18:59:23.017858] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-09T18:59:23.018724] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-09T18:59:23.018785] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-09T18:59:23.209468] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-09T18:59:23.383058] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:23.714436] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T18:59:23.996718] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-09T18:59:24.579139] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T18:59:24.796781] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-09T18:59:25.385779] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T18:59:25.596706] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-09T18:59:26.191794] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T18:59:26.396762] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-09T18:59:26.864864] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T18:59:26.868747] [INFO ] [REMOTE ] FMS: Full fetch complete (42409 records). [2025-10-09T18:59:26.868941] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-09T18:59:27.205070] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-09T18:59:27.246801] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-09T18:59:27.246883] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-09T18:59:27.247544] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-09T18:59:27.247585] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-09T18:59:27.250321] [DEBUG] [LOCAL ] FMS: Trimmed 42409 records to 30246 (keeping 200 days of data) [2025-10-09T18:59:27.449769] [DEBUG] [LOCAL ] FMS: Primary data saved (30246 records). [2025-10-09T18:59:27.449966] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-09T18:59:27.450070] [INFO ] [MAIN ] Update Progress: 855/2373 symbols completed. FMS took 33.9s. Estimated remaining: 3h 31m 59s. Rate: 7.2 symbols/min [2025-10-09T18:59:27.658762] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:27.713916] [DEBUG] [LOCAL ] FND: Loaded 52108 existing records from primary storage. [2025-10-09T18:59:27.714243] [INFO ] [MAIN ] FND: Loaded 52108 existing records. [2025-10-09T18:59:27.934145] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:27.934423] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-09T18:59:27.934586] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-09T18:59:27.935052] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-09T18:59:27.935140] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-09T18:59:28.012017] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-09T18:59:28.048184] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:59:28.323211] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:28.796697] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-09T18:59:28.848485] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T18:59:29.596717] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-09T18:59:29.730838] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T18:59:30.394202] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T18:59:30.405035] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-09T18:59:31.196696] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-09T18:59:31.336772] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T18:59:31.983187] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T18:59:31.996665] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-09T18:59:32.796681] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-09T18:59:32.890227] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T18:59:33.237534] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T18:59:33.240735] [INFO ] [REMOTE ] FMX: Full fetch complete (57518 records). [2025-10-09T18:59:33.240822] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-09T18:59:33.598499] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-09T18:59:33.618316] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-09T18:59:33.618425] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-09T18:59:33.619262] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-09T18:59:33.619331] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-09T18:59:33.620767] [DEBUG] [LOCAL ] FMX: Trimmed 57518 records to 40806 (keeping 200 days of data) [2025-10-09T18:59:33.874684] [DEBUG] [LOCAL ] FMX: Primary data saved (40806 records). [2025-10-09T18:59:33.874896] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-09T18:59:33.875005] [INFO ] [MAIN ] Update Progress: 856/2373 symbols completed. FMX took 38.7s. Estimated remaining: 3h 31m 47s. Rate: 7.2 symbols/min [2025-10-09T18:59:34.085084] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:34.115721] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T18:59:34.169517] [DEBUG] [LOCAL ] FNF: Loaded 48933 existing records from primary storage. [2025-10-09T18:59:34.169875] [INFO ] [MAIN ] FNF: Loaded 48933 existing records. [2025-10-09T18:59:34.345898] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:34.346132] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-09T18:59:34.346178] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-09T18:59:34.347733] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-09T18:59:34.347814] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-09T18:59:34.401912] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-09T18:59:34.697260] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:35.196682] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-09T18:59:35.305281] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-09T18:59:35.834627] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T18:59:35.996698] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-09T18:59:36.682903] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T18:59:36.796704] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-09T18:59:37.596690] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-09T18:59:37.653948] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T18:59:37.815437] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T18:59:38.396725] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-09T18:59:39.163109] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T18:59:39.196697] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-09T18:59:39.996687] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-09T18:59:40.118124] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T18:59:40.703541] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T18:59:40.796728] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-09T18:59:41.315430] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T18:59:41.596787] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-09T18:59:42.397079] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-09T18:59:42.402028] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T18:59:43.108680] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T18:59:43.196683] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-09T18:59:43.762479] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T18:59:43.996715] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-09T18:59:44.782906] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T18:59:44.796665] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-09T18:59:45.596799] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-09T18:59:45.647915] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T18:59:46.396697] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-09T18:59:46.442989] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T18:59:46.972452] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T18:59:47.196715] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-09T18:59:47.479616] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T18:59:47.996714] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-09T18:59:48.796770] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-09T18:59:48.955663] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T18:59:49.596832] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-09T18:59:49.736572] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T18:59:50.215747] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T18:59:50.396745] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-09T18:59:50.729566] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T18:59:50.732277] [INFO ] [REMOTE ] FN: Full fetch complete (56009 records). [2025-10-09T18:59:50.732366] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-09T18:59:51.118332] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-09T18:59:51.118402] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-09T18:59:51.119183] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-09T18:59:51.119247] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-09T18:59:51.120328] [DEBUG] [LOCAL ] FN: Trimmed 56009 records to 38337 (keeping 200 days of data) [2025-10-09T18:59:51.214495] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-09T18:59:51.364680] [DEBUG] [LOCAL ] FN: Primary data saved (38337 records). [2025-10-09T18:59:51.364841] [INFO ] [MAIN ] FN: Full history saved. [2025-10-09T18:59:51.365479] [INFO ] [MAIN ] Update Progress: 857/2373 symbols completed. FN took 32.2s. Estimated remaining: 3h 31m 55s. Rate: 7.2 symbols/min [2025-10-09T18:59:51.534965] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:51.582606] [DEBUG] [LOCAL ] FNV: Loaded 46166 existing records from primary storage. [2025-10-09T18:59:51.582955] [INFO ] [MAIN ] FNV: Loaded 46166 existing records. [2025-10-09T18:59:51.758411] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:51.758953] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-09T18:59:51.759106] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-09T18:59:51.760820] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-09T18:59:51.760882] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-09T18:59:52.002662] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-09T18:59:52.121038] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:52.149591] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T18:59:52.315303] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T18:59:52.796710] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-09T18:59:53.421291] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T18:59:53.596761] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-09T18:59:54.396674] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-09T18:59:54.512014] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T18:59:55.140571] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T18:59:55.196667] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-09T18:59:55.996731] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-09T18:59:56.121061] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T18:59:56.802573] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-09T18:59:56.814304] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-09T18:59:57.335348] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T18:59:57.596733] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-09T18:59:58.149080] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T18:59:58.153518] [INFO ] [REMOTE ] FNB: Full fetch complete (75888 records). [2025-10-09T18:59:58.153625] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-09T18:59:58.404924] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-09T18:59:58.538305] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-09T18:59:58.538389] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-09T18:59:58.539350] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-09T18:59:58.539416] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-09T18:59:58.540925] [DEBUG] [LOCAL ] FNB: Trimmed 75888 records to 52919 (keeping 200 days of data) [2025-10-09T18:59:58.875725] [DEBUG] [LOCAL ] FNB: Primary data saved (52919 records). [2025-10-09T18:59:58.875884] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-09T18:59:58.875979] [INFO ] [MAIN ] Update Progress: 858/2373 symbols completed. FNB took 36.3s. Estimated remaining: 3h 31m 45s. Rate: 7.2 symbols/min [2025-10-09T18:59:59.043326] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T18:59:59.056883] [DEBUG] [LOCAL ] FOA: Loaded 13062 existing records from primary storage. [2025-10-09T18:59:59.057090] [INFO ] [MAIN ] FOA: Loaded 13062 existing records. [2025-10-09T18:59:59.197579] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-09T18:59:59.237967] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T18:59:59.238462] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-09T18:59:59.238573] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-09T18:59:59.239308] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-09T18:59:59.239374] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-09T18:59:59.602137] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T18:59:59.631911] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-09T18:59:59.923766] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-09T18:59:59.996675] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-09T19:00:00.790593] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T19:00:00.801748] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-09T19:00:01.596713] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-09T19:00:01.729775] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T19:00:02.015769] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T19:00:02.396730] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-09T19:00:03.196730] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-09T19:00:03.468230] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T19:00:03.996942] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-09T19:00:04.153475] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T19:00:04.796987] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-09T19:00:05.026590] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:00:05.096080] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:00:05.596730] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-09T19:00:06.396755] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-09T19:00:06.508459] [DEBUG] [REMOTE ] FOA: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-09T19:00:06.508830] [WARN ] [REMOTE ] FOA: No data returned for month 2025-02 [2025-10-09T19:00:06.508938] [FATAL] [REMOTE ] FOA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:00:06.509035] [FATAL] [MAIN ] FOA: Failed to fetch primary data. [2025-10-09T19:00:06.509101] [WARN ] [MAIN ] FOA: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:00:06.509174] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-09T19:00:06.509253] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-10-09T19:00:06.509310] [INFO ] [LOCAL ] FOA: Starting deletion of derivative data. [2025-10-09T19:00:06.509625] [DEBUG] [LOCAL ] FOA: Deleted derivative data file. [2025-10-09T19:00:06.509755] [INFO ] [MAIN ] Update Progress: 859/2373 symbols completed. FOA took 7.6s. Estimated remaining: 3h 31m 35s. Rate: 7.2 symbols/min [2025-10-09T19:00:06.697501] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:06.710006] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-09T19:00:06.715098] [INFO ] [REMOTE ] FND: Full fetch complete (74734 records). [2025-10-09T19:00:06.715273] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-09T19:00:06.806460] [DEBUG] [LOCAL ] FOF: Loaded 8522 existing records from primary storage. [2025-10-09T19:00:06.823591] [INFO ] [MAIN ] FOF: Loaded 8522 existing records. [2025-10-09T19:00:07.207108] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-09T19:00:07.212588] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-09T19:00:07.258789] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:07.259124] [INFO ] [REMOTE ] FNF: Full fetch complete (69711 records). [2025-10-09T19:00:07.259330] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-09T19:00:07.265057] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-09T19:00:07.265391] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-09T19:00:07.300206] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-09T19:00:07.329706] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-09T19:00:07.469111] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-09T19:00:07.523593] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-09T19:00:07.567080] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-09T19:00:07.592138] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-09T19:00:07.863047] [DEBUG] [LOCAL ] FND: Trimmed 74734 records to 52495 (keeping 200 days of data) [2025-10-09T19:00:08.147230] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:08.166327] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-09T19:00:08.241008] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-09T19:00:08.241340] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-09T19:00:08.242247] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-09T19:00:08.242329] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-09T19:00:08.245629] [DEBUG] [LOCAL ] FNF: Trimmed 69711 records to 49306 (keeping 200 days of data) [2025-10-09T19:00:08.802249] [DEBUG] [LOCAL ] FND: Primary data saved (52495 records). [2025-10-09T19:00:08.803018] [INFO ] [MAIN ] FND: Full history saved. [2025-10-09T19:00:08.803379] [INFO ] [MAIN ] Update Progress: 860/2373 symbols completed. FND took 41.4s. Estimated remaining: 3h 31m 16s. Rate: 7.2 symbols/min [2025-10-09T19:00:08.921554] [DEBUG] [LOCAL ] FNF: Primary data saved (49306 records). [2025-10-09T19:00:08.932574] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-09T19:00:08.956870] [INFO ] [MAIN ] Update Progress: 861/2373 symbols completed. FNF took 35.1s. Estimated remaining: 3h 30m 53s. Rate: 7.2 symbols/min [2025-10-09T19:00:09.038180] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:09.092980] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-09T19:00:09.117538] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-09T19:00:09.229976] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:09.237135] [DEBUG] [LOCAL ] FOR: Loaded 19696 existing records from primary storage. [2025-10-09T19:00:09.237519] [INFO ] [MAIN ] FOR: Loaded 19696 existing records. [2025-10-09T19:00:09.426294] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:09.426832] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-09T19:00:09.426935] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-09T19:00:09.437619] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-09T19:00:09.451497] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-09T19:00:09.535939] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-09T19:00:09.598594] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-09T19:00:09.629025] [DEBUG] [LOCAL ] FOUR: Loaded 49586 existing records from primary storage. [2025-10-09T19:00:09.640003] [INFO ] [MAIN ] FOUR: Loaded 49586 existing records. [2025-10-09T19:00:09.781956] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-09T19:00:10.122453] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:10.128614] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:10.129294] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-09T19:00:10.129355] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-09T19:00:10.130733] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-09T19:00:10.130795] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-09T19:00:10.404300] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-09T19:00:10.487753] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:11.196697] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-09T19:00:11.296285] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T19:00:11.411191] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T19:00:11.990600] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T19:00:11.996674] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-09T19:00:12.796714] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-09T19:00:13.031340] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T19:00:13.596743] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-09T19:00:13.812336] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:00:14.396772] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-09T19:00:15.196700] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-09T19:00:15.237827] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-09T19:00:15.473406] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T19:00:15.996693] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-09T19:00:16.082550] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T19:00:16.796762] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-09T19:00:17.604112] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-09T19:00:17.622491] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:00:17.662705] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T19:00:18.396811] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-09T19:00:19.196697] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-09T19:00:19.348767] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T19:00:19.637420] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-09T19:00:19.912778] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T19:00:19.996685] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-09T19:00:20.706598] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:00:20.796726] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-09T19:00:21.500635] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T19:00:21.596714] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-09T19:00:22.241830] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T19:00:22.396748] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-09T19:00:23.165354] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T19:00:23.196790] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-09T19:00:23.996718] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-09T19:00:24.654094] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T19:00:24.745536] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T19:00:24.796693] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-09T19:00:25.596764] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-09T19:00:25.685793] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T19:00:25.687075] [INFO ] [REMOTE ] FOF: Full fetch complete (11891 records). [2025-10-09T19:00:25.687149] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-09T19:00:26.047502] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-09T19:00:26.047581] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-09T19:00:26.047929] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-09T19:00:26.047991] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-09T19:00:26.048448] [DEBUG] [LOCAL ] FOF: Trimmed 11891 records to 8601 (keeping 200 days of data) [2025-10-09T19:00:26.102850] [DEBUG] [LOCAL ] FOF: Primary data saved (8601 records). [2025-10-09T19:00:26.102981] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-09T19:00:26.103064] [INFO ] [MAIN ] Update Progress: 862/2373 symbols completed. FOF took 19.6s. Estimated remaining: 3h 31m 0s. Rate: 7.2 symbols/min [2025-10-09T19:00:26.275578] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:26.295849] [DEBUG] [LOCAL ] FPF: Loaded 18595 existing records from primary storage. [2025-10-09T19:00:26.296113] [INFO ] [MAIN ] FPF: Loaded 18595 existing records. [2025-10-09T19:00:26.399847] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-09T19:00:26.479490] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:26.479710] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-09T19:00:26.479767] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-09T19:00:26.480527] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-09T19:00:26.480587] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-09T19:00:26.791056] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T19:00:26.851702] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:27.196744] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-09T19:00:27.996770] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-09T19:00:28.080721] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T19:00:28.183105] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T19:00:28.759808] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T19:00:28.796673] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-09T19:00:29.596726] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-09T19:00:29.891490] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T19:00:30.396694] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-09T19:00:31.196725] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-09T19:00:31.362035] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-09T19:00:31.414468] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:00:31.996715] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-09T19:00:32.796735] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-09T19:00:32.891484] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T19:00:33.363009] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T19:00:33.596709] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-09T19:00:33.714982] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T19:00:34.396763] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-09T19:00:34.557040] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T19:00:35.196726] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-09T19:00:35.996840] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-09T19:00:36.131438] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-09T19:00:36.156748] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T19:00:36.796715] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-09T19:00:37.596726] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-09T19:00:37.628878] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:00:37.634181] [INFO ] [REMOTE ] FNV: Full fetch complete (66553 records). [2025-10-09T19:00:37.634402] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-09T19:00:38.025375] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-09T19:00:38.025549] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-09T19:00:38.026700] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-09T19:00:38.026784] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-09T19:00:38.028315] [DEBUG] [LOCAL ] FNV: Trimmed 66553 records to 46540 (keeping 200 days of data) [2025-10-09T19:00:38.279473] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T19:00:38.371724] [DEBUG] [LOCAL ] FNV: Primary data saved (46540 records). [2025-10-09T19:00:38.371875] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-09T19:00:38.372602] [INFO ] [MAIN ] Update Progress: 863/2373 symbols completed. FNV took 47.0s. Estimated remaining: 3h 30m 59s. Rate: 7.2 symbols/min [2025-10-09T19:00:38.401960] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-09T19:00:38.487202] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-09T19:00:38.562725] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:38.582778] [DEBUG] [LOCAL ] FPH: Loaded 19300 existing records from primary storage. [2025-10-09T19:00:38.583044] [INFO ] [MAIN ] FPH: Loaded 19300 existing records. [2025-10-09T19:00:38.756820] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:38.757062] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-09T19:00:38.757109] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-09T19:00:38.757927] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-09T19:00:38.757986] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-09T19:00:39.114510] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:39.196730] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-09T19:00:39.656745] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:00:39.996715] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-09T19:00:40.252356] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T19:00:40.796718] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-09T19:00:40.987395] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T19:00:41.596760] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-09T19:00:42.370668] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T19:00:42.402142] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-09T19:00:42.408772] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T19:00:43.196720] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-09T19:00:43.974607] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:00:43.996682] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-09T19:00:44.059851] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T19:00:44.796739] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-09T19:00:45.596716] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-09T19:00:45.695575] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T19:00:45.698192] [INFO ] [REMOTE ] FOR: Full fetch complete (29831 records). [2025-10-09T19:00:45.698331] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-09T19:00:46.100314] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-09T19:00:46.100952] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-09T19:00:46.102530] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-09T19:00:46.103573] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-09T19:00:46.114175] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-09T19:00:46.116001] [DEBUG] [LOCAL ] FOR: Trimmed 29831 records to 19850 (keeping 200 days of data) [2025-10-09T19:00:46.235077] [DEBUG] [LOCAL ] FOR: Primary data saved (19850 records). [2025-10-09T19:00:46.235232] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-09T19:00:46.235320] [INFO ] [MAIN ] Update Progress: 864/2373 symbols completed. FOR took 37.4s. Estimated remaining: 3h 30m 50s. Rate: 7.2 symbols/min [2025-10-09T19:00:46.404383] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-09T19:00:46.424506] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:46.456488] [DEBUG] [LOCAL ] FPI: Loaded 31074 existing records from primary storage. [2025-10-09T19:00:46.456847] [INFO ] [MAIN ] FPI: Loaded 31074 existing records. [2025-10-09T19:00:46.649924] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:46.651933] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-09T19:00:46.652005] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-09T19:00:46.653179] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T19:00:46.653240] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-09T19:00:46.659502] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-09T19:00:47.011020] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:47.196728] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-09T19:00:47.715593] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T19:00:47.720014] [INFO ] [REMOTE ] FOUR: Full fetch complete (72030 records). [2025-10-09T19:00:47.720136] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-09T19:00:48.005591] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-09T19:00:48.120030] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-09T19:00:48.120111] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-09T19:00:48.121114] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-09T19:00:48.121182] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-09T19:00:48.123250] [DEBUG] [LOCAL ] FOUR: Trimmed 72030 records to 49959 (keeping 200 days of data) [2025-10-09T19:00:48.354559] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T19:00:48.457218] [DEBUG] [LOCAL ] FOUR: Primary data saved (49959 records). [2025-10-09T19:00:48.457360] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-09T19:00:48.457510] [INFO ] [MAIN ] Update Progress: 865/2373 symbols completed. FOUR took 39.5s. Estimated remaining: 3h 30m 30s. Rate: 7.2 symbols/min [2025-10-09T19:00:48.643283] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:48.685014] [DEBUG] [LOCAL ] FR: Loaded 46358 existing records from primary storage. [2025-10-09T19:00:48.685349] [INFO ] [MAIN ] FR: Loaded 46358 existing records. [2025-10-09T19:00:48.801845] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-09T19:00:48.872763] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:48.872952] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-09T19:00:48.873021] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-09T19:00:48.874719] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-09T19:00:48.874783] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-09T19:00:49.248909] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:49.267167] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T19:00:49.596728] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-09T19:00:49.610428] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-09T19:00:50.396697] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-09T19:00:50.692327] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T19:00:50.960917] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T19:00:51.196745] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-09T19:00:51.996736] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-09T19:00:52.255024] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T19:00:52.722747] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T19:00:52.796714] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-09T19:00:53.596753] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-09T19:00:53.739739] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T19:00:54.396703] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-09T19:00:54.703206] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:00:55.196720] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-09T19:00:55.975421] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T19:00:55.996676] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-09T19:00:56.174435] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T19:00:56.796750] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-09T19:00:57.425958] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T19:00:57.596687] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-09T19:00:57.850610] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T19:00:57.853143] [INFO ] [REMOTE ] FPF: Full fetch complete (26672 records). [2025-10-09T19:00:57.853218] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-09T19:00:58.246497] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-09T19:00:58.246614] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-09T19:00:58.247234] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-09T19:00:58.247287] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-09T19:00:58.248033] [DEBUG] [LOCAL ] FPF: Trimmed 26672 records to 18750 (keeping 200 days of data) [2025-10-09T19:00:58.366624] [DEBUG] [LOCAL ] FPF: Primary data saved (18750 records). [2025-10-09T19:00:58.366819] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-09T19:00:58.366908] [INFO ] [MAIN ] Update Progress: 866/2373 symbols completed. FPF took 32.3s. Estimated remaining: 3h 30m 25s. Rate: 7.2 symbols/min [2025-10-09T19:00:58.402963] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-09T19:00:58.562311] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:00:58.577848] [DEBUG] [LOCAL ] FRA: Loaded 14561 existing records from primary storage. [2025-10-09T19:00:58.578097] [INFO ] [MAIN ] FRA: Loaded 14561 existing records. [2025-10-09T19:00:58.762230] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:00:58.762511] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-09T19:00:58.762582] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-09T19:00:58.763410] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-09T19:00:58.763473] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-09T19:00:59.188131] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:00:59.209576] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-09T19:00:59.212534] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T19:00:59.468982] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T19:00:59.996724] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-09T19:01:00.323838] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T19:01:00.796687] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-09T19:01:00.985545] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T19:01:01.596681] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-09T19:01:01.882459] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T19:01:02.396690] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-09T19:01:02.783788] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T19:01:03.196688] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-09T19:01:03.425587] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T19:01:03.996744] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-09T19:01:04.796683] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-09T19:01:04.912300] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T19:01:05.057350] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T19:01:05.596753] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-09T19:01:05.942297] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:01:05.944904] [INFO ] [REMOTE ] FPH: Full fetch complete (31182 records). [2025-10-09T19:01:05.944996] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-09T19:01:06.325702] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-09T19:01:06.325818] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-09T19:01:06.326559] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-09T19:01:06.326610] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-09T19:01:06.327444] [DEBUG] [LOCAL ] FPH: Trimmed 31182 records to 19427 (keeping 200 days of data) [2025-10-09T19:01:06.404086] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-09T19:01:06.439277] [DEBUG] [LOCAL ] FPH: Primary data saved (19427 records). [2025-10-09T19:01:06.439433] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-09T19:01:06.439518] [INFO ] [MAIN ] Update Progress: 867/2373 symbols completed. FPH took 28.1s. Estimated remaining: 3h 30m 16s. Rate: 7.2 symbols/min [2025-10-09T19:01:06.606004] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:06.606176] [DEBUG] [LOCAL ] FRGE: No existing data file found in primary storage. [2025-10-09T19:01:06.606213] [WARN ] [MAIN ] FRGE: No existing data found, performing full refresh instead. [2025-10-09T19:01:06.606322] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-09T19:01:06.606364] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-09T19:01:06.606404] [DEBUG] [LOCAL ] FRGE: No primary data file found to delete. [2025-10-09T19:01:06.606436] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-09T19:01:06.968264] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:07.196712] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-09T19:01:07.313124] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:01:07.807134] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T19:01:07.996832] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-09T19:01:08.329698] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:01:08.796734] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-09T19:01:09.226549] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T19:01:09.596716] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-09T19:01:09.998957] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T19:01:10.324019] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T19:01:10.396745] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-09T19:01:11.196709] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-09T19:01:11.468127] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T19:01:11.996726] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-09T19:01:12.429490] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T19:01:12.796696] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-09T19:01:13.521750] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:01:13.564825] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T19:01:13.596678] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-09T19:01:14.396746] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-09T19:01:15.116944] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T19:01:15.196767] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-09T19:01:15.403716] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T19:01:15.996735] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-09T19:01:16.516083] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T19:01:16.796753] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-09T19:01:16.941027] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T19:01:17.596694] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-09T19:01:18.032424] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T19:01:18.396767] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-09T19:01:19.080338] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:01:19.111697] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T19:01:19.196761] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-09T19:01:19.996738] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-09T19:01:20.550560] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:01:20.796738] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-09T19:01:21.004946] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:01:21.596710] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-09T19:01:22.302286] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T19:01:22.403926] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-09T19:01:22.404815] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T19:01:23.196772] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-09T19:01:23.907420] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T19:01:23.911437] [INFO ] [REMOTE ] FR: Full fetch complete (66690 records). [2025-10-09T19:01:23.911546] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-09T19:01:24.002123] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-09T19:01:24.339783] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-09T19:01:24.340830] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T19:01:24.340397] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-09T19:01:24.345818] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-09T19:01:24.346027] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-09T19:01:24.347396] [DEBUG] [LOCAL ] FR: Trimmed 66690 records to 46701 (keeping 200 days of data) [2025-10-09T19:01:24.644396] [DEBUG] [LOCAL ] FR: Primary data saved (46701 records). [2025-10-09T19:01:24.644535] [INFO ] [MAIN ] FR: Full history saved. [2025-10-09T19:01:24.645714] [INFO ] [MAIN ] Update Progress: 868/2373 symbols completed. FR took 36.2s. Estimated remaining: 3h 30m 24s. Rate: 7.2 symbols/min [2025-10-09T19:01:24.800671] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-09T19:01:24.822302] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:24.878357] [DEBUG] [LOCAL ] FRO: Loaded 51674 existing records from primary storage. [2025-10-09T19:01:24.878720] [INFO ] [MAIN ] FRO: Loaded 51674 existing records. [2025-10-09T19:01:25.059404] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:01:25.059728] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-09T19:01:25.059791] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-09T19:01:25.061372] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-09T19:01:25.061436] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-09T19:01:25.428781] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:25.454884] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T19:01:25.596676] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-09T19:01:25.733037] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-09T19:01:25.735072] [INFO ] [REMOTE ] FRA: Full fetch complete (23869 records). [2025-10-09T19:01:25.735144] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-09T19:01:26.097959] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-09T19:01:26.098036] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-09T19:01:26.098486] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-09T19:01:26.098532] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-09T19:01:26.099181] [DEBUG] [LOCAL ] FRA: Trimmed 23869 records to 14632 (keeping 200 days of data) [2025-10-09T19:01:26.191944] [DEBUG] [LOCAL ] FRA: Primary data saved (14632 records). [2025-10-09T19:01:26.192080] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-09T19:01:26.192161] [INFO ] [MAIN ] Update Progress: 869/2373 symbols completed. FRA took 27.8s. Estimated remaining: 3h 30m 4s. Rate: 7.2 symbols/min [2025-10-09T19:01:26.362880] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:26.403467] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-09T19:01:26.406116] [DEBUG] [LOCAL ] FRT: Loaded 41872 existing records from primary storage. [2025-10-09T19:01:26.406409] [INFO ] [MAIN ] FRT: Loaded 41872 existing records. [2025-10-09T19:01:26.582993] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:01:26.583181] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-09T19:01:26.583229] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-09T19:01:26.584384] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-09T19:01:26.584442] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-09T19:01:26.956377] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T19:01:26.955534] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:27.196725] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-09T19:01:27.996707] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-09T19:01:28.445321] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-09T19:01:28.710132] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:01:28.796836] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-09T19:01:29.250880] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:01:29.564200] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T19:01:29.596668] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-09T19:01:30.396697] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-09T19:01:30.444844] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T19:01:31.196798] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-09T19:01:31.720820] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T19:01:31.979116] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T19:01:31.996762] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-09T19:01:32.795808] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T19:01:32.798835] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-09T19:01:33.596754] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-09T19:01:34.396738] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-09T19:01:34.788030] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-09T19:01:35.045821] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T19:01:35.196683] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-09T19:01:35.440739] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T19:01:35.443509] [INFO ] [REMOTE ] FPI: Full fetch complete (44018 records). [2025-10-09T19:01:35.443587] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-09T19:01:35.813541] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-09T19:01:35.813624] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-09T19:01:35.814322] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-09T19:01:35.814374] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-09T19:01:35.815396] [DEBUG] [LOCAL ] FPI: Trimmed 44018 records to 31242 (keeping 200 days of data) [2025-10-09T19:01:35.996983] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-09T19:01:36.012629] [DEBUG] [LOCAL ] FPI: Primary data saved (31242 records). [2025-10-09T19:01:36.012807] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-09T19:01:36.012909] [INFO ] [MAIN ] Update Progress: 870/2373 symbols completed. FPI took 49.8s. Estimated remaining: 3h 29m 58s. Rate: 7.2 symbols/min [2025-10-09T19:01:36.186055] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:36.225350] [DEBUG] [LOCAL ] FSCO: Loaded 38029 existing records from primary storage. [2025-10-09T19:01:36.225697] [INFO ] [MAIN ] FSCO: Loaded 38029 existing records. [2025-10-09T19:01:36.442555] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:01:36.442804] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-09T19:01:36.442854] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-09T19:01:36.443855] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-09T19:01:36.443917] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-09T19:01:36.798539] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-09T19:01:36.835516] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T19:01:36.841949] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:36.843223] [INFO ] [REMOTE ] FRGE: Full fetch complete (31558 records). [2025-10-09T19:01:36.843470] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-09T19:01:37.048556] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T19:01:37.287631] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-09T19:01:37.287749] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-09T19:01:37.288470] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-09T19:01:37.288573] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-09T19:01:37.289489] [DEBUG] [LOCAL ] FRGE: Trimmed 31558 records to 16985 (keeping 200 days of data) [2025-10-09T19:01:37.412782] [DEBUG] [LOCAL ] FRGE: Primary data saved (16985 records). [2025-10-09T19:01:37.412931] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-09T19:01:37.413010] [INFO ] [MAIN ] Update Progress: 871/2373 symbols completed. FRGE took 31.0s. Estimated remaining: 3h 29m 38s. Rate: 7.2 symbols/min [2025-10-09T19:01:37.608426] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-09T19:01:37.613530] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:37.667270] [DEBUG] [LOCAL ] FSK: Loaded 49404 existing records from primary storage. [2025-10-09T19:01:37.667622] [INFO ] [MAIN ] FSK: Loaded 49404 existing records. [2025-10-09T19:01:37.868524] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:01:37.868767] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-09T19:01:37.868820] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-09T19:01:37.870179] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-09T19:01:37.870239] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-09T19:01:38.222838] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:38.396761] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-09T19:01:38.719517] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-09T19:01:39.196704] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-09T19:01:39.295949] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-09T19:01:39.996739] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-09T19:01:40.109124] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T19:01:40.422896] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T19:01:40.796769] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-09T19:01:41.564077] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:01:41.596734] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-09T19:01:42.396691] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-09T19:01:42.539008] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:01:43.009079] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T19:01:43.196747] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-09T19:01:43.951805] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T19:01:43.996667] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-09T19:01:44.673777] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T19:01:44.796700] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-09T19:01:45.583972] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:01:45.596668] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-09T19:01:46.255031] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:01:46.396697] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-09T19:01:47.196726] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-09T19:01:47.304045] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:01:47.963298] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:01:47.996694] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-09T19:01:48.498580] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T19:01:48.796717] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-09T19:01:49.506590] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-09T19:01:49.596741] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-09T19:01:49.694245] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T19:01:50.396717] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-09T19:01:51.036860] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:01:51.040719] [INFO ] [REMOTE ] FRT: Full fetch complete (60341 records). [2025-10-09T19:01:51.040854] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-09T19:01:51.206793] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-09T19:01:51.498033] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-09T19:01:51.498127] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-09T19:01:51.499045] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-09T19:01:51.499113] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-09T19:01:51.500512] [DEBUG] [LOCAL ] FRT: Trimmed 60341 records to 42147 (keeping 200 days of data) [2025-10-09T19:01:51.798474] [DEBUG] [LOCAL ] FRT: Primary data saved (42147 records). [2025-10-09T19:01:51.798609] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-09T19:01:51.798729] [INFO ] [MAIN ] Update Progress: 872/2373 symbols completed. FRT took 25.6s. Estimated remaining: 3h 29m 40s. Rate: 7.2 symbols/min [2025-10-09T19:01:51.968208] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:01:51.996690] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-09T19:01:52.015333] [DEBUG] [LOCAL ] FSLY: Loaded 51235 existing records from primary storage. [2025-10-09T19:01:52.015630] [INFO ] [MAIN ] FSLY: Loaded 51235 existing records. [2025-10-09T19:01:52.193725] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:01:52.193945] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-09T19:01:52.194233] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-09T19:01:52.204048] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-09T19:01:52.217557] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-09T19:01:52.304988] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T19:01:52.586680] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:01:52.796725] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-09T19:01:53.202224] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T19:01:53.340266] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T19:01:53.596731] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-09T19:01:54.396704] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-09T19:01:54.746202] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-09T19:01:54.979025] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T19:01:55.196729] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-09T19:01:55.996789] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-09T19:01:56.030964] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T19:01:56.796717] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-09T19:01:56.889981] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T19:01:57.282763] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T19:01:57.596740] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-09T19:01:58.396700] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-09T19:01:58.793207] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T19:01:59.196722] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-09T19:01:59.261241] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:01:59.769127] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T19:01:59.996788] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-09T19:02:00.796803] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-09T19:02:00.881239] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T19:02:01.596897] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-09T19:02:01.662010] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T19:02:01.949162] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T19:02:02.396730] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-09T19:02:03.196743] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-09T19:02:03.254885] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T19:02:03.598739] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-09T19:02:03.996691] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-09T19:02:04.796786] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-09T19:02:04.863562] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T19:02:05.596711] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-09T19:02:05.801719] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T19:02:06.396703] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-09T19:02:06.523600] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T19:02:07.196703] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-09T19:02:07.336331] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T19:02:07.340689] [INFO ] [REMOTE ] FRO: Full fetch complete (75199 records). [2025-10-09T19:02:07.340814] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-09T19:02:07.759111] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-09T19:02:07.759200] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-09T19:02:07.760178] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-09T19:02:07.760255] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-09T19:02:07.761817] [DEBUG] [LOCAL ] FRO: Trimmed 75199 records to 52062 (keeping 200 days of data) [2025-10-09T19:02:07.996802] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-09T19:02:08.097677] [DEBUG] [LOCAL ] FRO: Primary data saved (52062 records). [2025-10-09T19:02:08.097852] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-09T19:02:08.099005] [INFO ] [MAIN ] Update Progress: 873/2373 symbols completed. FRO took 43.5s. Estimated remaining: 3h 29m 45s. Rate: 7.2 symbols/min [2025-10-09T19:02:08.274538] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:08.305590] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T19:02:08.365817] [DEBUG] [LOCAL ] FSM: Loaded 53296 existing records from primary storage. [2025-10-09T19:02:08.366167] [INFO ] [MAIN ] FSM: Loaded 53296 existing records. [2025-10-09T19:02:08.539819] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:08.539994] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-09T19:02:08.540040] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-09T19:02:08.541287] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-09T19:02:08.541347] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-09T19:02:08.796805] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-09T19:02:08.798498] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:02:08.840549] [INFO ] [REMOTE ] FSK: Full fetch complete (71685 records). [2025-10-09T19:02:08.869753] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-09T19:02:09.060060] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:09.358027] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-09T19:02:09.358135] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-09T19:02:09.359263] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-09T19:02:09.359371] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-09T19:02:09.360918] [DEBUG] [LOCAL ] FSK: Trimmed 71685 records to 49791 (keeping 200 days of data) [2025-10-09T19:02:09.479568] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T19:02:09.608451] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-09T19:02:09.707686] [DEBUG] [LOCAL ] FSK: Primary data saved (49791 records). [2025-10-09T19:02:09.707850] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-09T19:02:09.708427] [INFO ] [MAIN ] Update Progress: 874/2373 symbols completed. FSK took 32.3s. Estimated remaining: 3h 29m 25s. Rate: 7.2 symbols/min [2025-10-09T19:02:09.877142] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:09.912138] [DEBUG] [LOCAL ] FSS: Loaded 33877 existing records from primary storage. [2025-10-09T19:02:09.912434] [INFO ] [MAIN ] FSS: Loaded 33877 existing records. [2025-10-09T19:02:10.090952] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:10.091251] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-09T19:02:10.091394] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-09T19:02:10.092715] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-09T19:02:10.092779] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-09T19:02:10.398718] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-09T19:02:10.456314] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:10.488667] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T19:02:10.912911] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T19:02:11.196776] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-09T19:02:11.996779] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-09T19:02:12.314451] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-09T19:02:12.796682] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-09T19:02:12.877955] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T19:02:12.955001] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T19:02:13.596732] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-09T19:02:14.396708] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-09T19:02:14.549704] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:02:14.575257] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T19:02:15.196775] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-09T19:02:15.956783] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:02:15.996727] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-09T19:02:16.626725] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T19:02:16.796718] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-09T19:02:17.114724] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T19:02:17.596768] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-09T19:02:18.396726] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-09T19:02:18.503960] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T19:02:19.140690] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:02:19.196696] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-09T19:02:19.935904] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:02:19.996785] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-09T19:02:20.796820] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-09T19:02:21.116787] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-09T19:02:21.437190] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T19:02:21.596778] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-09T19:02:22.229423] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T19:02:22.396747] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-09T19:02:22.803163] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T19:02:23.196776] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-09T19:02:23.351066] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:02:23.996747] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-09T19:02:24.612411] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T19:02:24.796739] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-09T19:02:25.160861] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-09T19:02:25.165570] [INFO ] [REMOTE ] FSCO: Full fetch complete (54749 records). [2025-10-09T19:02:25.165789] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-09T19:02:25.549671] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-09T19:02:25.549764] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-09T19:02:25.550528] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-09T19:02:25.550568] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-09T19:02:25.551721] [DEBUG] [LOCAL ] FSCO: Trimmed 54749 records to 38325 (keeping 200 days of data) [2025-10-09T19:02:25.606347] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-09T19:02:25.789851] [DEBUG] [LOCAL ] FSCO: Primary data saved (38325 records). [2025-10-09T19:02:25.790003] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-09T19:02:25.790168] [INFO ] [MAIN ] Update Progress: 875/2373 symbols completed. FSCO took 49.8s. Estimated remaining: 3h 29m 30s. Rate: 7.2 symbols/min [2025-10-09T19:02:25.965320] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:25.973818] [DEBUG] [LOCAL ] FT: Loaded 6607 existing records from primary storage. [2025-10-09T19:02:25.974022] [INFO ] [MAIN ] FT: Loaded 6607 existing records. [2025-10-09T19:02:26.156706] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:26.157085] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-09T19:02:26.157148] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-09T19:02:26.157495] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-09T19:02:26.157556] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-09T19:02:26.335252] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T19:02:26.404317] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-09T19:02:26.417351] [INFO ] [REMOTE ] FSLY: Full fetch complete (74862 records). [2025-10-09T19:02:26.417531] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-09T19:02:26.697400] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:27.045572] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-09T19:02:27.047164] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T19:02:27.047259] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-09T19:02:27.048794] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-09T19:02:27.055615] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-09T19:02:27.057882] [DEBUG] [LOCAL ] FSLY: Trimmed 74862 records to 51612 (keeping 200 days of data) [2025-10-09T19:02:27.215166] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-09T19:02:27.350113] [DEBUG] [LOCAL ] FSLY: Primary data saved (51612 records). [2025-10-09T19:02:27.350252] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-09T19:02:27.350332] [INFO ] [MAIN ] Update Progress: 876/2373 symbols completed. FSLY took 35.6s. Estimated remaining: 3h 29m 10s. Rate: 7.2 symbols/min [2025-10-09T19:02:27.516898] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:27.529712] [DEBUG] [LOCAL ] FTHY: Loaded 12273 existing records from primary storage. [2025-10-09T19:02:27.529911] [INFO ] [MAIN ] FTHY: Loaded 12273 existing records. [2025-10-09T19:02:27.712432] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:27.712684] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-09T19:02:27.712749] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-09T19:02:27.713142] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-09T19:02:27.713232] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-09T19:02:28.000148] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-09T19:02:28.082582] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:28.203535] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T19:02:28.342246] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T19:02:28.734667] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T19:02:28.796736] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-09T19:02:29.596765] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-09T19:02:29.783541] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T19:02:30.239851] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T19:02:30.396788] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-09T19:02:31.196728] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-09T19:02:31.286902] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T19:02:31.996736] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-09T19:02:32.533480] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T19:02:32.796731] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-09T19:02:33.229664] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T19:02:33.474404] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T19:02:33.596765] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-09T19:02:34.309521] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-09T19:02:34.396730] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-09T19:02:35.130873] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-09T19:02:35.196740] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-09T19:02:35.996721] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-09T19:02:36.705962] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-09T19:02:36.796690] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-09T19:02:37.069128] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T19:02:37.493738] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T19:02:37.596731] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-09T19:02:38.396732] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-09T19:02:38.814800] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T19:02:38.985210] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T19:02:39.196761] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-09T19:02:39.996742] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-09T19:02:40.330245] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T19:02:40.333189] [INFO ] [REMOTE ] FSS: Full fetch complete (48401 records). [2025-10-09T19:02:40.333282] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-09T19:02:40.730121] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-09T19:02:40.730205] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-09T19:02:40.731125] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-09T19:02:40.731192] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-09T19:02:40.732392] [DEBUG] [LOCAL ] FSS: Trimmed 48401 records to 34059 (keeping 200 days of data) [2025-10-09T19:02:40.797351] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-09T19:02:40.845351] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T19:02:40.981007] [DEBUG] [LOCAL ] FSS: Primary data saved (34059 records). [2025-10-09T19:02:40.981181] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-09T19:02:40.981808] [INFO ] [MAIN ] Update Progress: 877/2373 symbols completed. FSS took 31.3s. Estimated remaining: 3h 29m 10s. Rate: 7.2 symbols/min [2025-10-09T19:02:41.596768] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-09T19:02:42.328832] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T19:02:42.396684] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-09T19:02:42.628493] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:02:43.196732] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-09T19:02:43.267082] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T19:02:43.996724] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-09T19:02:44.769615] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T19:02:44.796672] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-09T19:02:44.957395] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T19:02:44.962038] [INFO ] [REMOTE ] FSM: Full fetch complete (76847 records). [2025-10-09T19:02:44.962173] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-09T19:02:45.354977] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-09T19:02:45.355059] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-09T19:02:45.356022] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-09T19:02:45.356089] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-09T19:02:45.357714] [DEBUG] [LOCAL ] FSM: Trimmed 76847 records to 53686 (keeping 200 days of data) [2025-10-09T19:02:45.569232] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T19:02:45.596734] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-09T19:02:45.686244] [DEBUG] [LOCAL ] FSM: Primary data saved (53686 records). [2025-10-09T19:02:45.686399] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-09T19:02:45.687856] [INFO ] [MAIN ] Update Progress: 878/2373 symbols completed. FSM took 37.6s. Estimated remaining: 3h 28m 56s. Rate: 7.2 symbols/min [2025-10-09T19:02:46.309903] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-09T19:02:46.396697] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-09T19:02:46.882294] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T19:02:47.196775] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-09T19:02:47.987980] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T19:02:47.996664] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-09T19:02:48.718477] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-09T19:02:48.720368] [INFO ] [REMOTE ] FTHY: Full fetch complete (17558 records). [2025-10-09T19:02:48.720455] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-09T19:02:48.810070] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-09T19:02:49.084739] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-09T19:02:49.084817] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-09T19:02:49.085237] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-09T19:02:49.085278] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-09T19:02:49.085889] [DEBUG] [LOCAL ] FTHY: Trimmed 17558 records to 12386 (keeping 200 days of data) [2025-10-09T19:02:49.175639] [DEBUG] [LOCAL ] FTHY: Primary data saved (12386 records). [2025-10-09T19:02:49.175835] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-09T19:02:49.175953] [INFO ] [MAIN ] Update Progress: 879/2373 symbols completed. FTHY took 21.8s. Estimated remaining: 3h 28m 39s. Rate: 7.2 symbols/min [2025-10-09T19:02:49.362729] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T19:02:49.596730] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-09T19:02:50.302479] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T19:02:50.396837] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-09T19:02:50.991549] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T19:02:50.992852] [INFO ] [REMOTE ] FT: Full fetch complete (9240 records). [2025-10-09T19:02:50.992920] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-09T19:02:51.351547] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-09T19:02:51.351632] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-09T19:02:51.351917] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-09T19:02:51.351963] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-09T19:02:51.352409] [DEBUG] [LOCAL ] FT: Trimmed 9240 records to 6755 (keeping 200 days of data) [2025-10-09T19:02:51.393299] [DEBUG] [LOCAL ] FT: Primary data saved (6755 records). [2025-10-09T19:02:51.393443] [INFO ] [MAIN ] FT: Full history saved. [2025-10-09T19:02:51.393530] [INFO ] [MAIN ] Update Progress: 880/2373 symbols completed. FT took 25.6s. Estimated remaining: 3h 28m 20s. Rate: 7.2 symbols/min [2025-10-09T19:02:51.992865] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:51.995816] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:52.102795] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:52.123073] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:02:52.172169] [DEBUG] [LOCAL ] FTS: Loaded 42429 existing records from primary storage. [2025-10-09T19:02:52.182450] [INFO ] [MAIN ] FTS: Loaded 42429 existing records. [2025-10-09T19:02:52.255845] [DEBUG] [LOCAL ] FTV: Loaded 52988 existing records from primary storage. [2025-10-09T19:02:52.282396] [DEBUG] [LOCAL ] FTK: Loaded 32569 existing records from primary storage. [2025-10-09T19:02:52.288260] [INFO ] [MAIN ] FTV: Loaded 52988 existing records. [2025-10-09T19:02:52.294021] [INFO ] [MAIN ] FTK: Loaded 32569 existing records. [2025-10-09T19:02:52.624147] [DEBUG] [LOCAL ] FTI: Loaded 53294 existing records from primary storage. [2025-10-09T19:02:52.673254] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:52.673439] [INFO ] [MAIN ] FTI: Loaded 53294 existing records. [2025-10-09T19:02:52.725414] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-09T19:02:52.771151] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-09T19:02:52.807805] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-09T19:02:52.867054] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:52.911490] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-09T19:02:52.911669] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-09T19:02:52.927107] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-09T19:02:52.954516] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:52.965375] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-09T19:02:52.985527] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-09T19:02:53.013967] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-09T19:02:52.990891] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-09T19:02:53.042470] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-09T19:02:53.059505] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-09T19:02:53.501425] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:02:53.523265] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-09T19:02:53.603381] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-09T19:02:53.816086] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-09T19:02:53.853239] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-09T19:02:54.145617] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:54.203624] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-09T19:02:54.241956] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:54.273540] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-09T19:02:54.409251] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:54.448434] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-09T19:02:54.601883] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:02:54.602199] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-09T19:02:55.238631] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-09T19:02:55.243701] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-09T19:02:55.459154] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T19:02:55.467173] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-09T19:02:56.008091] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T19:02:56.013569] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-09T19:02:56.170952] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T19:02:56.272697] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T19:02:56.458716] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-09T19:02:56.796724] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-09T19:02:57.086010] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T19:02:57.596727] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-09T19:02:58.403903] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-09T19:02:58.426941] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T19:02:58.722771] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:02:59.196833] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-09T19:02:59.996777] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-09T19:03:00.078395] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T19:03:00.796799] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-09T19:03:00.839265] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:03:01.540058] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:03:01.596779] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-09T19:03:02.156685] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T19:03:02.396773] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-09T19:03:03.152324] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T19:03:03.196689] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-09T19:03:03.996729] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-09T19:03:04.086556] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T19:03:04.787706] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:03:04.798864] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-09T19:03:05.290903] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-09T19:03:05.596727] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-09T19:03:06.396703] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-09T19:03:06.519218] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:03:07.180905] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T19:03:07.196666] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-09T19:03:07.996694] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-09T19:03:08.363957] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T19:03:08.410200] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T19:03:08.796730] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-09T19:03:09.097094] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T19:03:09.596750] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-09T19:03:10.396685] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-09T19:03:10.620022] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-09T19:03:10.849458] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T19:03:11.196733] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-09T19:03:11.928547] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:03:11.996677] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-09T19:03:12.787023] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T19:03:12.802066] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-09T19:03:13.596691] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-09T19:03:13.882221] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T19:03:13.909408] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T19:03:14.396799] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-09T19:03:15.202427] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-09T19:03:15.207665] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T19:03:15.646032] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T19:03:15.996773] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-09T19:03:16.796692] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-09T19:03:17.150639] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-09T19:03:17.453771] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:03:17.596756] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-09T19:03:18.230371] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:03:18.396741] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-09T19:03:19.050423] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T19:03:19.196715] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-09T19:03:19.907485] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T19:03:19.911418] [INFO ] [REMOTE ] FTS: Full fetch complete (60250 records). [2025-10-09T19:03:19.911520] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-09T19:03:20.001990] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-09T19:03:20.301544] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-09T19:03:20.301697] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-09T19:03:20.302927] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-09T19:03:20.303012] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-09T19:03:20.304916] [DEBUG] [LOCAL ] FTS: Trimmed 60250 records to 42723 (keeping 200 days of data) [2025-10-09T19:03:20.573734] [DEBUG] [LOCAL ] FTS: Primary data saved (42723 records). [2025-10-09T19:03:20.573863] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-09T19:03:20.573944] [INFO ] [MAIN ] Update Progress: 881/2373 symbols completed. FTS took 29.2s. Estimated remaining: 3h 28m 47s. Rate: 7.1 symbols/min [2025-10-09T19:03:20.748569] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:03:20.752766] [DEBUG] [LOCAL ] FTWO: Loaded 1882 existing records from primary storage. [2025-10-09T19:03:20.752958] [INFO ] [MAIN ] FTWO: Loaded 1882 existing records. [2025-10-09T19:03:20.816688] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-09T19:03:20.942971] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:03:20.943365] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-09T19:03:20.943438] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-09T19:03:20.944003] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-09T19:03:20.944104] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-09T19:03:21.136486] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-09T19:03:21.385071] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:03:21.517602] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T19:03:21.596772] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-09T19:03:22.396741] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-09T19:03:22.613705] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T19:03:22.760577] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-09T19:03:23.196695] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-09T19:03:23.275718] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-09T19:03:23.996728] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-09T19:03:24.542380] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-09T19:03:24.796723] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-09T19:03:25.368206] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T19:03:25.372622] [INFO ] [REMOTE ] FTV: Full fetch complete (76406 records). [2025-10-09T19:03:25.372766] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-09T19:03:25.601781] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-09T19:03:25.771520] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-09T19:03:25.771600] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-09T19:03:25.772584] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-09T19:03:25.772672] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-09T19:03:25.777148] [DEBUG] [LOCAL ] FTV: Trimmed 76406 records to 53377 (keeping 200 days of data) [2025-10-09T19:03:26.115498] [DEBUG] [LOCAL ] FTV: Primary data saved (53377 records). [2025-10-09T19:03:26.115619] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-09T19:03:26.115738] [INFO ] [MAIN ] Update Progress: 882/2373 symbols completed. FTV took 34.7s. Estimated remaining: 3h 28m 34s. Rate: 7.1 symbols/min [2025-10-09T19:03:26.291376] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:03:26.296858] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T19:03:26.301765] [INFO ] [REMOTE ] FTI: Full fetch complete (77123 records). [2025-10-09T19:03:26.301924] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-09T19:03:26.402845] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-09T19:03:26.685159] [DEBUG] [LOCAL ] FUBO: Loaded 53705 existing records from primary storage. [2025-10-09T19:03:26.701068] [INFO ] [MAIN ] FUBO: Loaded 53705 existing records. [2025-10-09T19:03:26.890412] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-09T19:03:26.916801] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-09T19:03:26.930817] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-09T19:03:26.941313] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-09T19:03:26.972296] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:03:26.972916] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-09T19:03:26.973030] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-09T19:03:26.974686] [DEBUG] [LOCAL ] FTI: Trimmed 77123 records to 53681 (keeping 200 days of data) [2025-10-09T19:03:26.974896] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-09T19:03:26.975266] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-09T19:03:27.169161] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T19:03:27.202047] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T19:03:27.222988] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-09T19:03:27.488220] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:03:27.718620] [DEBUG] [LOCAL ] FTI: Primary data saved (53681 records). [2025-10-09T19:03:27.718801] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-09T19:03:27.719517] [INFO ] [MAIN ] Update Progress: 883/2373 symbols completed. FTI took 36.3s. Estimated remaining: 3h 28m 14s. Rate: 7.2 symbols/min [2025-10-09T19:03:27.815925] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T19:03:27.895801] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:03:27.927464] [DEBUG] [LOCAL ] FUL: Loaded 32850 existing records from primary storage. [2025-10-09T19:03:27.927751] [INFO ] [MAIN ] FUL: Loaded 32850 existing records. [2025-10-09T19:03:28.001828] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-09T19:03:28.104501] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:03:28.104748] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-09T19:03:28.104818] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-09T19:03:28.105638] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-09T19:03:28.105734] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-09T19:03:28.460015] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:03:28.796725] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-09T19:03:29.084696] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-09T19:03:29.596728] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-09T19:03:29.916363] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T19:03:30.035457] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T19:03:30.396717] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-09T19:03:30.753546] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-09T19:03:31.196714] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-09T19:03:31.669448] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T19:03:31.996800] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-09T19:03:32.436599] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T19:03:32.796748] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-09T19:03:33.596716] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-09T19:03:34.396727] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-09T19:03:34.947521] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T19:03:34.951486] [INFO ] [REMOTE ] FTK: Full fetch complete (43819 records). [2025-10-09T19:03:34.951601] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-09T19:03:35.207603] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-09T19:03:35.405067] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-09T19:03:35.428316] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-09T19:03:35.428413] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-09T19:03:35.429250] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-09T19:03:35.429313] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-09T19:03:35.430359] [DEBUG] [LOCAL ] FTK: Trimmed 43819 records to 32796 (keeping 200 days of data) [2025-10-09T19:03:35.552078] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-09T19:03:35.573948] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T19:03:35.665195] [DEBUG] [LOCAL ] FTK: Primary data saved (32796 records). [2025-10-09T19:03:35.665342] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-09T19:03:35.665433] [INFO ] [MAIN ] Update Progress: 884/2373 symbols completed. FTK took 44.3s. Estimated remaining: 3h 28m 5s. Rate: 7.2 symbols/min [2025-10-09T19:03:35.837529] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:03:35.889748] [DEBUG] [LOCAL ] FUN: Loaded 51776 existing records from primary storage. [2025-10-09T19:03:35.890092] [INFO ] [MAIN ] FUN: Loaded 51776 existing records. [2025-10-09T19:03:36.001845] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-09T19:03:36.077778] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:03:36.078042] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-09T19:03:36.078094] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-09T19:03:36.079497] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-09T19:03:36.079558] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-09T19:03:36.478660] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:03:36.505388] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T19:03:36.796732] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-09T19:03:37.596718] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-09T19:03:38.396724] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-09T19:03:38.991834] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-09T19:03:38.992743] [INFO ] [REMOTE ] FTWO: Full fetch complete (3326 records). [2025-10-09T19:03:38.992817] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-09T19:03:39.135229] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:03:39.220565] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-09T19:03:39.259919] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-09T19:03:39.455771] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-09T19:03:39.455886] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-09T19:03:39.456031] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-09T19:03:39.456073] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-09T19:03:39.456399] [DEBUG] [LOCAL ] FTWO: Trimmed 3326 records to 1903 (keeping 200 days of data) [2025-10-09T19:03:39.469019] [DEBUG] [LOCAL ] FTWO: Primary data saved (1903 records). [2025-10-09T19:03:39.469078] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-09T19:03:39.469145] [INFO ] [MAIN ] Update Progress: 885/2373 symbols completed. FTWO took 18.9s. Estimated remaining: 3h 27m 49s. Rate: 7.2 symbols/min [2025-10-09T19:03:39.637379] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:03:39.661131] [DEBUG] [LOCAL ] FVR: Loaded 21569 existing records from primary storage. [2025-10-09T19:03:39.661386] [INFO ] [MAIN ] FVR: Loaded 21569 existing records. [2025-10-09T19:03:39.873687] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:03:39.873907] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-09T19:03:39.873953] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-09T19:03:39.874787] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-09T19:03:39.874846] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-09T19:03:40.012202] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-09T19:03:40.235725] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:03:40.488303] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T19:03:40.796694] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-09T19:03:41.596796] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-09T19:03:41.898991] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T19:03:42.281626] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-09T19:03:42.396718] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-09T19:03:43.151016] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:03:43.196670] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-09T19:03:43.691950] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T19:03:43.996727] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-09T19:03:44.796740] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-09T19:03:45.244118] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T19:03:45.309141] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-09T19:03:45.596738] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-09T19:03:46.037558] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T19:03:46.396780] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-09T19:03:47.025952] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:03:47.196697] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-09T19:03:47.420091] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:03:47.996723] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-09T19:03:48.796751] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-09T19:03:49.440597] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-09T19:03:49.482334] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-09T19:03:49.596725] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-09T19:03:49.656297] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T19:03:50.396736] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-09T19:03:50.503167] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T19:03:51.196722] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-09T19:03:51.990705] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T19:03:51.996668] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-09T19:03:52.148995] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T19:03:52.794434] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T19:03:52.798765] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-09T19:03:53.596757] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-09T19:03:54.138155] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-09T19:03:54.396729] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-09T19:03:55.035486] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:03:55.196717] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-09T19:03:55.707738] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T19:03:55.996750] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-09T19:03:56.427041] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T19:03:56.796784] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-09T19:03:57.251491] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T19:03:57.596701] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-09T19:03:57.921120] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T19:03:58.396780] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-09T19:03:59.196738] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-09T19:03:59.996739] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-09T19:04:00.137376] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-09T19:04:00.188284] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T19:04:00.425754] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T19:04:00.796772] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-09T19:04:01.131529] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:04:01.596751] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-09T19:04:02.396691] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-09T19:04:02.645955] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T19:04:02.732634] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:04:03.196755] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-09T19:04:03.572872] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T19:04:03.575872] [INFO ] [REMOTE ] FUL: Full fetch complete (47841 records). [2025-10-09T19:04:03.575959] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-09T19:04:03.976533] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-09T19:04:03.976687] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-09T19:04:03.977434] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-09T19:04:03.977600] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-09T19:04:03.990964] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T19:04:03.995638] [DEBUG] [LOCAL ] FUL: Trimmed 47841 records to 33056 (keeping 200 days of data) [2025-10-09T19:04:03.996798] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-09T19:04:04.208603] [DEBUG] [LOCAL ] FUL: Primary data saved (33056 records). [2025-10-09T19:04:04.208817] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-09T19:04:04.209592] [INFO ] [MAIN ] Update Progress: 886/2373 symbols completed. FUL took 36.5s. Estimated remaining: 3h 28m 8s. Rate: 7.1 symbols/min [2025-10-09T19:04:04.409195] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:04.452231] [DEBUG] [LOCAL ] FVRR: Loaded 40243 existing records from primary storage. [2025-10-09T19:04:04.452564] [INFO ] [MAIN ] FVRR: Loaded 40243 existing records. [2025-10-09T19:04:04.633714] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:04.633977] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-09T19:04:04.634039] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-09T19:04:04.635379] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-09T19:04:04.635439] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-09T19:04:04.806225] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-09T19:04:04.996125] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:05.596784] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-09T19:04:05.902568] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T19:04:06.396774] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-09T19:04:07.109348] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:04:07.146847] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-09T19:04:07.173143] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:04:07.196685] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-09T19:04:07.996744] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-09T19:04:08.796806] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-09T19:04:08.884328] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T19:04:08.906877] [DEBUG] [REMOTE ] FVR: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-09T19:04:08.907489] [WARN ] [REMOTE ] FVR: No data returned for month 2025-10 [2025-10-09T19:04:08.907896] [FATAL] [REMOTE ] FVR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:04:08.908397] [FATAL] [MAIN ] FVR: Failed to fetch primary data. [2025-10-09T19:04:08.908503] [WARN ] [MAIN ] FVR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:04:08.908586] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-09T19:04:08.908743] [DEBUG] [LOCAL ] FVR: No primary data file found to delete. [2025-10-09T19:04:08.908821] [INFO ] [LOCAL ] FVR: Starting deletion of derivative data. [2025-10-09T19:04:08.909185] [DEBUG] [LOCAL ] FVR: Deleted derivative data file. [2025-10-09T19:04:08.909341] [INFO ] [MAIN ] Update Progress: 887/2373 symbols completed. FVR took 29.4s. Estimated remaining: 3h 27m 53s. Rate: 7.1 symbols/min [2025-10-09T19:04:09.157454] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:09.160776] [DEBUG] [LOCAL ] FXED: Loaded 1252 existing records from primary storage. [2025-10-09T19:04:09.160969] [INFO ] [MAIN ] FXED: Loaded 1252 existing records. [2025-10-09T19:04:09.371561] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:09.371944] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-09T19:04:09.372001] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-09T19:04:09.372203] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-09T19:04:09.372287] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-09T19:04:09.598784] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-09T19:04:09.752550] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:09.784526] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T19:04:10.396775] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-09T19:04:11.189784] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:04:11.197467] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-09T19:04:11.938884] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T19:04:11.943457] [INFO ] [REMOTE ] FUN: Full fetch complete (73028 records). [2025-10-09T19:04:11.943606] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-09T19:04:12.006783] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-09T19:04:12.345213] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-09T19:04:12.345104] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-09T19:04:12.346339] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-09T19:04:12.347292] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-09T19:04:12.347355] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-09T19:04:12.348720] [DEBUG] [LOCAL ] FUN: Trimmed 73028 records to 52165 (keeping 200 days of data) [2025-10-09T19:04:12.649711] [DEBUG] [LOCAL ] FUN: Primary data saved (52165 records). [2025-10-09T19:04:12.649854] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-09T19:04:12.651173] [INFO ] [MAIN ] Update Progress: 888/2373 symbols completed. FUN took 37.0s. Estimated remaining: 3h 27m 37s. Rate: 7.2 symbols/min [2025-10-09T19:04:12.802413] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-09T19:04:12.836525] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:12.892554] [DEBUG] [LOCAL ] G: Loaded 49981 existing records from primary storage. [2025-10-09T19:04:12.892949] [INFO ] [MAIN ] G: Loaded 49981 existing records. [2025-10-09T19:04:13.069800] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:13.070038] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-09T19:04:13.070099] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-09T19:04:13.071535] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-09T19:04:13.071596] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-09T19:04:13.382032] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T19:04:13.435892] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:13.467387] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-09T19:04:13.596677] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-09T19:04:14.396716] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-09T19:04:14.730467] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-09T19:04:15.207058] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-09T19:04:15.242108] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T19:04:15.996740] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-09T19:04:16.796743] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-09T19:04:16.893125] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T19:04:17.572676] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T19:04:17.596682] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-09T19:04:18.396768] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-09T19:04:18.894847] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-09T19:04:18.899553] [INFO ] [REMOTE ] FUBO: Full fetch complete (77771 records). [2025-10-09T19:04:18.899723] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-09T19:04:19.203741] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-09T19:04:19.323833] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-09T19:04:19.323985] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-09T19:04:19.325298] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-09T19:04:19.325429] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-09T19:04:19.360013] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T19:04:19.358273] [DEBUG] [LOCAL ] FUBO: Trimmed 77771 records to 54095 (keeping 200 days of data) [2025-10-09T19:04:19.572996] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T19:04:19.606763] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T19:04:19.735080] [DEBUG] [LOCAL ] FUBO: Primary data saved (54095 records). [2025-10-09T19:04:19.735248] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-09T19:04:19.735384] [INFO ] [MAIN ] Update Progress: 889/2373 symbols completed. FUBO took 53.6s. Estimated remaining: 3h 27m 27s. Rate: 7.2 symbols/min [2025-10-09T19:04:19.914596] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:19.947200] [DEBUG] [LOCAL ] GAB: Loaded 27641 existing records from primary storage. [2025-10-09T19:04:19.947523] [INFO ] [MAIN ] GAB: Loaded 27641 existing records. [2025-10-09T19:04:20.005117] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-09T19:04:20.134487] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:20.134766] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-09T19:04:20.134876] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-09T19:04:20.135774] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-09T19:04:20.135835] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-09T19:04:20.443966] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T19:04:20.524214] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:20.796736] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-09T19:04:21.596742] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-09T19:04:21.952034] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-09T19:04:22.396697] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-09T19:04:22.439209] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T19:04:23.196716] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-09T19:04:23.991277] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T19:04:24.001463] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-09T19:04:24.426169] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T19:04:24.438424] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T19:04:24.796737] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-09T19:04:25.596743] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-09T19:04:26.036735] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-09T19:04:26.262984] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:04:26.396792] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-09T19:04:27.196789] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-09T19:04:27.700832] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T19:04:27.996768] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-09T19:04:28.535258] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:04:28.796720] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-09T19:04:29.100131] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T19:04:29.596793] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-09T19:04:30.054622] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T19:04:30.396735] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-09T19:04:30.452164] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T19:04:31.196718] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-09T19:04:31.689004] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T19:04:31.823701] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T19:04:31.996761] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-09T19:04:32.796780] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-09T19:04:33.596764] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-09T19:04:33.625729] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T19:04:34.166386] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T19:04:34.396795] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-09T19:04:34.980160] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T19:04:35.196761] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-09T19:04:35.258266] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T19:04:35.996787] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-09T19:04:36.748969] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T19:04:36.796689] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-09T19:04:37.211243] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T19:04:37.596728] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-09T19:04:38.396684] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-09T19:04:38.468315] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T19:04:38.469208] [INFO ] [REMOTE ] FXED: Full fetch complete (1806 records). [2025-10-09T19:04:38.469325] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-09T19:04:38.752268] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-09T19:04:38.865150] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-09T19:04:38.865235] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-09T19:04:38.865323] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-09T19:04:38.865361] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-09T19:04:38.865699] [DEBUG] [LOCAL ] FXED: Trimmed 1806 records to 1259 (keeping 200 days of data) [2025-10-09T19:04:38.874034] [DEBUG] [LOCAL ] FXED: Primary data saved (1259 records). [2025-10-09T19:04:38.874092] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-09T19:04:38.874171] [INFO ] [MAIN ] Update Progress: 890/2373 symbols completed. FXED took 30.0s. Estimated remaining: 3h 27m 36s. Rate: 7.1 symbols/min [2025-10-09T19:04:39.038619] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:39.044586] [DEBUG] [LOCAL ] GAM: Loaded 4028 existing records from primary storage. [2025-10-09T19:04:39.044759] [INFO ] [MAIN ] GAM: Loaded 4028 existing records. [2025-10-09T19:04:39.197019] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-09T19:04:39.224708] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:39.224944] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-09T19:04:39.225020] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-09T19:04:39.226384] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-09T19:04:39.226443] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-09T19:04:39.585003] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:39.791829] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T19:04:39.795567] [INFO ] [REMOTE ] FVRR: Full fetch complete (59193 records). [2025-10-09T19:04:39.795700] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-09T19:04:40.004746] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-09T19:04:40.182853] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-09T19:04:40.182940] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-09T19:04:40.183882] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-09T19:04:40.183951] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-09T19:04:40.185361] [DEBUG] [LOCAL ] FVRR: Trimmed 59193 records to 40524 (keeping 200 days of data) [2025-10-09T19:04:40.439803] [DEBUG] [LOCAL ] FVRR: Primary data saved (40524 records). [2025-10-09T19:04:40.439949] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-09T19:04:40.440890] [INFO ] [MAIN ] Update Progress: 891/2373 symbols completed. FVRR took 36.2s. Estimated remaining: 3h 27m 16s. Rate: 7.2 symbols/min [2025-10-09T19:04:40.622284] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:40.675413] [DEBUG] [LOCAL ] GAP: Loaded 53652 existing records from primary storage. [2025-10-09T19:04:40.675892] [INFO ] [MAIN ] GAP: Loaded 53652 existing records. [2025-10-09T19:04:40.806000] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-09T19:04:40.813611] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T19:04:40.919605] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:40.919921] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-09T19:04:40.919977] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-09T19:04:40.921910] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-09T19:04:40.921974] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-09T19:04:41.355225] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:41.414194] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T19:04:41.596779] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-09T19:04:41.973142] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T19:04:42.396740] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-09T19:04:43.196727] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-09T19:04:43.378000] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T19:04:43.441997] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T19:04:43.644261] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T19:04:43.996720] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-09T19:04:44.796694] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-09T19:04:45.066550] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-09T19:04:45.434849] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-09T19:04:45.596728] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-09T19:04:46.396720] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-09T19:04:47.110610] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-09T19:04:47.196704] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-09T19:04:47.996718] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-09T19:04:48.114600] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T19:04:48.346492] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:04:48.348993] [INFO ] [REMOTE ] GAB: Full fetch complete (39362 records). [2025-10-09T19:04:48.349073] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-09T19:04:48.730270] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-09T19:04:48.730416] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-09T19:04:48.731352] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-09T19:04:48.731421] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-09T19:04:48.732449] [DEBUG] [LOCAL ] GAB: Trimmed 39362 records to 27889 (keeping 200 days of data) [2025-10-09T19:04:48.817626] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-09T19:04:48.897524] [DEBUG] [LOCAL ] GAB: Primary data saved (27889 records). [2025-10-09T19:04:48.897692] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-09T19:04:48.897829] [INFO ] [MAIN ] Update Progress: 892/2373 symbols completed. GAB took 29.2s. Estimated remaining: 3h 27m 8s. Rate: 7.1 symbols/min [2025-10-09T19:04:49.066407] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:49.085463] [DEBUG] [LOCAL ] GATX: Loaded 18143 existing records from primary storage. [2025-10-09T19:04:49.085758] [INFO ] [MAIN ] GATX: Loaded 18143 existing records. [2025-10-09T19:04:49.278893] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:49.279130] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-09T19:04:49.279183] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-09T19:04:49.279760] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-09T19:04:49.279819] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-09T19:04:49.600882] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-09T19:04:49.660236] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:49.775399] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T19:04:50.381783] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T19:04:50.396683] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-09T19:04:50.488597] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:04:50.493065] [INFO ] [REMOTE ] G: Full fetch complete (71768 records). [2025-10-09T19:04:50.493192] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-09T19:04:50.878483] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-09T19:04:50.878567] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-09T19:04:50.879518] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-09T19:04:50.879587] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-09T19:04:50.881002] [DEBUG] [LOCAL ] G: Trimmed 71768 records to 50363 (keeping 200 days of data) [2025-10-09T19:04:51.197132] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-09T19:04:51.201099] [DEBUG] [LOCAL ] G: Primary data saved (50363 records). [2025-10-09T19:04:51.201274] [INFO ] [MAIN ] G: Full history saved. [2025-10-09T19:04:51.202219] [INFO ] [MAIN ] Update Progress: 893/2373 symbols completed. G took 38.6s. Estimated remaining: 3h 26m 50s. Rate: 7.2 symbols/min [2025-10-09T19:04:51.382293] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:04:51.397412] [DEBUG] [LOCAL ] GBAB: Loaded 13043 existing records from primary storage. [2025-10-09T19:04:51.397673] [INFO ] [MAIN ] GBAB: Loaded 13043 existing records. [2025-10-09T19:04:51.520586] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T19:04:51.591945] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:04:51.592159] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-09T19:04:51.592207] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-09T19:04:51.592706] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-09T19:04:51.592765] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-09T19:04:51.948249] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:04:51.996668] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-09T19:04:52.796710] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-09T19:04:52.986732] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T19:04:53.068170] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T19:04:53.406939] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T19:04:53.596719] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-09T19:04:54.396699] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-09T19:04:54.617452] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:04:55.196754] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-09T19:04:55.226627] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-09T19:04:55.996701] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-09T19:04:56.095995] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T19:04:56.796755] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-09T19:04:56.952114] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T19:04:57.565007] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T19:04:57.596676] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-09T19:04:58.172344] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-09T19:04:58.396758] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-09T19:04:59.196778] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-09T19:04:59.854688] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T19:04:59.996745] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-09T19:05:00.289541] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T19:05:00.593055] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T19:05:00.796802] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-09T19:05:01.366557] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T19:05:01.596744] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-09T19:05:02.396722] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-09T19:05:02.656637] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T19:05:02.761028] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T19:05:03.196702] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-09T19:05:03.996814] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-09T19:05:04.767032] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-09T19:05:04.796753] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-09T19:05:04.978138] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T19:05:05.596682] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-09T19:05:05.931263] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:05:06.236237] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T19:05:06.237137] [INFO ] [REMOTE ] GAM: Full fetch complete (6592 records). [2025-10-09T19:05:06.237204] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-09T19:05:06.401980] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-09T19:05:06.604752] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-09T19:05:06.604831] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-09T19:05:06.605009] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-09T19:05:06.605047] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-09T19:05:06.605440] [DEBUG] [LOCAL ] GAM: Trimmed 6592 records to 4058 (keeping 200 days of data) [2025-10-09T19:05:06.633734] [DEBUG] [LOCAL ] GAM: Primary data saved (4058 records). [2025-10-09T19:05:06.633947] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-09T19:05:06.634038] [INFO ] [MAIN ] Update Progress: 894/2373 symbols completed. GAM took 27.8s. Estimated remaining: 3h 26m 53s. Rate: 7.1 symbols/min [2025-10-09T19:05:06.798886] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:06.840505] [DEBUG] [LOCAL ] GBCI: Loaded 40512 existing records from primary storage. [2025-10-09T19:05:06.840826] [INFO ] [MAIN ] GBCI: Loaded 40512 existing records. [2025-10-09T19:05:07.012816] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:07.013096] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-09T19:05:07.013141] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-09T19:05:07.014555] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-09T19:05:07.014615] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-09T19:05:07.202503] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-09T19:05:07.380008] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:07.423302] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:05:07.996722] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-09T19:05:08.796737] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-09T19:05:09.167636] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-09T19:05:09.325003] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-09T19:05:09.446602] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T19:05:09.596723] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-09T19:05:10.396729] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-09T19:05:11.040176] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T19:05:11.196694] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-09T19:05:11.363987] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T19:05:11.996782] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-09T19:05:12.641433] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T19:05:12.688293] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-09T19:05:12.796717] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-09T19:05:13.596796] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-09T19:05:14.396689] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-09T19:05:14.624851] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T19:05:14.756452] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-09T19:05:15.196689] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-09T19:05:15.281226] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-09T19:05:15.996776] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-09T19:05:16.489774] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T19:05:16.796686] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-09T19:05:17.137520] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:05:17.596737] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-09T19:05:17.620246] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T19:05:18.396801] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-09T19:05:18.529294] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T19:05:19.146978] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T19:05:19.148521] [INFO ] [REMOTE ] GBAB: Full fetch complete (19373 records). [2025-10-09T19:05:19.148597] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-09T19:05:19.204823] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-09T19:05:19.579512] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-09T19:05:19.580012] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-09T19:05:19.580557] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-09T19:05:19.580683] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-09T19:05:19.581744] [DEBUG] [LOCAL ] GBAB: Trimmed 19373 records to 13099 (keeping 200 days of data) [2025-10-09T19:05:19.669446] [DEBUG] [LOCAL ] GBAB: Primary data saved (13099 records). [2025-10-09T19:05:19.669598] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-09T19:05:19.669715] [INFO ] [MAIN ] Update Progress: 895/2373 symbols completed. GBAB took 28.5s. Estimated remaining: 3h 26m 52s. Rate: 7.1 symbols/min [2025-10-09T19:05:19.845950] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:19.846135] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-09T19:05:19.846173] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-09T19:05:19.846293] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-09T19:05:19.846337] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-09T19:05:19.846379] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-09T19:05:19.846414] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-09T19:05:20.007801] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-09T19:05:20.234554] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:20.334239] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:05:20.796764] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-09T19:05:21.596777] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-09T19:05:21.709481] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T19:05:21.709326] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T19:05:21.722190] [INFO ] [REMOTE ] GATX: Full fetch complete (25019 records). [2025-10-09T19:05:21.722463] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-09T19:05:22.085362] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-09T19:05:22.085444] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-09T19:05:22.085921] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-09T19:05:22.085984] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-09T19:05:22.086601] [DEBUG] [LOCAL ] GATX: Trimmed 25019 records to 18233 (keeping 200 days of data) [2025-10-09T19:05:22.200130] [DEBUG] [LOCAL ] GATX: Primary data saved (18233 records). [2025-10-09T19:05:22.200274] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-09T19:05:22.200355] [INFO ] [MAIN ] Update Progress: 896/2373 symbols completed. GATX took 33.3s. Estimated remaining: 3h 26m 34s. Rate: 7.2 symbols/min [2025-10-09T19:05:22.373592] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:22.399136] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-09T19:05:22.417537] [DEBUG] [LOCAL ] GBTG: Loaded 40036 existing records from primary storage. [2025-10-09T19:05:22.417877] [INFO ] [MAIN ] GBTG: Loaded 40036 existing records. [2025-10-09T19:05:22.594410] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:22.594669] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-09T19:05:22.594743] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-09T19:05:22.595960] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-09T19:05:22.596024] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-09T19:05:22.967178] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:22.990306] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T19:05:23.161161] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T19:05:23.196677] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-09T19:05:23.996722] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-09T19:05:24.326304] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:05:24.796779] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-09T19:05:25.596729] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-09T19:05:26.093983] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T19:05:26.218106] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-09T19:05:26.396702] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-09T19:05:26.620848] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:05:27.196723] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-09T19:05:27.715879] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T19:05:27.996761] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-09T19:05:28.677356] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T19:05:28.796796] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-09T19:05:29.317295] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T19:05:29.596727] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-09T19:05:29.908443] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-09T19:05:30.244768] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T19:05:30.396720] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-09T19:05:30.641073] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-09T19:05:31.196746] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-09T19:05:31.996753] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-09T19:05:32.741371] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T19:05:32.796676] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-09T19:05:33.596744] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-09T19:05:33.806530] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-09T19:05:33.811171] [INFO ] [REMOTE ] GAP: Full fetch complete (77632 records). [2025-10-09T19:05:33.811283] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-09T19:05:34.214002] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-09T19:05:34.222307] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-09T19:05:34.236771] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-09T19:05:34.237410] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-09T19:05:34.238376] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T19:05:34.248841] [DEBUG] [LOCAL ] GAP: Trimmed 77632 records to 54042 (keeping 200 days of data) [2025-10-09T19:05:34.432745] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-09T19:05:34.592437] [DEBUG] [LOCAL ] GAP: Primary data saved (54042 records). [2025-10-09T19:05:34.592572] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-09T19:05:34.593204] [INFO ] [MAIN ] Update Progress: 897/2373 symbols completed. GAP took 54.2s. Estimated remaining: 3h 26m 32s. Rate: 7.1 symbols/min [2025-10-09T19:05:34.761620] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:34.790039] [DEBUG] [LOCAL ] GBX: Loaded 29122 existing records from primary storage. [2025-10-09T19:05:34.790310] [INFO ] [MAIN ] GBX: Loaded 29122 existing records. [2025-10-09T19:05:34.971217] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:34.971446] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-09T19:05:34.971600] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-09T19:05:34.972731] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-09T19:05:34.972792] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-09T19:05:35.074731] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T19:05:35.201817] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-09T19:05:35.254695] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:05:35.382856] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:35.996734] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-09T19:05:36.796755] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-09T19:05:36.844171] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T19:05:37.581246] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T19:05:37.604406] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-09T19:05:37.606620] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T19:05:38.047295] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T19:05:38.396728] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-09T19:05:38.695151] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-09T19:05:39.196732] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-09T19:05:39.996719] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-09T19:05:40.766762] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T19:05:40.796668] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-09T19:05:41.107931] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T19:05:41.596698] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-09T19:05:41.816764] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T19:05:42.396775] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-09T19:05:43.174235] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T19:05:43.196696] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-09T19:05:43.812072] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T19:05:43.816833] [INFO ] [REMOTE ] GBCI: Full fetch complete (58552 records). [2025-10-09T19:05:43.816950] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-09T19:05:44.002386] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-09T19:05:44.226378] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-09T19:05:44.226461] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-09T19:05:44.227296] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-09T19:05:44.227361] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-09T19:05:44.228556] [DEBUG] [LOCAL ] GBCI: Trimmed 58552 records to 40822 (keeping 200 days of data) [2025-10-09T19:05:44.355245] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T19:05:44.498176] [DEBUG] [LOCAL ] GBCI: Primary data saved (40822 records). [2025-10-09T19:05:44.498313] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-09T19:05:44.498406] [INFO ] [MAIN ] Update Progress: 898/2373 symbols completed. GBCI took 37.9s. Estimated remaining: 3h 26m 26s. Rate: 7.1 symbols/min [2025-10-09T19:05:44.649464] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T19:05:44.700935] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:44.740848] [DEBUG] [LOCAL ] GCI: Loaded 44080 existing records from primary storage. [2025-10-09T19:05:44.741170] [INFO ] [MAIN ] GCI: Loaded 44080 existing records. [2025-10-09T19:05:44.802036] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-09T19:05:44.920850] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:44.921069] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-09T19:05:44.921119] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-09T19:05:44.922387] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-09T19:05:44.922447] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-09T19:05:45.313719] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:45.596727] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-09T19:05:46.217348] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T19:05:46.396700] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-09T19:05:47.050831] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T19:05:47.196722] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-09T19:05:47.793939] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T19:05:47.996745] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-09T19:05:48.730217] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T19:05:48.796664] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-09T19:05:49.248179] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T19:05:49.251771] [INFO ] [REMOTE ] GBTG: Full fetch complete (56426 records). [2025-10-09T19:05:49.251880] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-09T19:05:49.598505] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-09T19:05:49.644271] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-09T19:05:49.644354] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-09T19:05:49.645258] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-09T19:05:49.645326] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-09T19:05:49.646557] [DEBUG] [LOCAL ] GBTG: Trimmed 56426 records to 40278 (keeping 200 days of data) [2025-10-09T19:05:49.872822] [DEBUG] [LOCAL ] GBTG: Primary data saved (40278 records). [2025-10-09T19:05:49.872952] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-09T19:05:49.873032] [INFO ] [MAIN ] Update Progress: 899/2373 symbols completed. GBTG took 27.7s. Estimated remaining: 3h 26m 13s. Rate: 7.1 symbols/min [2025-10-09T19:05:50.017599] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T19:05:50.073320] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:50.095751] [DEBUG] [LOCAL ] GCO: Loaded 24065 existing records from primary storage. [2025-10-09T19:05:50.095974] [INFO ] [MAIN ] GCO: Loaded 24065 existing records. [2025-10-09T19:05:50.286288] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:50.286507] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-09T19:05:50.286560] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-09T19:05:50.286788] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-09T19:05:50.286849] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-09T19:05:50.401883] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-09T19:05:50.667152] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:50.914149] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-09T19:05:51.001097] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:05:51.196724] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-09T19:05:51.996732] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-09T19:05:52.443419] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-09T19:05:52.592195] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T19:05:52.796723] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-09T19:05:53.596717] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-09T19:05:54.302080] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T19:05:54.396698] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-09T19:05:54.478895] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T19:05:55.196729] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-09T19:05:55.996740] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-09T19:05:56.045586] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T19:05:56.389372] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-09T19:05:56.406689] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T19:05:56.796771] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-09T19:05:57.235978] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T19:05:57.236669] [INFO ] [REMOTE ] GBLI: Full fetch complete (1309 records). [2025-10-09T19:05:57.236743] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-09T19:05:57.413992] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-09T19:05:57.414184] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:05:57.414274] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:05:57.414347] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-09T19:05:57.414411] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-09T19:05:57.414458] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-09T19:05:57.414526] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-09T19:05:57.414583] [INFO ] [MAIN ] Update Progress: 900/2373 symbols completed. GBLI took 37.7s. Estimated remaining: 3h 26m 3s. Rate: 7.1 symbols/min [2025-10-09T19:05:57.593443] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:05:57.596688] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-09T19:05:57.616240] [DEBUG] [LOCAL ] GCTS: Loaded 20353 existing records from primary storage. [2025-10-09T19:05:57.616469] [INFO ] [MAIN ] GCTS: Loaded 20353 existing records. [2025-10-09T19:05:57.793464] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:05:57.793692] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-09T19:05:57.793750] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-09T19:05:57.793961] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-09T19:05:57.794018] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-09T19:05:58.146260] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:05:58.396748] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-09T19:05:59.140582] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T19:05:59.196714] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-09T19:05:59.471414] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T19:05:59.996772] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-09T19:06:00.746697] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:06:00.796688] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-09T19:06:01.197119] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T19:06:01.596723] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-09T19:06:02.038885] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T19:06:02.396721] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-09T19:06:02.753313] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-09T19:06:03.196728] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-09T19:06:03.618084] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T19:06:03.996689] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-09T19:06:04.359029] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T19:06:04.796740] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-09T19:06:04.997212] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-09T19:06:05.596724] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-09T19:06:06.248563] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-09T19:06:06.319197] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T19:06:06.396717] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-09T19:06:07.196771] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-09T19:06:07.843505] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:06:07.847354] [INFO ] [REMOTE ] GCI: Full fetch complete (63233 records). [2025-10-09T19:06:07.847465] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-09T19:06:07.999053] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-09T19:06:08.250218] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-09T19:06:08.250376] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-09T19:06:08.251755] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-09T19:06:08.251839] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-09T19:06:08.253486] [DEBUG] [LOCAL ] GCI: Trimmed 63233 records to 44365 (keeping 200 days of data) [2025-10-09T19:06:08.369204] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T19:06:08.524832] [DEBUG] [LOCAL ] GCI: Primary data saved (44365 records). [2025-10-09T19:06:08.524975] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-09T19:06:08.525090] [INFO ] [MAIN ] Update Progress: 901/2373 symbols completed. GCI took 24.0s. Estimated remaining: 3h 25m 59s. Rate: 7.1 symbols/min [2025-10-09T19:06:08.699605] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:08.708875] [DEBUG] [LOCAL ] GCV: Loaded 7565 existing records from primary storage. [2025-10-09T19:06:08.709108] [INFO ] [MAIN ] GCV: Loaded 7565 existing records. [2025-10-09T19:06:08.801840] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-09T19:06:08.892821] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:08.893106] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-09T19:06:08.893152] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-09T19:06:08.893322] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-09T19:06:08.893378] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-09T19:06:09.201044] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T19:06:09.250198] [INFO ] [REMOTE ] GBX: Full fetch complete (42706 records). [2025-10-09T19:06:09.276203] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-09T19:06:09.280897] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:09.600346] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T19:06:09.600411] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-09T19:06:09.684715] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-09T19:06:09.684796] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-09T19:06:09.685449] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-09T19:06:09.685489] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-09T19:06:09.686474] [DEBUG] [LOCAL ] GBX: Trimmed 42706 records to 29325 (keeping 200 days of data) [2025-10-09T19:06:09.866242] [DEBUG] [LOCAL ] GBX: Primary data saved (29325 records). [2025-10-09T19:06:09.866379] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-09T19:06:09.866866] [INFO ] [MAIN ] Update Progress: 902/2373 symbols completed. GBX took 35.3s. Estimated remaining: 3h 25m 39s. Rate: 7.2 symbols/min [2025-10-09T19:06:10.043298] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:10.087809] [DEBUG] [LOCAL ] GD: Loaded 46879 existing records from primary storage. [2025-10-09T19:06:10.088117] [INFO ] [MAIN ] GD: Loaded 46879 existing records. [2025-10-09T19:06:10.274557] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:10.274875] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-09T19:06:10.274936] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-09T19:06:10.276486] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-09T19:06:10.276553] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-09T19:06:10.401837] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-09T19:06:10.645980] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T19:06:10.766932] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:11.196806] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-09T19:06:11.496284] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T19:06:11.996779] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-09T19:06:12.796683] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-09T19:06:12.958478] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T19:06:13.107182] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-09T19:06:13.397784] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-09T19:06:13.596755] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-09T19:06:14.036696] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T19:06:14.396745] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-09T19:06:15.082363] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T19:06:15.196696] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-09T19:06:15.996776] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-09T19:06:16.673121] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T19:06:16.796751] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-09T19:06:17.596720] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-09T19:06:17.810706] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T19:06:18.373000] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T19:06:18.396668] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-09T19:06:18.733514] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T19:06:19.196719] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-09T19:06:19.232639] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-09T19:06:19.996759] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-09T19:06:20.030776] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T19:06:20.796691] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-09T19:06:21.248141] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:06:21.596725] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-09T19:06:22.258801] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T19:06:22.273248] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-09T19:06:22.396685] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-09T19:06:23.181685] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T19:06:23.196669] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-09T19:06:23.996696] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-09T19:06:24.197804] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T19:06:24.620633] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T19:06:24.796722] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-09T19:06:25.596699] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-09T19:06:25.858770] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T19:06:26.396760] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-09T19:06:26.500290] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T19:06:27.112084] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T19:06:27.196793] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-09T19:06:27.996765] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-09T19:06:28.332550] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T19:06:28.334683] [INFO ] [REMOTE ] GCTS: Full fetch complete (26993 records). [2025-10-09T19:06:28.334756] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-09T19:06:28.600308] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-09T19:06:28.723130] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-09T19:06:28.723221] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-09T19:06:28.723813] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-09T19:06:28.723876] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-09T19:06:28.724532] [DEBUG] [LOCAL ] GCTS: Trimmed 26993 records to 20474 (keeping 200 days of data) [2025-10-09T19:06:28.805803] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-09T19:06:28.845546] [DEBUG] [LOCAL ] GCTS: Primary data saved (20474 records). [2025-10-09T19:06:28.845704] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-09T19:06:28.845794] [INFO ] [MAIN ] Update Progress: 903/2373 symbols completed. GCTS took 31.4s. Estimated remaining: 3h 25m 48s. Rate: 7.1 symbols/min [2025-10-09T19:06:29.017685] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:29.065889] [DEBUG] [LOCAL ] GDDY: Loaded 49785 existing records from primary storage. [2025-10-09T19:06:29.066210] [INFO ] [MAIN ] GDDY: Loaded 49785 existing records. [2025-10-09T19:06:29.246901] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:29.247153] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-09T19:06:29.247208] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-09T19:06:29.247419] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-09T19:06:29.247477] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-09T19:06:29.603006] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-09T19:06:29.626937] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:29.862834] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-09T19:06:30.396736] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-09T19:06:30.990692] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T19:06:31.196825] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-09T19:06:31.412164] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-09T19:06:31.996738] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-09T19:06:32.796692] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-09T19:06:32.908614] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T19:06:33.596692] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-09T19:06:33.759619] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T19:06:33.759948] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T19:06:34.396765] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-09T19:06:35.196780] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-09T19:06:35.260877] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T19:06:35.262613] [INFO ] [REMOTE ] GCV: Full fetch complete (9619 records). [2025-10-09T19:06:35.262745] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-09T19:06:35.479248] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T19:06:35.678749] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-09T19:06:35.678840] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-09T19:06:35.679157] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-09T19:06:35.679220] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-09T19:06:35.679713] [DEBUG] [LOCAL ] GCV: Trimmed 9619 records to 7653 (keeping 200 days of data) [2025-10-09T19:06:35.724217] [DEBUG] [LOCAL ] GCV: Primary data saved (7653 records). [2025-10-09T19:06:35.724340] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-09T19:06:35.724436] [INFO ] [MAIN ] Update Progress: 904/2373 symbols completed. GCV took 27.2s. Estimated remaining: 3h 25m 37s. Rate: 7.1 symbols/min [2025-10-09T19:06:35.893609] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:35.898622] [DEBUG] [LOCAL ] GDIV: Loaded 3609 existing records from primary storage. [2025-10-09T19:06:35.898791] [INFO ] [MAIN ] GDIV: Loaded 3609 existing records. [2025-10-09T19:06:35.996770] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-09T19:06:36.074440] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:36.074662] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-09T19:06:36.074724] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-09T19:06:36.075025] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-09T19:06:36.075084] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-09T19:06:36.448116] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:36.668049] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T19:06:36.796723] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-09T19:06:37.557438] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:06:37.596684] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-09T19:06:38.321937] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:06:38.396735] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-09T19:06:38.505147] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T19:06:38.506958] [INFO ] [REMOTE ] GCO: Full fetch complete (35222 records). [2025-10-09T19:06:38.507028] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-09T19:06:38.876953] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-09T19:06:38.877032] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-09T19:06:38.877702] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-09T19:06:38.877827] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-09T19:06:38.878631] [DEBUG] [LOCAL ] GCO: Trimmed 35222 records to 24160 (keeping 200 days of data) [2025-10-09T19:06:39.017587] [DEBUG] [LOCAL ] GCO: Primary data saved (24160 records). [2025-10-09T19:06:39.017762] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-09T19:06:39.017865] [INFO ] [MAIN ] Update Progress: 905/2373 symbols completed. GCO took 49.1s. Estimated remaining: 3h 25m 21s. Rate: 7.1 symbols/min [2025-10-09T19:06:39.184900] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:39.189368] [DEBUG] [LOCAL ] GDL: Loaded 2553 existing records from primary storage. [2025-10-09T19:06:39.189543] [INFO ] [MAIN ] GDL: Loaded 2553 existing records. [2025-10-09T19:06:39.201962] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-09T19:06:39.365704] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:39.365907] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-09T19:06:39.365953] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-09T19:06:39.366174] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-09T19:06:39.366240] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-09T19:06:39.716067] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:39.996725] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-09T19:06:40.026000] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T19:06:40.383098] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-09T19:06:40.796750] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-09T19:06:40.993497] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T19:06:41.242797] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T19:06:41.596722] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-09T19:06:41.994262] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-09T19:06:42.396734] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-09T19:06:43.196735] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-09T19:06:43.483810] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-09T19:06:43.996729] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-09T19:06:44.061474] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:06:44.796761] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-09T19:06:45.376545] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T19:06:45.408437] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T19:06:45.596749] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-09T19:06:46.396716] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-09T19:06:46.849152] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-09T19:06:47.185994] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T19:06:47.196692] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-09T19:06:47.996775] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-09T19:06:48.476282] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T19:06:48.796688] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-09T19:06:48.909332] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T19:06:49.350123] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T19:06:49.596757] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-09T19:06:50.197842] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T19:06:50.396824] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-09T19:06:50.824234] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-09T19:06:51.196727] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-09T19:06:51.530528] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T19:06:51.996719] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-09T19:06:52.478415] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T19:06:52.796734] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-09T19:06:53.255007] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T19:06:53.596727] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-09T19:06:54.165892] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T19:06:54.396725] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-09T19:06:54.923493] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-09T19:06:55.196741] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-09T19:06:55.701852] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T19:06:55.702991] [INFO ] [REMOTE ] GDL: Full fetch complete (3555 records). [2025-10-09T19:06:55.703080] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-09T19:06:56.002002] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-09T19:06:56.075260] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-09T19:06:56.075339] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-09T19:06:56.075475] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-09T19:06:56.075516] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-09T19:06:56.075909] [DEBUG] [LOCAL ] GDL: Trimmed 3555 records to 2566 (keeping 200 days of data) [2025-10-09T19:06:56.091680] [DEBUG] [LOCAL ] GDL: Primary data saved (2566 records). [2025-10-09T19:06:56.091760] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-09T19:06:56.091836] [INFO ] [MAIN ] Update Progress: 906/2373 symbols completed. GDL took 17.1s. Estimated remaining: 3h 25m 26s. Rate: 7.1 symbols/min [2025-10-09T19:06:56.256631] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:06:56.264232] [DEBUG] [LOCAL ] GDO: Loaded 5927 existing records from primary storage. [2025-10-09T19:06:56.264423] [INFO ] [MAIN ] GDO: Loaded 5927 existing records. [2025-10-09T19:06:56.437541] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:06:56.437808] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-09T19:06:56.437869] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-09T19:06:56.438241] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-09T19:06:56.438300] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-09T19:06:56.793025] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:06:56.796662] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-09T19:06:56.819500] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T19:06:57.596692] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-09T19:06:57.617107] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T19:06:58.396771] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-09T19:06:59.089245] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T19:06:59.196808] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-09T19:06:59.243619] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T19:06:59.752165] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T19:06:59.996699] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-09T19:07:00.581969] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T19:07:00.796784] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-09T19:07:01.141047] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-09T19:07:01.596732] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-09T19:07:02.214256] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-09T19:07:02.396766] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-09T19:07:02.865235] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-09T19:07:02.866340] [INFO ] [REMOTE ] GDIV: Full fetch complete (5467 records). [2025-10-09T19:07:02.866430] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-09T19:07:03.202045] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-09T19:07:03.455358] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-09T19:07:03.455488] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-09T19:07:03.455848] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-09T19:07:03.455932] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-09T19:07:03.456800] [DEBUG] [LOCAL ] GDIV: Trimmed 5467 records to 3625 (keeping 200 days of data) [2025-10-09T19:07:03.492162] [DEBUG] [LOCAL ] GDIV: Primary data saved (3625 records). [2025-10-09T19:07:03.492353] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-09T19:07:03.492476] [INFO ] [MAIN ] Update Progress: 907/2373 symbols completed. GDIV took 27.8s. Estimated remaining: 3h 25m 16s. Rate: 7.1 symbols/min [2025-10-09T19:07:03.756413] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:03.811028] [DEBUG] [LOCAL ] GDOT: Loaded 37785 existing records from primary storage. [2025-10-09T19:07:03.811517] [INFO ] [MAIN ] GDOT: Loaded 37785 existing records. [2025-10-09T19:07:04.010403] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-09T19:07:04.016255] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:04.017779] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-09T19:07:04.017847] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-09T19:07:04.018844] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-09T19:07:04.018908] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-09T19:07:04.420573] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:04.605927] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T19:07:04.796689] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-09T19:07:04.851298] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T19:07:04.855104] [INFO ] [REMOTE ] GD: Full fetch complete (69889 records). [2025-10-09T19:07:04.855213] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-09T19:07:05.250419] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-09T19:07:05.250503] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-09T19:07:05.251410] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-09T19:07:05.251475] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-09T19:07:05.252810] [DEBUG] [LOCAL ] GD: Trimmed 69889 records to 47158 (keeping 200 days of data) [2025-10-09T19:07:05.473615] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T19:07:05.559748] [DEBUG] [LOCAL ] GD: Primary data saved (47158 records). [2025-10-09T19:07:05.559891] [INFO ] [MAIN ] GD: Full history saved. [2025-10-09T19:07:05.560607] [INFO ] [MAIN ] Update Progress: 908/2373 symbols completed. GD took 55.7s. Estimated remaining: 3h 24m 58s. Rate: 7.1 symbols/min [2025-10-09T19:07:05.601803] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-09T19:07:05.738029] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:05.758692] [DEBUG] [LOCAL ] GDV: Loaded 19517 existing records from primary storage. [2025-10-09T19:07:05.758969] [INFO ] [MAIN ] GDV: Loaded 19517 existing records. [2025-10-09T19:07:05.943862] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:05.944107] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-09T19:07:05.944173] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-09T19:07:05.945164] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-09T19:07:05.945245] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-09T19:07:06.317021] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:06.364347] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:07:06.396763] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-09T19:07:07.196732] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-09T19:07:07.788425] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:07:07.996733] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-09T19:07:08.763695] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T19:07:08.796711] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-09T19:07:08.817788] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T19:07:09.434832] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-09T19:07:09.596767] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-09T19:07:10.053585] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T19:07:10.396723] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-09T19:07:11.196740] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-09T19:07:11.797331] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:07:11.996723] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-09T19:07:12.796707] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-09T19:07:12.969218] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T19:07:13.167483] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T19:07:13.442425] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T19:07:13.596724] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-09T19:07:14.082741] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T19:07:14.396790] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-09T19:07:15.196687] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-09T19:07:15.409413] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:07:15.996784] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-09T19:07:16.796736] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-09T19:07:16.976844] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:07:17.545494] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:07:17.594926] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T19:07:17.598724] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-09T19:07:18.396833] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-09T19:07:19.052922] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T19:07:19.196681] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-09T19:07:19.440297] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-09T19:07:19.996749] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-09T19:07:20.524150] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T19:07:20.524449] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T19:07:20.796727] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-09T19:07:21.596708] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-09T19:07:22.226590] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T19:07:22.227808] [INFO ] [REMOTE ] GDO: Full fetch complete (8698 records). [2025-10-09T19:07:22.227879] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-09T19:07:22.404186] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-09T19:07:22.620379] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T19:07:22.638450] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-09T19:07:22.638628] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-09T19:07:22.639129] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-09T19:07:22.639294] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-09T19:07:22.640219] [DEBUG] [LOCAL ] GDO: Trimmed 8698 records to 5961 (keeping 200 days of data) [2025-10-09T19:07:22.676235] [DEBUG] [LOCAL ] GDO: Primary data saved (5961 records). [2025-10-09T19:07:22.676311] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-09T19:07:22.676388] [INFO ] [MAIN ] Update Progress: 909/2373 symbols completed. GDO took 26.6s. Estimated remaining: 3h 25m 3s. Rate: 7.1 symbols/min [2025-10-09T19:07:22.842948] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:22.894205] [DEBUG] [LOCAL ] GE: Loaded 53706 existing records from primary storage. [2025-10-09T19:07:22.894537] [INFO ] [MAIN ] GE: Loaded 53706 existing records. [2025-10-09T19:07:23.074213] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:23.074431] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-09T19:07:23.074489] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-09T19:07:23.075942] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-09T19:07:23.076018] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-09T19:07:23.201875] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-09T19:07:23.428258] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:23.621029] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T19:07:23.996726] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-09T19:07:24.796690] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-09T19:07:25.150871] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-09T19:07:25.155228] [INFO ] [REMOTE ] GDDY: Full fetch complete (71783 records). [2025-10-09T19:07:25.155341] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-09T19:07:25.543201] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-09T19:07:25.543280] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-09T19:07:25.544187] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-09T19:07:25.544253] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-09T19:07:25.545606] [DEBUG] [LOCAL ] GDDY: Trimmed 71783 records to 50152 (keeping 200 days of data) [2025-10-09T19:07:25.598277] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-09T19:07:25.860879] [DEBUG] [LOCAL ] GDDY: Primary data saved (50152 records). [2025-10-09T19:07:25.861222] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-09T19:07:25.862279] [INFO ] [MAIN ] Update Progress: 910/2373 symbols completed. GDDY took 57.0s. Estimated remaining: 3h 24m 46s. Rate: 7.1 symbols/min [2025-10-09T19:07:26.066001] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:26.069163] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-09T19:07:26.098436] [DEBUG] [LOCAL ] GEF: Loaded 20665 existing records from primary storage. [2025-10-09T19:07:26.098720] [INFO ] [MAIN ] GEF: Loaded 20665 existing records. [2025-10-09T19:07:26.277208] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:26.277572] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-09T19:07:26.277827] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-09T19:07:26.286450] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-09T19:07:26.299539] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-09T19:07:26.401007] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T19:07:26.401196] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-09T19:07:26.672180] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:26.883328] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:07:27.196724] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-09T19:07:27.996684] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-09T19:07:28.321750] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:07:28.558454] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-09T19:07:28.796747] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-09T19:07:29.001794] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T19:07:29.596707] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-09T19:07:30.396704] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-09T19:07:30.628696] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T19:07:30.782503] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-09T19:07:31.196801] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-09T19:07:31.487183] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-09T19:07:31.996716] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-09T19:07:32.782425] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T19:07:32.796672] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-09T19:07:32.908244] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T19:07:33.596735] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-09T19:07:34.297618] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T19:07:34.359044] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-09T19:07:34.396672] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-09T19:07:35.196698] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-09T19:07:35.468900] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T19:07:35.996718] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-09T19:07:36.796695] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-09T19:07:36.897270] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T19:07:37.041121] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T19:07:37.596692] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-09T19:07:37.653214] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-09T19:07:38.396776] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-09T19:07:39.196755] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-09T19:07:39.378682] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T19:07:39.612278] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-09T19:07:39.971615] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T19:07:39.996666] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-09T19:07:40.796766] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-09T19:07:41.221394] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T19:07:41.596722] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-09T19:07:42.362180] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T19:07:42.366352] [INFO ] [REMOTE ] GDOT: Full fetch complete (53126 records). [2025-10-09T19:07:42.366483] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-09T19:07:42.407990] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-09T19:07:42.528040] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T19:07:42.810372] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-09T19:07:42.810459] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-09T19:07:42.811208] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-09T19:07:42.811272] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-09T19:07:42.812331] [DEBUG] [LOCAL ] GDOT: Trimmed 53126 records to 38054 (keeping 200 days of data) [2025-10-09T19:07:43.029599] [DEBUG] [LOCAL ] GDOT: Primary data saved (38054 records). [2025-10-09T19:07:43.029765] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-09T19:07:43.029857] [INFO ] [MAIN ] Update Progress: 911/2373 symbols completed. GDOT took 39.5s. Estimated remaining: 3h 24m 52s. Rate: 7.1 symbols/min [2025-10-09T19:07:43.201521] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-09T19:07:43.201443] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:43.202673] [DEBUG] [LOCAL ] GEL: No existing data file found in primary storage. [2025-10-09T19:07:43.202740] [WARN ] [MAIN ] GEL: No existing data found, performing full refresh instead. [2025-10-09T19:07:43.202894] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-09T19:07:43.202965] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-09T19:07:43.203042] [DEBUG] [LOCAL ] GEL: No primary data file found to delete. [2025-10-09T19:07:43.203098] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-09T19:07:43.568914] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:43.996692] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-09T19:07:44.406563] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T19:07:44.671167] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-09T19:07:44.785942] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T19:07:44.796669] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-09T19:07:45.596696] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-09T19:07:45.642043] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T19:07:45.644019] [INFO ] [REMOTE ] GDV: Full fetch complete (28467 records). [2025-10-09T19:07:45.644089] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-09T19:07:46.010551] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-09T19:07:46.010764] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-09T19:07:46.011315] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-09T19:07:46.011357] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-09T19:07:46.012048] [DEBUG] [LOCAL ] GDV: Trimmed 28467 records to 19701 (keeping 200 days of data) [2025-10-09T19:07:46.132322] [DEBUG] [LOCAL ] GDV: Primary data saved (19701 records). [2025-10-09T19:07:46.132463] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-09T19:07:46.132544] [INFO ] [MAIN ] Update Progress: 912/2373 symbols completed. GDV took 40.6s. Estimated remaining: 3h 24m 35s. Rate: 7.1 symbols/min [2025-10-09T19:07:46.296292] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:46.349243] [DEBUG] [LOCAL ] GENI: Loaded 52944 existing records from primary storage. [2025-10-09T19:07:46.349624] [INFO ] [MAIN ] GENI: Loaded 52944 existing records. [2025-10-09T19:07:46.402195] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-09T19:07:46.525060] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:46.525283] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-09T19:07:46.525331] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-09T19:07:46.526987] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-09T19:07:46.527050] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-09T19:07:46.873226] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:47.196738] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-09T19:07:47.442438] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-09T19:07:47.613442] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T19:07:47.996682] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-09T19:07:48.296466] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T19:07:48.298689] [INFO ] [REMOTE ] GEF: Full fetch complete (29335 records). [2025-10-09T19:07:48.298765] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-09T19:07:48.678014] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-09T19:07:48.678086] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-09T19:07:48.678661] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-09T19:07:48.678724] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-09T19:07:48.679371] [DEBUG] [LOCAL ] GEF: Trimmed 29335 records to 20821 (keeping 200 days of data) [2025-10-09T19:07:48.796791] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-09T19:07:48.820246] [DEBUG] [LOCAL ] GEF: Primary data saved (20821 records). [2025-10-09T19:07:48.820366] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-09T19:07:48.820444] [INFO ] [MAIN ] Update Progress: 913/2373 symbols completed. GEF took 23.0s. Estimated remaining: 3h 24m 18s. Rate: 7.1 symbols/min [2025-10-09T19:07:48.991483] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:07:49.044275] [DEBUG] [LOCAL ] GEO: Loaded 51887 existing records from primary storage. [2025-10-09T19:07:49.044614] [INFO ] [MAIN ] GEO: Loaded 51887 existing records. [2025-10-09T19:07:49.228136] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:07:49.245325] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-09T19:07:49.245455] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-09T19:07:49.246806] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:07:49.253322] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-09T19:07:49.253509] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-09T19:07:49.609362] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:07:49.603769] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-09T19:07:50.396717] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-09T19:07:50.562827] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T19:07:51.196756] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-09T19:07:51.270565] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-09T19:07:51.943425] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-09T19:07:51.996685] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-09T19:07:52.761114] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T19:07:52.796675] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-09T19:07:53.596748] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-09T19:07:54.201323] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T19:07:54.396760] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-09T19:07:54.738783] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T19:07:55.064518] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T19:07:55.196806] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-09T19:07:55.996793] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-09T19:07:56.293365] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T19:07:56.584267] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-09T19:07:56.796744] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-09T19:07:57.596708] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-09T19:07:57.788977] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-09T19:07:57.852929] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T19:07:58.396784] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-09T19:07:59.196762] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-09T19:07:59.306143] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-09T19:07:59.996764] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-09T19:08:00.546058] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-09T19:08:00.550828] [INFO ] [REMOTE ] GE: Full fetch complete (77771 records). [2025-10-09T19:08:00.550966] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-09T19:08:00.804564] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-09T19:08:00.975027] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-09T19:08:00.985476] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-09T19:08:00.991865] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-09T19:08:01.003124] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-09T19:08:01.005371] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T19:08:01.016189] [DEBUG] [LOCAL ] GE: Trimmed 77771 records to 54096 (keeping 200 days of data) [2025-10-09T19:08:01.363776] [DEBUG] [LOCAL ] GE: Primary data saved (54096 records). [2025-10-09T19:08:01.363927] [INFO ] [MAIN ] GE: Full history saved. [2025-10-09T19:08:01.364965] [INFO ] [MAIN ] Update Progress: 914/2373 symbols completed. GE took 38.7s. Estimated remaining: 3h 24m 16s. Rate: 7.1 symbols/min [2025-10-09T19:08:01.538888] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:01.580261] [DEBUG] [LOCAL ] GES: Loaded 38643 existing records from primary storage. [2025-10-09T19:08:01.580639] [INFO ] [MAIN ] GES: Loaded 38643 existing records. [2025-10-09T19:08:01.611696] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-09T19:08:01.809968] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:01.810222] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-09T19:08:01.814469] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T19:08:01.811470] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-09T19:08:01.833178] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-09T19:08:01.833266] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-09T19:08:02.216762] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:02.319858] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T19:08:02.396718] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-09T19:08:03.128751] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:08:03.196678] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-09T19:08:03.996680] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-09T19:08:04.374094] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T19:08:04.541818] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T19:08:04.796835] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-09T19:08:05.295788] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T19:08:05.596753] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-09T19:08:06.283960] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:08:06.396708] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-09T19:08:07.034896] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:08:07.196733] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-09T19:08:07.996744] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-09T19:08:08.091198] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T19:08:08.796731] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-09T19:08:09.104273] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T19:08:09.137541] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T19:08:09.596737] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-09T19:08:10.396775] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-09T19:08:10.550680] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:08:10.710684] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T19:08:11.196748] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-09T19:08:11.811528] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:08:11.996760] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-09T19:08:12.735594] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T19:08:12.796706] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-09T19:08:13.092630] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T19:08:13.095003] [INFO ] [REMOTE ] GEL: Full fetch complete (48196 records). [2025-10-09T19:08:13.095105] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-09T19:08:13.507560] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-09T19:08:13.507695] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-09T19:08:13.508508] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-09T19:08:13.508563] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-09T19:08:13.509906] [DEBUG] [LOCAL ] GEL: Trimmed 48196 records to 32514 (keeping 200 days of data) [2025-10-09T19:08:13.602036] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-09T19:08:13.726157] [DEBUG] [LOCAL ] GEL: Primary data saved (32514 records). [2025-10-09T19:08:13.726314] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-09T19:08:13.726402] [INFO ] [MAIN ] Update Progress: 915/2373 symbols completed. GEL took 30.7s. Estimated remaining: 3h 24m 14s. Rate: 7.1 symbols/min [2025-10-09T19:08:13.910062] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:13.956066] [DEBUG] [LOCAL ] GETY: Loaded 35367 existing records from primary storage. [2025-10-09T19:08:13.956489] [INFO ] [MAIN ] GETY: Loaded 35367 existing records. [2025-10-09T19:08:14.143976] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:14.144274] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-09T19:08:14.144343] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-09T19:08:14.145510] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-09T19:08:14.145573] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-09T19:08:14.403184] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-09T19:08:14.522149] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:14.602615] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T19:08:15.196693] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-09T19:08:15.442177] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-09T19:08:15.677109] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T19:08:15.996740] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-09T19:08:16.671121] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T19:08:16.796730] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-09T19:08:17.596684] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-09T19:08:17.662855] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:08:17.667223] [INFO ] [REMOTE ] GEO: Full fetch complete (75430 records). [2025-10-09T19:08:17.667325] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-09T19:08:18.052907] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-09T19:08:18.052993] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-09T19:08:18.053922] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-09T19:08:18.053984] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-09T19:08:18.055370] [DEBUG] [LOCAL ] GEO: Trimmed 75430 records to 52261 (keeping 200 days of data) [2025-10-09T19:08:18.361269] [DEBUG] [LOCAL ] GEO: Primary data saved (52261 records). [2025-10-09T19:08:18.361419] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-09T19:08:18.362425] [INFO ] [MAIN ] Update Progress: 916/2373 symbols completed. GEO took 29.5s. Estimated remaining: 3h 23m 59s. Rate: 7.1 symbols/min [2025-10-09T19:08:18.407287] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-09T19:08:18.541131] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:18.596522] [DEBUG] [LOCAL ] GEV: Loaded 53015 existing records from primary storage. [2025-10-09T19:08:18.596902] [INFO ] [MAIN ] GEV: Loaded 53015 existing records. [2025-10-09T19:08:18.786489] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:18.786893] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-09T19:08:18.786988] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-09T19:08:18.818865] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-09T19:08:18.815538] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-09T19:08:18.832850] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-09T19:08:19.201704] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-09T19:08:19.206344] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:19.238121] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T19:08:19.960612] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:08:19.996730] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-09T19:08:20.791353] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:08:20.800036] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-09T19:08:21.596757] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-09T19:08:22.086954] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T19:08:22.240166] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-09T19:08:22.396687] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-09T19:08:23.131074] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T19:08:23.196695] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-09T19:08:23.996808] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-09T19:08:24.685616] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-09T19:08:24.736989] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T19:08:24.796683] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-09T19:08:25.243629] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T19:08:25.596736] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-09T19:08:26.279160] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T19:08:26.396685] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-09T19:08:27.196724] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-09T19:08:27.746045] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-09T19:08:27.809492] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T19:08:27.996730] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-09T19:08:28.332252] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:08:28.796721] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-09T19:08:29.596714] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-09T19:08:30.160988] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T19:08:30.203602] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-09T19:08:30.396725] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-09T19:08:30.528062] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-09T19:08:31.196719] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-09T19:08:31.996721] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-09T19:08:32.755249] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-09T19:08:32.797495] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T19:08:32.797577] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-09T19:08:33.234408] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T19:08:33.596711] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-09T19:08:34.396769] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-09T19:08:35.196695] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-09T19:08:35.262318] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-09T19:08:35.393977] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-09T19:08:35.399430] [INFO ] [REMOTE ] GENI: Full fetch complete (75618 records). [2025-10-09T19:08:35.399542] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-09T19:08:35.830443] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-09T19:08:35.830629] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-09T19:08:35.831678] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-09T19:08:35.831830] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-09T19:08:35.833395] [DEBUG] [LOCAL ] GENI: Trimmed 75618 records to 53328 (keeping 200 days of data) [2025-10-09T19:08:35.963086] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T19:08:36.041777] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-09T19:08:36.202290] [DEBUG] [LOCAL ] GENI: Primary data saved (53328 records). [2025-10-09T19:08:36.202527] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-09T19:08:36.203256] [INFO ] [MAIN ] Update Progress: 917/2373 symbols completed. GENI took 50.1s. Estimated remaining: 3h 24m 6s. Rate: 7.1 symbols/min [2025-10-09T19:08:36.599351] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T19:08:36.796701] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-09T19:08:37.596743] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-09T19:08:37.767231] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T19:08:38.064955] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T19:08:38.067977] [INFO ] [REMOTE ] GES: Full fetch complete (58937 records). [2025-10-09T19:08:38.068078] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-09T19:08:38.401804] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-09T19:08:38.477305] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-09T19:08:38.477385] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-09T19:08:38.478382] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-09T19:08:38.478451] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-09T19:08:38.479911] [DEBUG] [LOCAL ] GES: Trimmed 58937 records to 38897 (keeping 200 days of data) [2025-10-09T19:08:38.608403] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:08:38.748890] [DEBUG] [LOCAL ] GES: Primary data saved (38897 records). [2025-10-09T19:08:38.749069] [INFO ] [MAIN ] GES: Full history saved. [2025-10-09T19:08:38.749159] [INFO ] [MAIN ] Update Progress: 918/2373 symbols completed. GES took 37.4s. Estimated remaining: 3h 23m 48s. Rate: 7.1 symbols/min [2025-10-09T19:08:39.196776] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-09T19:08:40.430750] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T19:08:40.444900] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-09T19:08:40.464478] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:08:40.796770] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-09T19:08:41.947357] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:08:41.950556] [INFO ] [REMOTE ] GETY: Full fetch complete (55496 records). [2025-10-09T19:08:41.950683] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-09T19:08:42.332054] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-09T19:08:42.332210] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-09T19:08:42.333029] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-09T19:08:42.333294] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-09T19:08:42.334463] [DEBUG] [LOCAL ] GETY: Trimmed 55496 records to 35597 (keeping 200 days of data) [2025-10-09T19:08:42.548421] [DEBUG] [LOCAL ] GETY: Primary data saved (35597 records). [2025-10-09T19:08:42.548766] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-09T19:08:42.548888] [INFO ] [MAIN ] Update Progress: 919/2373 symbols completed. GETY took 28.8s. Estimated remaining: 3h 23m 33s. Rate: 7.1 symbols/min [2025-10-09T19:08:42.592808] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-09T19:08:42.604457] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-09T19:08:44.685001] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-09T19:08:44.696866] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-09T19:08:46.966885] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-09T19:08:46.971440] [INFO ] [REMOTE ] GEV: Full fetch complete (76893 records). [2025-10-09T19:08:46.971551] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-09T19:08:47.365148] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-09T19:08:47.365227] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-09T19:08:47.366170] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-09T19:08:47.366248] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-09T19:08:47.367699] [DEBUG] [LOCAL ] GEV: Trimmed 76893 records to 53394 (keeping 200 days of data) [2025-10-09T19:08:47.695982] [DEBUG] [LOCAL ] GEV: Primary data saved (53394 records). [2025-10-09T19:08:47.696317] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-09T19:08:47.696395] [INFO ] [MAIN ] Update Progress: 920/2373 symbols completed. GEV took 29.3s. Estimated remaining: 3h 23m 19s. Rate: 7.1 symbols/min [2025-10-09T19:08:48.233958] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:48.393122] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:48.411171] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:48.363313] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:08:48.418258] [DEBUG] [LOCAL ] GF: Loaded 2781 existing records from primary storage. [2025-10-09T19:08:48.418678] [INFO ] [MAIN ] GF: Loaded 2781 existing records. [2025-10-09T19:08:48.575409] [DEBUG] [LOCAL ] GFF: Loaded 30233 existing records from primary storage. [2025-10-09T19:08:48.613533] [INFO ] [MAIN ] GFF: Loaded 30233 existing records. [2025-10-09T19:08:48.650181] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:48.719836] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-09T19:08:48.731503] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-09T19:08:48.779770] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-09T19:08:48.783764] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-09T19:08:48.784526] [DEBUG] [LOCAL ] GFL: Loaded 47875 existing records from primary storage. [2025-10-09T19:08:48.785680] [DEBUG] [LOCAL ] GFI: Loaded 53098 existing records from primary storage. [2025-10-09T19:08:48.823095] [INFO ] [MAIN ] GFL: Loaded 47875 existing records. [2025-10-09T19:08:48.898168] [INFO ] [MAIN ] GFI: Loaded 53098 existing records. [2025-10-09T19:08:49.140935] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:49.195093] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-09T19:08:49.222471] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-09T19:08:49.423715] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:49.412061] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-09T19:08:49.440517] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-09T19:08:49.488787] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-09T19:08:49.529025] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-09T19:08:49.538841] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:08:49.601737] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-09T19:08:49.596426] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-09T19:08:49.627781] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-09T19:08:49.633122] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-09T19:08:49.697096] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-09T19:08:49.755769] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-09T19:08:50.159171] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:50.236588] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-09T19:08:50.787116] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:50.799774] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:50.805407] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-09T19:08:50.812829] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-09T19:08:50.912942] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:08:50.913222] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-09T19:08:51.122331] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T19:08:51.124260] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-09T19:08:51.439246] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-09T19:08:51.440794] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-09T19:08:52.032469] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-09T19:08:52.034081] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-09T19:08:52.163410] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T19:08:52.169360] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-09T19:08:52.301499] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-09T19:08:52.310746] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-09T19:08:52.466769] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T19:08:52.469069] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-09T19:08:52.625350] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T19:08:52.635768] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-09T19:08:53.045220] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-09T19:08:53.046744] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-09T19:08:53.483274] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T19:08:53.489602] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-09T19:08:53.837176] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T19:08:53.839375] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-09T19:08:53.874272] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T19:08:54.178321] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:08:54.251794] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-09T19:08:54.396684] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-09T19:08:54.444501] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T19:08:54.718669] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-09T19:08:55.196708] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-09T19:08:55.996724] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-09T19:08:56.571838] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T19:08:56.796756] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-09T19:08:57.328153] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T19:08:57.596763] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-09T19:08:58.362203] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T19:08:58.396684] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-09T19:08:59.196763] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-09T19:08:59.261349] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T19:08:59.679242] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-09T19:08:59.906906] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T19:08:59.996764] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-09T19:09:00.796715] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-09T19:09:01.146468] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-09T19:09:01.596730] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-09T19:09:01.839694] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T19:09:02.007593] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-09T19:09:02.008429] [INFO ] [REMOTE ] GF: Full fetch complete (5049 records). [2025-10-09T19:09:02.008501] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-09T19:09:02.412159] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-09T19:09:02.456841] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-09T19:09:02.456938] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-09T19:09:02.457098] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-09T19:09:02.457138] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-09T19:09:02.457601] [DEBUG] [LOCAL ] GF: Trimmed 5049 records to 2790 (keeping 200 days of data) [2025-10-09T19:09:02.475673] [DEBUG] [LOCAL ] GF: Primary data saved (2790 records). [2025-10-09T19:09:02.475835] [INFO ] [MAIN ] GF: Full history saved. [2025-10-09T19:09:02.475945] [INFO ] [MAIN ] Update Progress: 921/2373 symbols completed. GF took 14.8s. Estimated remaining: 3h 23m 21s. Rate: 7.1 symbols/min [2025-10-09T19:09:02.656715] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:02.666774] [DEBUG] [LOCAL ] GFR: Loaded 7915 existing records from primary storage. [2025-10-09T19:09:02.667014] [INFO ] [MAIN ] GFR: Loaded 7915 existing records. [2025-10-09T19:09:02.855992] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:02.856231] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-09T19:09:02.856284] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-09T19:09:02.856502] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-09T19:09:02.856560] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-09T19:09:03.201857] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-09T19:09:03.235451] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:03.591387] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T19:09:03.996803] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-09T19:09:04.669867] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T19:09:04.796783] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-09T19:09:05.596759] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-09T19:09:05.703788] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T19:09:06.270471] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-09T19:09:06.396759] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-09T19:09:06.903276] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-09T19:09:07.196692] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-09T19:09:07.996765] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-09T19:09:08.077053] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T19:09:08.562447] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T19:09:08.796725] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-09T19:09:09.315335] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T19:09:09.596717] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-09T19:09:09.985430] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T19:09:10.396769] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-09T19:09:10.876522] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T19:09:10.888964] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T19:09:11.196730] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-09T19:09:11.996784] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-09T19:09:12.759808] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T19:09:12.796749] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-09T19:09:13.011803] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T19:09:13.580351] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T19:09:13.596672] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-09T19:09:14.353872] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:09:14.396697] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-09T19:09:14.918527] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-09T19:09:15.196757] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-09T19:09:15.996911] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-09T19:09:16.645136] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T19:09:16.796750] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-09T19:09:17.596752] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-09T19:09:17.905929] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-09T19:09:18.070376] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:09:18.396720] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-09T19:09:19.188750] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T19:09:19.198552] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-09T19:09:19.613253] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-09T19:09:19.616219] [INFO ] [REMOTE ] GFF: Full fetch complete (44066 records). [2025-10-09T19:09:19.616325] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-09T19:09:19.998824] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-09T19:09:20.011324] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-09T19:09:20.011409] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-09T19:09:20.012120] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-09T19:09:20.012292] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-09T19:09:20.013259] [DEBUG] [LOCAL ] GFF: Trimmed 44066 records to 30371 (keeping 200 days of data) [2025-10-09T19:09:20.111795] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T19:09:20.207371] [DEBUG] [LOCAL ] GFF: Primary data saved (30371 records). [2025-10-09T19:09:20.207513] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-09T19:09:20.207596] [INFO ] [MAIN ] Update Progress: 922/2373 symbols completed. GFF took 32.5s. Estimated remaining: 3h 23m 27s. Rate: 7.1 symbols/min [2025-10-09T19:09:20.373821] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:20.423577] [DEBUG] [LOCAL ] GGB: Loaded 51174 existing records from primary storage. [2025-10-09T19:09:20.423935] [INFO ] [MAIN ] GGB: Loaded 51174 existing records. [2025-10-09T19:09:20.600746] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:20.600961] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-09T19:09:20.601010] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-09T19:09:20.601232] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-09T19:09:20.601289] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-09T19:09:20.802941] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-09T19:09:20.956522] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:21.601977] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-09T19:09:21.619449] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T19:09:21.634687] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-09T19:09:22.396700] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-09T19:09:23.196755] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-09T19:09:23.456421] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T19:09:23.821058] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T19:09:24.001976] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-09T19:09:24.017273] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:09:24.796724] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-09T19:09:25.596782] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-09T19:09:25.783938] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T19:09:26.396693] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-09T19:09:26.780611] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-09T19:09:26.785092] [INFO ] [REMOTE ] GFI: Full fetch complete (76497 records). [2025-10-09T19:09:26.785366] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-09T19:09:27.126084] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T19:09:27.211463] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-09T19:09:27.215896] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-09T19:09:27.215953] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-09T19:09:27.216917] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-09T19:09:27.217106] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-09T19:09:27.218626] [DEBUG] [LOCAL ] GFI: Trimmed 76497 records to 53488 (keeping 200 days of data) [2025-10-09T19:09:27.543057] [DEBUG] [LOCAL ] GFI: Primary data saved (53488 records). [2025-10-09T19:09:27.543188] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-09T19:09:27.543267] [INFO ] [MAIN ] Update Progress: 923/2373 symbols completed. GFI took 39.8s. Estimated remaining: 3h 23m 17s. Rate: 7.1 symbols/min [2025-10-09T19:09:27.711391] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:27.749118] [DEBUG] [LOCAL ] GGG: Loaded 40765 existing records from primary storage. [2025-10-09T19:09:27.749404] [INFO ] [MAIN ] GGG: Loaded 40765 existing records. [2025-10-09T19:09:27.935755] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:27.935992] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-09T19:09:27.936048] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-09T19:09:27.936278] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-09T19:09:27.936373] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-09T19:09:28.001271] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-09T19:09:28.266375] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T19:09:28.353095] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:28.777757] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:09:28.796716] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-09T19:09:28.835366] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:09:28.840850] [INFO ] [REMOTE ] GFL: Full fetch complete (69204 records). [2025-10-09T19:09:28.841130] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-09T19:09:29.240348] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-09T19:09:29.240461] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-09T19:09:29.241428] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-09T19:09:29.241504] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-09T19:09:29.243801] [DEBUG] [LOCAL ] GFL: Trimmed 69204 records to 48223 (keeping 200 days of data) [2025-10-09T19:09:29.530059] [DEBUG] [LOCAL ] GFL: Primary data saved (48223 records). [2025-10-09T19:09:29.530184] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-09T19:09:29.531306] [INFO ] [MAIN ] Update Progress: 924/2373 symbols completed. GFL took 41.8s. Estimated remaining: 3h 22m 58s. Rate: 7.1 symbols/min [2025-10-09T19:09:29.606697] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-09T19:09:29.702477] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:29.718692] [DEBUG] [LOCAL ] GGT: Loaded 14116 existing records from primary storage. [2025-10-09T19:09:29.718941] [INFO ] [MAIN ] GGT: Loaded 14116 existing records. [2025-10-09T19:09:29.892267] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:29.892439] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-09T19:09:29.892486] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-09T19:09:29.892698] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-09T19:09:29.892755] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-09T19:09:30.253674] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:30.312455] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:09:30.396666] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-09T19:09:30.558856] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T19:09:30.560029] [INFO ] [REMOTE ] GFR: Full fetch complete (12336 records). [2025-10-09T19:09:30.560096] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-09T19:09:30.924698] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-09T19:09:30.924814] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-09T19:09:30.925113] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-09T19:09:30.925155] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-09T19:09:30.925772] [DEBUG] [LOCAL ] GFR: Trimmed 12336 records to 7968 (keeping 200 days of data) [2025-10-09T19:09:30.969789] [DEBUG] [LOCAL ] GFR: Primary data saved (7968 records). [2025-10-09T19:09:30.969927] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-09T19:09:30.970012] [INFO ] [MAIN ] Update Progress: 925/2373 symbols completed. GFR took 28.5s. Estimated remaining: 3h 22m 39s. Rate: 7.1 symbols/min [2025-10-09T19:09:31.138142] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:31.143468] [DEBUG] [LOCAL ] GGZ: Loaded 2428 existing records from primary storage. [2025-10-09T19:09:31.143667] [INFO ] [MAIN ] GGZ: Loaded 2428 existing records. [2025-10-09T19:09:31.204746] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-09T19:09:31.325849] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:31.326037] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-09T19:09:31.326084] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-09T19:09:31.326257] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-09T19:09:31.326314] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-09T19:09:31.674531] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:31.996701] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-09T19:09:32.139942] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T19:09:32.235034] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:09:32.590720] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T19:09:32.796740] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-09T19:09:33.282766] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T19:09:33.596733] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-09T19:09:33.997507] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-09T19:09:34.396743] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-09T19:09:35.105751] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-09T19:09:35.196728] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-09T19:09:35.732821] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T19:09:35.996706] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-09T19:09:36.796770] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-09T19:09:37.113729] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-09T19:09:37.596694] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-09T19:09:37.696635] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T19:09:38.348324] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-09T19:09:38.396683] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-09T19:09:38.960583] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T19:09:39.196734] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-09T19:09:39.701902] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T19:09:39.996718] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-09T19:09:40.388617] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-09T19:09:40.796723] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-09T19:09:41.596739] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-09T19:09:42.071163] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-09T19:09:42.310905] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:09:42.396846] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-09T19:09:42.825112] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-09T19:09:43.196743] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-09T19:09:43.653394] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T19:09:43.996734] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-09T19:09:44.796719] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-09T19:09:45.543751] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:09:45.596672] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-09T19:09:46.396699] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-09T19:09:46.421863] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T19:09:46.930996] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T19:09:46.931774] [INFO ] [REMOTE ] GGZ: Full fetch complete (4066 records). [2025-10-09T19:09:46.931843] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-09T19:09:47.197585] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-09T19:09:47.318892] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-09T19:09:47.319076] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-09T19:09:47.319271] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-09T19:09:47.319361] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-09T19:09:47.319974] [DEBUG] [LOCAL ] GGZ: Trimmed 4066 records to 2437 (keeping 200 days of data) [2025-10-09T19:09:47.335168] [DEBUG] [LOCAL ] GGZ: Primary data saved (2437 records). [2025-10-09T19:09:47.335229] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-09T19:09:47.335296] [INFO ] [MAIN ] Update Progress: 926/2373 symbols completed. GGZ took 16.4s. Estimated remaining: 3h 22m 43s. Rate: 7.1 symbols/min [2025-10-09T19:09:47.477828] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T19:09:47.544703] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:09:47.549784] [DEBUG] [LOCAL ] GHC: Loaded 2780 existing records from primary storage. [2025-10-09T19:09:47.549920] [INFO ] [MAIN ] GHC: Loaded 2780 existing records. [2025-10-09T19:09:47.724276] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:09:47.724508] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-09T19:09:47.724555] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-09T19:09:47.724910] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-09T19:09:47.724967] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-09T19:09:48.001930] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-09T19:09:48.070267] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:09:48.796709] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-09T19:09:48.943173] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T19:09:49.382779] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T19:09:49.596690] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-09T19:09:49.697430] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T19:09:50.396745] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-09T19:09:50.992882] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T19:09:51.031922] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T19:09:51.196724] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-09T19:09:51.996803] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-09T19:09:52.189333] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T19:09:52.796735] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-09T19:09:53.308768] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T19:09:53.596735] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-09T19:09:54.349042] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T19:09:54.396684] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-09T19:09:55.196702] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-09T19:09:55.230632] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:09:55.664866] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T19:09:55.996723] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-09T19:09:56.109369] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T19:09:56.796801] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-09T19:09:57.489008] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T19:09:57.596685] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-09T19:09:58.238620] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T19:09:58.396712] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-09T19:09:58.504183] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T19:09:58.882670] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-09T19:09:59.196795] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-09T19:09:59.688043] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-09T19:09:59.996791] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-09T19:10:00.796746] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-09T19:10:01.033777] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T19:10:01.596733] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-09T19:10:02.396703] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-09T19:10:02.464514] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T19:10:02.745134] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-09T19:10:03.196758] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-09T19:10:03.854079] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T19:10:03.861718] [INFO ] [REMOTE ] GGB: Full fetch complete (74116 records). [2025-10-09T19:10:03.861916] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-09T19:10:04.001837] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-09T19:10:04.290696] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-09T19:10:04.290853] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-09T19:10:04.292433] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-09T19:10:04.292545] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-09T19:10:04.296855] [DEBUG] [LOCAL ] GGB: Trimmed 74116 records to 51552 (keeping 200 days of data) [2025-10-09T19:10:04.606514] [DEBUG] [LOCAL ] GGB: Primary data saved (51552 records). [2025-10-09T19:10:04.606690] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-09T19:10:04.606805] [INFO ] [MAIN ] Update Progress: 927/2373 symbols completed. GGB took 44.4s. Estimated remaining: 3h 22m 49s. Rate: 7.1 symbols/min [2025-10-09T19:10:04.814862] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-09T19:10:04.817771] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:04.828483] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:10:04.833289] [INFO ] [REMOTE ] GGG: Full fetch complete (59392 records). [2025-10-09T19:10:04.833513] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-09T19:10:04.843464] [DEBUG] [LOCAL ] GHG: Loaded 3211 existing records from primary storage. [2025-10-09T19:10:04.882825] [INFO ] [MAIN ] GHG: Loaded 3211 existing records. [2025-10-09T19:10:05.003965] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T19:10:05.300955] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:05.324772] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-09T19:10:05.333033] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-09T19:10:05.335936] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-09T19:10:05.341576] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-09T19:10:05.546135] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-09T19:10:05.551554] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-09T19:10:05.563390] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-09T19:10:05.569338] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-09T19:10:05.574519] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-09T19:10:05.598391] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-09T19:10:05.742549] [DEBUG] [LOCAL ] GGG: Trimmed 59392 records to 41084 (keeping 200 days of data) [2025-10-09T19:10:05.917568] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:06.078760] [DEBUG] [LOCAL ] GGG: Primary data saved (41084 records). [2025-10-09T19:10:06.078884] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-09T19:10:06.078966] [INFO ] [MAIN ] Update Progress: 928/2373 symbols completed. GGG took 38.5s. Estimated remaining: 3h 22m 29s. Rate: 7.1 symbols/min [2025-10-09T19:10:06.193767] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-09T19:10:06.258975] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:06.268552] [DEBUG] [LOCAL ] GHI: Loaded 7185 existing records from primary storage. [2025-10-09T19:10:06.268798] [INFO ] [MAIN ] GHI: Loaded 7185 existing records. [2025-10-09T19:10:06.408793] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-09T19:10:06.462040] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:06.462297] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-09T19:10:06.462362] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-09T19:10:06.462569] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-09T19:10:06.462675] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-09T19:10:06.815781] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:07.196743] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-09T19:10:07.538945] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T19:10:07.540954] [INFO ] [REMOTE ] GGT: Full fetch complete (18715 records). [2025-10-09T19:10:07.541056] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-09T19:10:07.644860] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-09T19:10:07.910195] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-09T19:10:07.910276] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-09T19:10:07.910706] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-09T19:10:07.910767] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-09T19:10:07.911313] [DEBUG] [LOCAL ] GGT: Trimmed 18715 records to 14247 (keeping 200 days of data) [2025-10-09T19:10:07.997032] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-09T19:10:08.003537] [DEBUG] [LOCAL ] GGT: Primary data saved (14247 records). [2025-10-09T19:10:08.003742] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-09T19:10:08.003837] [INFO ] [MAIN ] Update Progress: 929/2373 symbols completed. GGT took 38.5s. Estimated remaining: 3h 22m 11s. Rate: 7.1 symbols/min [2025-10-09T19:10:08.170514] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:08.177554] [DEBUG] [LOCAL ] GHLD: Loaded 4184 existing records from primary storage. [2025-10-09T19:10:08.177765] [INFO ] [MAIN ] GHLD: Loaded 4184 existing records. [2025-10-09T19:10:08.351167] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:08.351368] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-09T19:10:08.351416] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-09T19:10:08.351590] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-09T19:10:08.351682] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-09T19:10:08.710300] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:08.796679] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-09T19:10:09.082859] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T19:10:09.236212] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-09T19:10:09.596732] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-09T19:10:10.041749] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T19:10:10.396780] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-09T19:10:10.896607] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T19:10:11.196738] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-09T19:10:12.003280] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-09T19:10:12.007221] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T19:10:12.716945] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:10:12.796714] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-09T19:10:13.343795] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T19:10:13.596704] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-09T19:10:14.304038] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-09T19:10:14.396739] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-09T19:10:15.003826] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-09T19:10:15.196760] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-09T19:10:15.994758] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-09T19:10:15.997211] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-09T19:10:16.661321] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T19:10:16.796727] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-09T19:10:17.361030] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T19:10:17.596752] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-09T19:10:18.062540] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T19:10:18.396745] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-09T19:10:19.164341] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T19:10:19.196732] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-09T19:10:19.942245] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T19:10:19.996717] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-09T19:10:20.348405] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T19:10:20.796729] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-09T19:10:21.594436] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-09T19:10:21.596923] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-09T19:10:22.054356] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T19:10:22.396746] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-09T19:10:22.860320] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T19:10:23.196720] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-09T19:10:23.676487] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T19:10:23.996795] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-09T19:10:24.404588] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-09T19:10:24.796723] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-09T19:10:25.596723] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-09T19:10:25.838829] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T19:10:25.840412] [INFO ] [REMOTE ] GHI: Full fetch complete (11377 records). [2025-10-09T19:10:25.840487] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-09T19:10:26.251294] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-09T19:10:26.264401] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-09T19:10:26.264514] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-09T19:10:26.265133] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-09T19:10:26.265202] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-09T19:10:26.265887] [DEBUG] [LOCAL ] GHI: Trimmed 11377 records to 7248 (keeping 200 days of data) [2025-10-09T19:10:26.312293] [DEBUG] [LOCAL ] GHI: Primary data saved (7248 records). [2025-10-09T19:10:26.312445] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-09T19:10:26.312542] [INFO ] [MAIN ] Update Progress: 930/2373 symbols completed. GHI took 20.2s. Estimated remaining: 3h 22m 18s. Rate: 7.1 symbols/min [2025-10-09T19:10:26.401984] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-09T19:10:26.485400] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:26.501084] [DEBUG] [LOCAL ] GHM: Loaded 14150 existing records from primary storage. [2025-10-09T19:10:26.501325] [INFO ] [MAIN ] GHM: Loaded 14150 existing records. [2025-10-09T19:10:26.674251] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:26.674499] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-09T19:10:26.674548] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-09T19:10:26.674767] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-09T19:10:26.674824] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-09T19:10:26.959117] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T19:10:27.033911] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:27.196733] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-09T19:10:27.638843] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-09T19:10:27.996732] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-09T19:10:28.584748] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T19:10:28.796715] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-09T19:10:29.358989] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-09T19:10:29.596748] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-09T19:10:30.111251] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-09T19:10:30.396726] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-09T19:10:31.149364] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T19:10:31.196729] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-09T19:10:31.996728] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-09T19:10:32.223568] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:10:32.614241] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T19:10:32.796739] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-09T19:10:33.596697] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-09T19:10:33.635459] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T19:10:34.175929] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T19:10:34.396724] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-09T19:10:35.196743] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-09T19:10:35.532494] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T19:10:35.762425] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T19:10:35.996741] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-09T19:10:36.705410] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T19:10:36.706480] [INFO ] [REMOTE ] GHC: Full fetch complete (3534 records). [2025-10-09T19:10:36.706552] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-09T19:10:36.802362] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-09T19:10:37.061241] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-09T19:10:37.061328] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-09T19:10:37.061448] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-09T19:10:37.061489] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-09T19:10:37.061864] [DEBUG] [LOCAL ] GHC: Trimmed 3534 records to 2863 (keeping 200 days of data) [2025-10-09T19:10:37.080900] [DEBUG] [LOCAL ] GHC: Primary data saved (2863 records). [2025-10-09T19:10:37.081035] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-09T19:10:37.081131] [INFO ] [MAIN ] Update Progress: 931/2373 symbols completed. GHC took 49.7s. Estimated remaining: 3h 22m 13s. Rate: 7.1 symbols/min [2025-10-09T19:10:37.254693] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:37.276984] [DEBUG] [LOCAL ] GHY: Loaded 20935 existing records from primary storage. [2025-10-09T19:10:37.277254] [INFO ] [MAIN ] GHY: Loaded 20935 existing records. [2025-10-09T19:10:37.378919] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T19:10:37.459256] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:37.459494] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-09T19:10:37.459562] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-09T19:10:37.459805] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-09T19:10:37.459862] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-09T19:10:37.601806] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-09T19:10:37.822708] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:38.396696] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-09T19:10:38.706831] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T19:10:39.039886] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-09T19:10:39.040898] [INFO ] [REMOTE ] GHLD: Full fetch complete (4896 records). [2025-10-09T19:10:39.040991] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-09T19:10:39.198054] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-09T19:10:39.404331] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-09T19:10:39.404417] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-09T19:10:39.404591] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-09T19:10:39.404675] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-09T19:10:39.405072] [DEBUG] [LOCAL ] GHLD: Trimmed 4896 records to 4231 (keeping 200 days of data) [2025-10-09T19:10:39.431321] [DEBUG] [LOCAL ] GHLD: Primary data saved (4231 records). [2025-10-09T19:10:39.431417] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-09T19:10:39.431539] [INFO ] [MAIN ] Update Progress: 932/2373 symbols completed. GHLD took 31.4s. Estimated remaining: 3h 21m 55s. Rate: 7.1 symbols/min [2025-10-09T19:10:39.604196] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:39.639819] [DEBUG] [LOCAL ] GIB: Loaded 31842 existing records from primary storage. [2025-10-09T19:10:39.640107] [INFO ] [MAIN ] GIB: Loaded 31842 existing records. [2025-10-09T19:10:39.813264] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:39.813502] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-09T19:10:39.813550] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-09T19:10:39.813807] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-09T19:10:39.813864] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-09T19:10:39.998720] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-09T19:10:40.120488] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T19:10:40.199386] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:40.502744] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T19:10:40.796729] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-09T19:10:41.536984] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T19:10:41.596770] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-09T19:10:42.293981] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-09T19:10:42.396715] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-09T19:10:43.196796] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-09T19:10:43.677728] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T19:10:43.996756] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-09T19:10:44.426073] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T19:10:44.796926] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-09T19:10:44.801153] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T19:10:45.279767] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-09T19:10:45.280825] [INFO ] [REMOTE ] GHG: Full fetch complete (4092 records). [2025-10-09T19:10:45.280904] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-09T19:10:45.601808] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-09T19:10:45.664596] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-09T19:10:45.664697] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-09T19:10:45.664842] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-09T19:10:45.664884] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-09T19:10:45.665228] [DEBUG] [LOCAL ] GHG: Trimmed 4092 records to 3244 (keeping 200 days of data) [2025-10-09T19:10:45.683937] [DEBUG] [LOCAL ] GHG: Primary data saved (3244 records). [2025-10-09T19:10:45.684018] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-09T19:10:45.684092] [INFO ] [MAIN ] Update Progress: 933/2373 symbols completed. GHG took 41.1s. Estimated remaining: 3h 21m 44s. Rate: 7.1 symbols/min [2025-10-09T19:10:45.852552] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:45.870992] [DEBUG] [LOCAL ] GIC: Loaded 13439 existing records from primary storage. [2025-10-09T19:10:45.871225] [INFO ] [MAIN ] GIC: Loaded 13439 existing records. [2025-10-09T19:10:46.049773] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:46.049949] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-09T19:10:46.049997] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-09T19:10:46.050183] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-09T19:10:46.050241] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-09T19:10:46.401981] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:10:46.397437] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-09T19:10:46.979874] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-09T19:10:47.196720] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-09T19:10:47.396906] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T19:10:47.996699] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-09T19:10:48.142374] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T19:10:48.796743] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-09T19:10:49.450355] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T19:10:49.596754] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-09T19:10:49.757873] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T19:10:50.396773] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-09T19:10:50.715541] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T19:10:51.196698] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-09T19:10:51.318587] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T19:10:51.977298] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T19:10:51.996666] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-09T19:10:52.732196] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T19:10:52.796721] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-09T19:10:53.596715] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-09T19:10:53.869510] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T19:10:54.275811] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T19:10:54.396726] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-09T19:10:55.196724] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-09T19:10:55.917921] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T19:10:55.938947] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T19:10:55.996700] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-09T19:10:56.715897] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T19:10:56.796716] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-09T19:10:57.596705] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-09T19:10:57.636447] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T19:10:58.396710] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-09T19:10:58.415226] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T19:10:59.048859] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T19:10:59.050705] [INFO ] [REMOTE ] GHM: Full fetch complete (21907 records). [2025-10-09T19:10:59.050792] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-09T19:10:59.202095] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-09T19:10:59.421551] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-09T19:10:59.421630] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-09T19:10:59.422159] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-09T19:10:59.422208] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-09T19:10:59.422962] [DEBUG] [LOCAL ] GHM: Trimmed 21907 records to 14304 (keeping 200 days of data) [2025-10-09T19:10:59.509231] [DEBUG] [LOCAL ] GHM: Primary data saved (14304 records). [2025-10-09T19:10:59.509381] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-09T19:10:59.509486] [INFO ] [MAIN ] Update Progress: 934/2373 symbols completed. GHM took 33.2s. Estimated remaining: 3h 21m 44s. Rate: 7.1 symbols/min [2025-10-09T19:10:59.684931] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:10:59.725791] [DEBUG] [LOCAL ] GIL: Loaded 43687 existing records from primary storage. [2025-10-09T19:10:59.726103] [INFO ] [MAIN ] GIL: Loaded 43687 existing records. [2025-10-09T19:10:59.904035] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:10:59.904335] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-09T19:10:59.904397] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-09T19:10:59.904701] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-09T19:10:59.904780] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-09T19:11:00.001832] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-09T19:11:00.281017] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:00.420000] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T19:11:00.637843] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T19:11:00.796741] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-09T19:11:01.596779] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-09T19:11:01.949063] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T19:11:02.396803] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-09T19:11:02.574155] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T19:11:03.196747] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-09T19:11:03.293272] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-09T19:11:03.996710] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-09T19:11:04.248270] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T19:11:04.796750] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-09T19:11:05.370238] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T19:11:05.596203] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T19:11:05.599249] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-09T19:11:06.396692] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-09T19:11:06.614358] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T19:11:06.616893] [INFO ] [REMOTE ] GHY: Full fetch complete (32302 records). [2025-10-09T19:11:06.616975] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-09T19:11:07.035110] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-09T19:11:07.035208] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-09T19:11:07.035976] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-09T19:11:07.036044] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-09T19:11:07.036900] [DEBUG] [LOCAL ] GHY: Trimmed 32302 records to 21047 (keeping 200 days of data) [2025-10-09T19:11:07.185283] [DEBUG] [LOCAL ] GHY: Primary data saved (21047 records). [2025-10-09T19:11:07.185431] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-09T19:11:07.185571] [INFO ] [MAIN ] Update Progress: 935/2373 symbols completed. GHY took 30.1s. Estimated remaining: 3h 21m 34s. Rate: 7.1 symbols/min [2025-10-09T19:11:07.201982] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-09T19:11:07.396634] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:07.448055] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-09T19:11:07.448449] [INFO ] [MAIN ] GIS: Loaded 53672 existing records. [2025-10-09T19:11:07.642283] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:07.642637] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-09T19:11:07.642726] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-09T19:11:07.642963] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-09T19:11:07.643022] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-09T19:11:07.797867] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:11:08.007624] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-09T19:11:08.052230] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:08.772180] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T19:11:08.796667] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-09T19:11:09.446955] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T19:11:09.596755] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-09T19:11:09.936531] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T19:11:10.396770] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-09T19:11:10.964765] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T19:11:11.196715] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-09T19:11:11.996710] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-09T19:11:12.270001] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T19:11:12.796688] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-09T19:11:12.824592] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:11:12.944358] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T19:11:12.947187] [INFO ] [REMOTE ] GIB: Full fetch complete (45709 records). [2025-10-09T19:11:12.947274] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-09T19:11:13.314000] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-09T19:11:13.314077] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-09T19:11:13.314772] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-09T19:11:13.314835] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-09T19:11:13.315782] [DEBUG] [LOCAL ] GIB: Trimmed 45709 records to 32024 (keeping 200 days of data) [2025-10-09T19:11:13.516073] [DEBUG] [LOCAL ] GIB: Primary data saved (32024 records). [2025-10-09T19:11:13.516213] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-09T19:11:13.517209] [INFO ] [MAIN ] Update Progress: 936/2373 symbols completed. GIB took 34.1s. Estimated remaining: 3h 21m 22s. Rate: 7.1 symbols/min [2025-10-09T19:11:13.605142] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-09T19:11:13.686460] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:13.728573] [DEBUG] [LOCAL ] GKOS: Loaded 42550 existing records from primary storage. [2025-10-09T19:11:13.728921] [INFO ] [MAIN ] GKOS: Loaded 42550 existing records. [2025-10-09T19:11:13.911826] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:13.912083] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-09T19:11:13.912146] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-09T19:11:13.912425] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-09T19:11:13.912501] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-09T19:11:14.288117] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:14.336570] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:11:14.396713] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-09T19:11:14.911687] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T19:11:15.196741] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-09T19:11:15.996682] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-09T19:11:16.005871] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T19:11:16.101344] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T19:11:16.796768] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-09T19:11:17.046457] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-09T19:11:17.596746] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-09T19:11:17.704483] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T19:11:18.396735] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-09T19:11:18.858951] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T19:11:19.196774] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-09T19:11:19.789863] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-09T19:11:19.996702] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-09T19:11:20.402397] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T19:11:20.796793] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-09T19:11:20.924121] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T19:11:21.596828] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-09T19:11:22.341285] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T19:11:22.396687] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-09T19:11:22.876493] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T19:11:23.196688] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-09T19:11:23.996755] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-09T19:11:24.351319] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-09T19:11:24.385914] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T19:11:24.796746] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-09T19:11:24.886751] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T19:11:25.596768] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-09T19:11:26.312822] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:11:26.396678] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-09T19:11:27.196727] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-09T19:11:27.254510] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-09T19:11:27.997124] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T19:11:27.997194] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-09T19:11:28.796735] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-09T19:11:28.840632] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T19:11:28.842111] [INFO ] [REMOTE ] GIC: Full fetch complete (20173 records). [2025-10-09T19:11:28.842184] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-09T19:11:29.214692] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-09T19:11:29.214776] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-09T19:11:29.215232] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-09T19:11:29.215274] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-09T19:11:29.216105] [DEBUG] [LOCAL ] GIC: Trimmed 20173 records to 13510 (keeping 200 days of data) [2025-10-09T19:11:29.322883] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-09T19:11:29.341800] [DEBUG] [LOCAL ] GIC: Primary data saved (13510 records). [2025-10-09T19:11:29.341929] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-09T19:11:29.342008] [INFO ] [MAIN ] Update Progress: 937/2373 symbols completed. GIC took 43.7s. Estimated remaining: 3h 21m 25s. Rate: 7.1 symbols/min [2025-10-09T19:11:29.527102] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:29.566511] [DEBUG] [LOCAL ] GL: Loaded 37792 existing records from primary storage. [2025-10-09T19:11:29.566837] [INFO ] [MAIN ] GL: Loaded 37792 existing records. [2025-10-09T19:11:29.601931] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-09T19:11:29.747410] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:29.747611] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-09T19:11:29.747694] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-09T19:11:29.748092] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-09T19:11:29.748149] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-09T19:11:30.105158] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:30.372748] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T19:11:30.396678] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-09T19:11:31.196689] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-09T19:11:31.277965] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T19:11:31.976269] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T19:11:31.996676] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-09T19:11:32.796753] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-09T19:11:33.213815] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-09T19:11:33.504061] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T19:11:33.596704] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-09T19:11:34.346031] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-09T19:11:34.351688] [INFO ] [REMOTE ] GIL: Full fetch complete (61852 records). [2025-10-09T19:11:34.351852] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-09T19:11:34.401870] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-09T19:11:34.741417] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-09T19:11:34.741536] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-09T19:11:34.742393] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-09T19:11:34.742458] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-09T19:11:34.744334] [DEBUG] [LOCAL ] GIL: Trimmed 61852 records to 44027 (keeping 200 days of data) [2025-10-09T19:11:35.014540] [DEBUG] [LOCAL ] GIL: Primary data saved (44027 records). [2025-10-09T19:11:35.014713] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-09T19:11:35.014811] [INFO ] [MAIN ] Update Progress: 938/2373 symbols completed. GIL took 35.5s. Estimated remaining: 3h 21m 13s. Rate: 7.1 symbols/min [2025-10-09T19:11:35.200082] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:35.198543] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-09T19:11:35.226344] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T19:11:35.273365] [DEBUG] [LOCAL ] GLOB: Loaded 47776 existing records from primary storage. [2025-10-09T19:11:35.273735] [INFO ] [MAIN ] GLOB: Loaded 47776 existing records. [2025-10-09T19:11:35.449806] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:35.450052] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-09T19:11:35.450100] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-09T19:11:35.450335] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-09T19:11:35.450394] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-09T19:11:35.800912] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:35.996717] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-09T19:11:36.507893] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-09T19:11:36.754790] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T19:11:36.796735] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-09T19:11:37.006586] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T19:11:37.596728] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-09T19:11:38.396769] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-09T19:11:38.468072] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T19:11:39.025563] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T19:11:39.196770] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-09T19:11:39.775004] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T19:11:39.996768] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-09T19:11:40.190966] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T19:11:40.796790] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-09T19:11:41.596718] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-09T19:11:41.669398] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T19:11:42.385881] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T19:11:42.397035] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-09T19:11:43.196743] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-09T19:11:43.259150] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:11:43.439952] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T19:11:43.996771] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-09T19:11:44.535508] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:11:44.539001] [INFO ] [REMOTE ] GKOS: Full fetch complete (60054 records). [2025-10-09T19:11:44.539128] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-09T19:11:44.801871] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-09T19:11:44.938891] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-09T19:11:44.938967] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-09T19:11:44.939776] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-09T19:11:44.939839] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-09T19:11:44.940960] [DEBUG] [LOCAL ] GKOS: Trimmed 60054 records to 42815 (keeping 200 days of data) [2025-10-09T19:11:45.197702] [DEBUG] [LOCAL ] GKOS: Primary data saved (42815 records). [2025-10-09T19:11:45.197905] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-09T19:11:45.198017] [INFO ] [MAIN ] Update Progress: 939/2373 symbols completed. GKOS took 31.7s. Estimated remaining: 3h 21m 7s. Rate: 7.1 symbols/min [2025-10-09T19:11:45.373255] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:45.384326] [DEBUG] [LOCAL ] GLP: Loaded 9242 existing records from primary storage. [2025-10-09T19:11:45.384572] [INFO ] [MAIN ] GLP: Loaded 9242 existing records. [2025-10-09T19:11:45.576699] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:45.577006] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-09T19:11:45.577222] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-09T19:11:45.577500] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-09T19:11:45.577734] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-09T19:11:45.601847] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-09T19:11:45.682138] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T19:11:46.016520] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:46.117856] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T19:11:46.396807] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-09T19:11:47.196694] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-09T19:11:47.563435] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T19:11:47.588862] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-09T19:11:47.595995] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-09T19:11:47.596203] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-09T19:11:47.803072] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-09T19:11:48.019534] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-09T19:11:48.023562] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-09T19:11:48.024829] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-09T19:11:48.025921] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-09T19:11:48.025988] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-09T19:11:48.027567] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 54062 (keeping 200 days of data) [2025-10-09T19:11:48.354662] [DEBUG] [LOCAL ] GIS: Primary data saved (54062 records). [2025-10-09T19:11:48.354808] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-09T19:11:48.355453] [INFO ] [MAIN ] Update Progress: 940/2373 symbols completed. GIS took 41.2s. Estimated remaining: 3h 20m 51s. Rate: 7.1 symbols/min [2025-10-09T19:11:48.524212] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:11:48.577090] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-09T19:11:48.577440] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-09T19:11:48.771018] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:11:48.772011] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T19:11:48.774761] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-09T19:11:48.775542] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-09T19:11:48.775867] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-09T19:11:48.775924] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-09T19:11:48.804756] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-09T19:11:49.126874] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:11:49.444825] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-09T19:11:49.596731] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-09T19:11:50.396705] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-09T19:11:51.203826] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-09T19:11:51.210490] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-09T19:11:51.996813] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-09T19:11:52.660502] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-09T19:11:52.797887] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T19:11:52.796994] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-09T19:11:53.244246] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T19:11:53.596685] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-09T19:11:53.740115] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T19:11:54.396733] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-09T19:11:55.196733] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-09T19:11:55.250248] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T19:11:55.249211] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T19:11:55.996720] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-09T19:11:56.796701] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-09T19:11:56.847835] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T19:11:57.268091] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-09T19:11:57.596777] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-09T19:11:58.313620] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T19:11:58.396697] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-09T19:11:58.950872] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T19:11:59.196787] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-09T19:11:59.830067] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T19:11:59.996791] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-09T19:12:00.746889] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:12:00.796664] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-09T19:12:01.348705] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T19:12:01.352582] [INFO ] [REMOTE ] GL: Full fetch complete (55211 records). [2025-10-09T19:12:01.352704] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-09T19:12:01.602449] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-09T19:12:01.752498] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-09T19:12:01.752590] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-09T19:12:01.753452] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-09T19:12:01.753523] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-09T19:12:01.754780] [DEBUG] [LOCAL ] GL: Trimmed 55211 records to 38074 (keeping 200 days of data) [2025-10-09T19:12:02.015765] [DEBUG] [LOCAL ] GL: Primary data saved (38074 records). [2025-10-09T19:12:02.015921] [INFO ] [MAIN ] GL: Full history saved. [2025-10-09T19:12:02.016023] [INFO ] [MAIN ] Update Progress: 941/2373 symbols completed. GL took 32.7s. Estimated remaining: 3h 20m 50s. Rate: 7.1 symbols/min [2025-10-09T19:12:02.193924] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:02.249082] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-09T19:12:02.249449] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-09T19:12:02.404789] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-09T19:12:02.432760] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:02.433344] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-09T19:12:02.433556] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-09T19:12:02.433945] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-09T19:12:02.434061] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-09T19:12:02.581905] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T19:12:02.598135] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-09T19:12:02.853364] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:03.196722] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-09T19:12:03.837059] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-09T19:12:03.996694] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-09T19:12:04.094193] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T19:12:04.796739] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-09T19:12:05.596690] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-09T19:12:05.795447] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T19:12:06.396684] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-09T19:12:06.877015] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T19:12:07.116658] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T19:12:07.196692] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-09T19:12:07.369414] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T19:12:07.996706] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-09T19:12:08.205373] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-09T19:12:08.796738] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-09T19:12:09.596743] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-09T19:12:10.205589] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-09T19:12:10.396724] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-09T19:12:10.726168] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T19:12:11.176820] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T19:12:11.178571] [INFO ] [REMOTE ] GLP: Full fetch complete (14283 records). [2025-10-09T19:12:11.178729] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-09T19:12:11.202988] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-09T19:12:11.570380] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-09T19:12:11.570553] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-09T19:12:11.571033] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-09T19:12:11.571244] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-09T19:12:11.600531] [DEBUG] [LOCAL ] GLP: Trimmed 14283 records to 9309 (keeping 200 days of data) [2025-10-09T19:12:11.603283] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T19:12:11.678777] [DEBUG] [LOCAL ] GLP: Primary data saved (9309 records). [2025-10-09T19:12:11.678954] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-09T19:12:11.679062] [INFO ] [MAIN ] Update Progress: 942/2373 symbols completed. GLP took 26.5s. Estimated remaining: 3h 20m 44s. Rate: 7.1 symbols/min [2025-10-09T19:12:11.852589] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:11.909030] [DEBUG] [LOCAL ] GME: Loaded 53783 existing records from primary storage. [2025-10-09T19:12:11.909388] [INFO ] [MAIN ] GME: Loaded 53783 existing records. [2025-10-09T19:12:12.005058] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-09T19:12:12.088290] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:12.088536] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-09T19:12:12.088606] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-09T19:12:12.088940] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-09T19:12:12.089048] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-09T19:12:12.436196] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:12.796823] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-09T19:12:13.503365] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-09T19:12:13.596669] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-09T19:12:13.750949] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T19:12:14.396682] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-09T19:12:14.467593] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:12:14.471786] [INFO ] [REMOTE ] GLOB: Full fetch complete (64708 records). [2025-10-09T19:12:14.471890] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-09T19:12:14.877849] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-09T19:12:14.877929] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-09T19:12:14.878786] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-09T19:12:14.878853] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-09T19:12:14.880330] [DEBUG] [LOCAL ] GLOB: Trimmed 64708 records to 48132 (keeping 200 days of data) [2025-10-09T19:12:15.172551] [DEBUG] [LOCAL ] GLOB: Primary data saved (48132 records). [2025-10-09T19:12:15.172739] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-09T19:12:15.172841] [INFO ] [MAIN ] Update Progress: 943/2373 symbols completed. GLOB took 40.2s. Estimated remaining: 3h 20m 28s. Rate: 7.1 symbols/min [2025-10-09T19:12:15.204729] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-09T19:12:15.364610] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:15.413979] [DEBUG] [LOCAL ] GMED: Loaded 48352 existing records from primary storage. [2025-10-09T19:12:15.414344] [INFO ] [MAIN ] GMED: Loaded 48352 existing records. [2025-10-09T19:12:15.632701] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:15.632934] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-09T19:12:15.633007] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-09T19:12:15.633609] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-09T19:12:15.633702] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-09T19:12:16.043536] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-09T19:12:16.078178] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-09T19:12:16.098877] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:16.798193] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-09T19:12:16.803986] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-09T19:12:17.161890] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-09T19:12:17.596687] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-09T19:12:17.893616] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T19:12:18.365042] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T19:12:18.396679] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-09T19:12:19.196706] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-09T19:12:19.285569] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T19:12:19.762373] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T19:12:19.996720] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-09T19:12:20.796761] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-09T19:12:21.528542] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T19:12:21.586172] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-09T19:12:21.596843] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-09T19:12:22.396791] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-09T19:12:22.915765] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-09T19:12:23.196711] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-09T19:12:23.240614] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T19:12:23.996750] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-09T19:12:24.173280] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T19:12:24.796715] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-09T19:12:25.331364] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-09T19:12:25.336165] [INFO ] [REMOTE ] GLW: Full fetch complete (77622 records). [2025-10-09T19:12:25.336277] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-09T19:12:25.601924] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-09T19:12:25.769335] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-09T19:12:25.769488] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-09T19:12:25.771135] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-09T19:12:25.772727] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-09T19:12:25.772617] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T19:12:25.784601] [DEBUG] [LOCAL ] GLW: Trimmed 77622 records to 54026 (keeping 200 days of data) [2025-10-09T19:12:26.124096] [DEBUG] [LOCAL ] GLW: Primary data saved (54026 records). [2025-10-09T19:12:26.124238] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-09T19:12:26.124931] [INFO ] [MAIN ] Update Progress: 944/2373 symbols completed. GLW took 37.8s. Estimated remaining: 3h 20m 23s. Rate: 7.1 symbols/min [2025-10-09T19:12:26.297619] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:26.336963] [DEBUG] [LOCAL ] GMRE: Loaded 37133 existing records from primary storage. [2025-10-09T19:12:26.337246] [INFO ] [MAIN ] GMRE: Loaded 37133 existing records. [2025-10-09T19:12:26.400833] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-09T19:12:26.517192] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:26.517588] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-09T19:12:26.517776] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-09T19:12:26.518222] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-09T19:12:26.518280] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-09T19:12:26.924966] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:26.962280] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-09T19:12:27.196692] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-09T19:12:27.559265] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-09T19:12:27.996698] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-09T19:12:28.175685] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:12:28.569238] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T19:12:28.796705] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-09T19:12:29.596727] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-09T19:12:30.155843] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T19:12:30.396753] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-09T19:12:30.460693] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-09T19:12:31.189502] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-09T19:12:31.198792] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-09T19:12:31.694314] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T19:12:31.996771] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-09T19:12:32.796720] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-09T19:12:33.374020] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-09T19:12:33.596718] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-09T19:12:33.810470] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:12:34.396738] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-09T19:12:35.096231] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-09T19:12:35.196675] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-09T19:12:35.623830] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-09T19:12:35.724637] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T19:12:35.996815] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-09T19:12:36.796749] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-09T19:12:37.439574] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-09T19:12:37.541939] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-09T19:12:37.596689] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-09T19:12:38.396750] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-09T19:12:38.734963] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T19:12:38.857966] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T19:12:39.196764] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-09T19:12:39.728507] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T19:12:39.996719] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-09T19:12:40.796765] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-09T19:12:41.421783] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:12:41.596701] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-09T19:12:41.724780] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-09T19:12:42.070541] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:12:42.396770] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-09T19:12:42.652203] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-09T19:12:43.196771] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-09T19:12:43.996817] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-09T19:12:44.678855] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T19:12:44.683079] [INFO ] [REMOTE ] GMED: Full fetch complete (69721 records). [2025-10-09T19:12:44.683188] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-09T19:12:44.798739] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-09T19:12:45.113822] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-09T19:12:45.114054] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-09T19:12:45.115717] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-09T19:12:45.115813] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-09T19:12:45.117509] [DEBUG] [LOCAL ] GMED: Trimmed 69721 records to 48701 (keeping 200 days of data) [2025-10-09T19:12:45.242164] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-10-09T19:12:45.443372] [DEBUG] [LOCAL ] GMED: Primary data saved (48701 records). [2025-10-09T19:12:45.443506] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-09T19:12:45.443602] [INFO ] [MAIN ] Update Progress: 945/2373 symbols completed. GMED took 30.3s. Estimated remaining: 3h 20m 31s. Rate: 7.1 symbols/min [2025-10-09T19:12:45.611389] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-09T19:12:45.613891] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:45.632865] [DEBUG] [LOCAL ] GNE: Loaded 17869 existing records from primary storage. [2025-10-09T19:12:45.633100] [INFO ] [MAIN ] GNE: Loaded 17869 existing records. [2025-10-09T19:12:45.816307] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:45.816582] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-09T19:12:45.816669] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-09T19:12:45.816938] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-09T19:12:45.816996] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-09T19:12:46.079251] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-09T19:12:46.114147] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-09T19:12:46.117411] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-09T19:12:46.295401] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:46.326348] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T19:12:46.407186] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-09T19:12:46.626079] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-09T19:12:46.626166] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-09T19:12:46.627133] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-09T19:12:46.627199] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-09T19:12:46.628761] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54119 (keeping 200 days of data) [2025-10-09T19:12:46.965931] [DEBUG] [LOCAL ] GM: Primary data saved (54119 records). [2025-10-09T19:12:46.966072] [INFO ] [MAIN ] GM: Full history saved. [2025-10-09T19:12:46.966229] [INFO ] [MAIN ] Update Progress: 946/2373 symbols completed. GM took 45.0s. Estimated remaining: 3h 20m 12s. Rate: 7.1 symbols/min [2025-10-09T19:12:47.149314] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:47.188517] [DEBUG] [LOCAL ] GNK: Loaded 40257 existing records from primary storage. [2025-10-09T19:12:47.188872] [INFO ] [MAIN ] GNK: Loaded 40257 existing records. [2025-10-09T19:12:47.201826] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-09T19:12:47.384102] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:47.384357] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-09T19:12:47.384417] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-09T19:12:47.384682] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-09T19:12:47.384742] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-09T19:12:47.760309] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:47.943277] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T19:12:47.962134] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T19:12:48.002997] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-09T19:12:48.008541] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-09T19:12:48.801829] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-09T19:12:48.804381] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T19:12:49.596742] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-09T19:12:49.977824] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T19:12:49.980388] [INFO ] [REMOTE ] GMRE: Full fetch complete (52899 records). [2025-10-09T19:12:49.980480] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-09T19:12:50.397009] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-09T19:12:50.413361] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-09T19:12:50.413470] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-09T19:12:50.415439] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-09T19:12:50.416038] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-09T19:12:50.418123] [DEBUG] [LOCAL ] GMRE: Trimmed 52899 records to 37301 (keeping 200 days of data) [2025-10-09T19:12:50.774332] [DEBUG] [LOCAL ] GMRE: Primary data saved (37301 records). [2025-10-09T19:12:50.774716] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-09T19:12:50.775375] [INFO ] [MAIN ] Update Progress: 947/2373 symbols completed. GMRE took 24.7s. Estimated remaining: 3h 19m 57s. Rate: 7.1 symbols/min [2025-10-09T19:12:51.083812] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:51.109610] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:12:51.163239] [DEBUG] [LOCAL ] GNL: Loaded 46764 existing records from primary storage. [2025-10-09T19:12:51.163633] [INFO ] [MAIN ] GNL: Loaded 46764 existing records. [2025-10-09T19:12:51.201966] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-09T19:12:51.380462] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:51.380722] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-09T19:12:51.380780] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-09T19:12:51.381049] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-09T19:12:51.381107] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-09T19:12:51.760372] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:51.996721] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-09T19:12:52.635634] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T19:12:52.796771] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-09T19:12:52.996981] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-09T19:12:53.164330] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T19:12:53.537392] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T19:12:53.596703] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-09T19:12:54.195285] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T19:12:54.396802] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-09T19:12:55.196744] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-09T19:12:55.996713] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-09T19:12:56.061631] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T19:12:56.796795] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-09T19:12:57.376824] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T19:12:57.470404] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T19:12:57.596688] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-09T19:12:57.715156] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-09T19:12:57.719712] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-09T19:12:57.719827] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-09T19:12:58.116078] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-09T19:12:58.116282] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-09T19:12:58.117297] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-09T19:12:58.117364] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-09T19:12:58.119005] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 54173 (keeping 200 days of data) [2025-10-09T19:12:58.402350] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-09T19:12:58.454702] [DEBUG] [LOCAL ] GME: Primary data saved (54173 records). [2025-10-09T19:12:58.454834] [INFO ] [MAIN ] GME: Full history saved. [2025-10-09T19:12:58.455724] [INFO ] [MAIN ] Update Progress: 948/2373 symbols completed. GME took 46.8s. Estimated remaining: 3h 19m 48s. Rate: 7.1 symbols/min [2025-10-09T19:12:58.633068] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:12:58.682164] [DEBUG] [LOCAL ] GNRC: Loaded 45257 existing records from primary storage. [2025-10-09T19:12:58.682485] [INFO ] [MAIN ] GNRC: Loaded 45257 existing records. [2025-10-09T19:12:58.871557] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:12:58.871826] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-09T19:12:58.871878] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-09T19:12:58.872144] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-09T19:12:58.872204] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-09T19:12:59.213493] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-09T19:12:59.256800] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:12:59.280730] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T19:12:59.375275] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-09T19:12:59.996734] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-09T19:13:00.796743] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-09T19:13:01.036610] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T19:13:01.596702] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-09T19:13:01.710885] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:13:02.192133] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T19:13:02.396755] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-09T19:13:03.196769] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-09T19:13:03.231388] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:13:03.919421] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T19:13:03.996690] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-09T19:13:04.796700] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-09T19:13:04.841614] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T19:13:05.275688] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-09T19:13:05.596741] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-09T19:13:06.259495] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:13:06.396732] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-09T19:13:06.739068] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T19:13:07.196761] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-09T19:13:07.830460] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:13:07.996689] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-09T19:13:08.357519] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T19:13:08.796743] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-09T19:13:09.475236] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T19:13:09.596685] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-09T19:13:09.881842] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T19:13:10.396799] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-09T19:13:10.841559] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T19:13:11.196725] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-09T19:13:11.330027] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T19:13:11.996691] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-09T19:13:12.699434] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T19:13:12.796739] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-09T19:13:13.456216] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:13:13.596796] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-09T19:13:14.396705] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-09T19:13:14.513792] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T19:13:14.515326] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T19:13:14.527030] [INFO ] [REMOTE ] GNE: Full fetch complete (22467 records). [2025-10-09T19:13:14.527392] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-09T19:13:14.901372] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-09T19:13:14.901445] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-09T19:13:14.901928] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-09T19:13:14.901990] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-09T19:13:14.902611] [DEBUG] [LOCAL ] GNE: Trimmed 22467 records to 17962 (keeping 200 days of data) [2025-10-09T19:13:15.022949] [DEBUG] [LOCAL ] GNE: Primary data saved (17962 records). [2025-10-09T19:13:15.023062] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-09T19:13:15.023142] [INFO ] [MAIN ] Update Progress: 949/2373 symbols completed. GNE took 29.6s. Estimated remaining: 3h 19m 51s. Rate: 7.1 symbols/min [2025-10-09T19:13:15.190735] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:15.196919] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-09T19:13:15.202361] [DEBUG] [LOCAL ] GNT: Loaded 8298 existing records from primary storage. [2025-10-09T19:13:15.202620] [INFO ] [MAIN ] GNT: Loaded 8298 existing records. [2025-10-09T19:13:15.395336] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:15.395552] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-09T19:13:15.395612] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-09T19:13:15.395863] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-09T19:13:15.395922] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-09T19:13:15.757771] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:15.790032] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T19:13:15.996738] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-09T19:13:16.390202] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T19:13:16.796733] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-09T19:13:17.525111] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:13:17.596678] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-09T19:13:18.061878] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T19:13:18.396721] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-09T19:13:18.838924] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T19:13:19.196781] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-09T19:13:19.642758] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:13:19.996753] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-09T19:13:20.287799] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T19:13:20.796773] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-09T19:13:21.083845] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-09T19:13:21.088879] [INFO ] [REMOTE ] GNL: Full fetch complete (68102 records). [2025-10-09T19:13:21.089015] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-09T19:13:21.473031] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-09T19:13:21.473122] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-09T19:13:21.474049] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-09T19:13:21.474115] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-09T19:13:21.475489] [DEBUG] [LOCAL ] GNL: Trimmed 68102 records to 47094 (keeping 200 days of data) [2025-10-09T19:13:21.638992] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-09T19:13:21.747729] [DEBUG] [LOCAL ] GNL: Primary data saved (47094 records). [2025-10-09T19:13:21.747876] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-09T19:13:21.748431] [INFO ] [MAIN ] Update Progress: 950/2373 symbols completed. GNL took 31.0s. Estimated remaining: 3h 19m 40s. Rate: 7.1 symbols/min [2025-10-09T19:13:21.916620] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:21.973017] [DEBUG] [LOCAL ] GNW: Loaded 51342 existing records from primary storage. [2025-10-09T19:13:21.973378] [INFO ] [MAIN ] GNW: Loaded 51342 existing records. [2025-10-09T19:13:22.138168] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:13:22.168333] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:22.168487] [INFO ] [REMOTE ] GNK: Full fetch complete (57204 records). [2025-10-09T19:13:22.168820] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-09T19:13:22.168988] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-09T19:13:22.169217] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-09T19:13:22.169736] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-09T19:13:22.200948] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-09T19:13:22.355052] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-09T19:13:22.397835] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-09T19:13:23.010804] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:23.011065] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-09T19:13:23.012212] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T19:13:23.012283] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-09T19:13:23.015545] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-09T19:13:23.015620] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-09T19:13:23.016854] [DEBUG] [LOCAL ] GNK: Trimmed 57204 records to 40519 (keeping 200 days of data) [2025-10-09T19:13:23.202789] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-09T19:13:23.290610] [DEBUG] [LOCAL ] GNK: Primary data saved (40519 records). [2025-10-09T19:13:23.290785] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-09T19:13:23.290878] [INFO ] [MAIN ] Update Progress: 951/2373 symbols completed. GNK took 36.3s. Estimated remaining: 3h 19m 22s. Rate: 7.1 symbols/min [2025-10-09T19:13:23.469630] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:23.512851] [DEBUG] [LOCAL ] GOF: Loaded 42523 existing records from primary storage. [2025-10-09T19:13:23.513208] [INFO ] [MAIN ] GOF: Loaded 42523 existing records. [2025-10-09T19:13:23.691283] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:23.691521] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-09T19:13:23.691589] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-09T19:13:23.692108] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-09T19:13:23.692169] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-09T19:13:23.864183] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T19:13:24.001795] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-09T19:13:24.066518] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:24.796729] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-09T19:13:25.596754] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-09T19:13:25.741975] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T19:13:26.251039] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T19:13:26.396754] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-09T19:13:27.024204] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:13:27.196709] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-09T19:13:27.996692] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-09T19:13:28.085402] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T19:13:28.528815] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T19:13:28.796798] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-09T19:13:29.343194] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T19:13:29.596731] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-09T19:13:30.125424] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T19:13:30.155880] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T19:13:30.396732] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-09T19:13:30.849964] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T19:13:31.196757] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-09T19:13:31.996732] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-09T19:13:32.700490] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T19:13:32.730158] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T19:13:32.796750] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-09T19:13:33.559768] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T19:13:33.596677] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-09T19:13:34.396746] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-09T19:13:34.403834] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T19:13:35.196770] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-09T19:13:35.996700] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-09T19:13:36.165953] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T19:13:36.728263] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T19:13:36.796688] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-09T19:13:37.407666] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T19:13:37.596697] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-09T19:13:38.152726] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:13:38.396724] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-09T19:13:39.014890] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T19:13:39.196698] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-09T19:13:39.256499] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:13:39.996770] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-09T19:13:40.796710] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-09T19:13:40.846511] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T19:13:41.326420] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-09T19:13:41.596718] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-09T19:13:41.662682] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:13:41.666636] [INFO ] [REMOTE ] GNRC: Full fetch complete (65372 records). [2025-10-09T19:13:41.666786] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-09T19:13:42.047986] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-09T19:13:42.048070] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-09T19:13:42.048951] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-09T19:13:42.049020] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-09T19:13:42.050359] [DEBUG] [LOCAL ] GNRC: Trimmed 65372 records to 45593 (keeping 200 days of data) [2025-10-09T19:13:42.326921] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T19:13:42.331120] [INFO ] [REMOTE ] GNT: Full fetch complete (11053 records). [2025-10-09T19:13:42.332256] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-09T19:13:42.397944] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-09T19:13:42.430593] [DEBUG] [LOCAL ] GNRC: Primary data saved (45593 records). [2025-10-09T19:13:42.441282] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-09T19:13:42.442148] [INFO ] [MAIN ] Update Progress: 952/2373 symbols completed. GNRC took 44.0s. Estimated remaining: 3h 19m 29s. Rate: 7.1 symbols/min [2025-10-09T19:13:42.812288] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:42.890838] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-09T19:13:42.890930] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-09T19:13:42.891217] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-09T19:13:42.891299] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-09T19:13:42.891913] [DEBUG] [LOCAL ] GNT: Trimmed 11053 records to 8376 (keeping 200 days of data) [2025-10-09T19:13:42.972701] [DEBUG] [LOCAL ] GOLF: Loaded 31026 existing records from primary storage. [2025-10-09T19:13:42.971611] [DEBUG] [LOCAL ] GNT: Primary data saved (8376 records). [2025-10-09T19:13:42.973095] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-09T19:13:42.973298] [INFO ] [MAIN ] GOLF: Loaded 31026 existing records. [2025-10-09T19:13:42.973446] [INFO ] [MAIN ] Update Progress: 953/2373 symbols completed. GNT took 28.0s. Estimated remaining: 3h 19m 9s. Rate: 7.1 symbols/min [2025-10-09T19:13:43.213696] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-09T19:13:43.416612] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:43.432890] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-09T19:13:43.432975] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-09T19:13:43.433310] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-09T19:13:43.433381] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-09T19:13:43.517327] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:43.884709] [DEBUG] [LOCAL ] GOOS: Loaded 44801 existing records from primary storage. [2025-10-09T19:13:43.908538] [INFO ] [MAIN ] GOOS: Loaded 44801 existing records. [2025-10-09T19:13:44.076526] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:44.087334] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-09T19:13:44.189331] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:44.189962] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-09T19:13:44.190036] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-09T19:13:44.202820] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-09T19:13:44.208042] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-09T19:13:44.324425] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-09T19:13:44.592124] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:44.796735] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-09T19:13:44.947673] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-09T19:13:44.997718] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T19:13:45.596794] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-09T19:13:46.396776] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-09T19:13:46.619780] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T19:13:46.657009] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T19:13:47.196766] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-09T19:13:47.962349] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T19:13:47.996789] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-09T19:13:48.716149] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T19:13:48.796765] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-09T19:13:49.096107] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T19:13:49.596760] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-09T19:13:50.350452] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:13:50.396680] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-09T19:13:51.196773] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-09T19:13:51.308630] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T19:13:51.996691] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-09T19:13:52.090129] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-09T19:13:52.696104] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T19:13:52.796710] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-09T19:13:53.439545] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:13:53.444097] [INFO ] [REMOTE ] GNW: Full fetch complete (73677 records). [2025-10-09T19:13:53.444221] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-09T19:13:53.602439] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-09T19:13:53.860057] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-09T19:13:53.860267] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-09T19:13:53.861286] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-09T19:13:53.861380] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-09T19:13:53.862904] [DEBUG] [LOCAL ] GNW: Trimmed 73677 records to 51730 (keeping 200 days of data) [2025-10-09T19:13:54.091536] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:13:54.199281] [DEBUG] [LOCAL ] GNW: Primary data saved (51730 records). [2025-10-09T19:13:54.199434] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-09T19:13:54.200034] [INFO ] [MAIN ] Update Progress: 954/2373 symbols completed. GNW took 32.5s. Estimated remaining: 3h 19m 5s. Rate: 7.1 symbols/min [2025-10-09T19:13:54.371989] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:13:54.396742] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-09T19:13:54.411547] [DEBUG] [LOCAL ] GOTU: Loaded 37800 existing records from primary storage. [2025-10-09T19:13:54.411883] [INFO ] [MAIN ] GOTU: Loaded 37800 existing records. [2025-10-09T19:13:54.597724] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:13:54.598277] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-09T19:13:54.598338] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-09T19:13:54.598964] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-09T19:13:54.599025] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-09T19:13:54.967431] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:13:55.138723] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:13:55.196702] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-09T19:13:55.892386] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T19:13:55.996745] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-09T19:13:56.301301] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-09T19:13:56.796746] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-09T19:13:57.439934] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T19:13:57.596701] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-09T19:13:58.396704] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-09T19:13:58.433227] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T19:13:58.777624] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T19:13:59.196725] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-09T19:13:59.921454] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T19:13:59.964428] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-09T19:13:59.996674] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-09T19:14:00.796718] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-09T19:14:01.156609] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T19:14:01.596697] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-09T19:14:02.161548] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T19:14:02.165198] [INFO ] [REMOTE ] GOF: Full fetch complete (62040 records). [2025-10-09T19:14:02.165298] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-09T19:14:02.401904] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-09T19:14:02.548980] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-09T19:14:02.549056] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-09T19:14:02.549873] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-09T19:14:02.549935] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-09T19:14:02.551105] [DEBUG] [LOCAL ] GOF: Trimmed 62040 records to 42828 (keeping 200 days of data) [2025-10-09T19:14:02.814094] [DEBUG] [LOCAL ] GOF: Primary data saved (42828 records). [2025-10-09T19:14:02.814224] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-09T19:14:02.814318] [INFO ] [MAIN ] Update Progress: 955/2373 symbols completed. GOF took 39.5s. Estimated remaining: 3h 18m 57s. Rate: 7.1 symbols/min [2025-10-09T19:14:02.978615] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:03.024876] [DEBUG] [LOCAL ] GPC: Loaded 46159 existing records from primary storage. [2025-10-09T19:14:03.025195] [INFO ] [MAIN ] GPC: Loaded 46159 existing records. [2025-10-09T19:14:03.202353] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-09T19:14:03.207983] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:03.208254] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-09T19:14:03.208309] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-09T19:14:03.208503] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-09T19:14:03.208559] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-09T19:14:03.410047] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T19:14:03.644680] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:03.646436] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T19:14:03.996773] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-09T19:14:04.331684] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:14:04.796720] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-09T19:14:05.517963] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:14:05.596672] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-09T19:14:06.008390] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T19:14:06.396724] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-09T19:14:07.139794] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:14:07.196669] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-09T19:14:07.996694] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-09T19:14:08.050742] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T19:14:08.758740] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:14:08.796664] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-09T19:14:09.151062] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T19:14:09.596781] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-09T19:14:10.309055] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T19:14:10.396676] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-09T19:14:11.196791] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-09T19:14:11.239514] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T19:14:11.605513] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T19:14:11.996750] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-09T19:14:12.321730] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T19:14:12.324377] [INFO ] [REMOTE ] GOLF: Full fetch complete (45076 records). [2025-10-09T19:14:12.324486] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-09T19:14:12.728979] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-09T19:14:12.729060] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-09T19:14:12.729819] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-09T19:14:12.729883] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-09T19:14:12.731195] [DEBUG] [LOCAL ] GOLF: Trimmed 45076 records to 31223 (keeping 200 days of data) [2025-10-09T19:14:12.802584] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-09T19:14:12.950791] [DEBUG] [LOCAL ] GOLF: Primary data saved (31223 records). [2025-10-09T19:14:12.950954] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-09T19:14:12.951046] [INFO ] [MAIN ] Update Progress: 956/2373 symbols completed. GOLF took 30.5s. Estimated remaining: 3h 18m 51s. Rate: 7.1 symbols/min [2025-10-09T19:14:13.153462] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:13.169790] [DEBUG] [LOCAL ] GPI: Loaded 14622 existing records from primary storage. [2025-10-09T19:14:13.170032] [INFO ] [MAIN ] GPI: Loaded 14622 existing records. [2025-10-09T19:14:13.380016] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:13.380310] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-09T19:14:13.380362] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-09T19:14:13.380527] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-09T19:14:13.380567] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-09T19:14:13.605485] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-09T19:14:13.822901] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:13.851198] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:14:14.315486] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T19:14:14.396668] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-09T19:14:15.117426] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-09T19:14:15.196735] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-09T19:14:15.854634] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:14:15.996711] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-09T19:14:16.741969] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T19:14:16.796674] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-09T19:14:17.433170] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-09T19:14:17.596725] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-09T19:14:17.873140] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-09T19:14:18.396779] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-09T19:14:18.831898] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T19:14:19.196742] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-09T19:14:19.665574] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:14:19.996760] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-09T19:14:20.796738] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-09T19:14:20.952171] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T19:14:21.457829] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T19:14:21.461662] [INFO ] [REMOTE ] GOOS: Full fetch complete (65114 records). [2025-10-09T19:14:21.461794] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-09T19:14:21.601883] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-09T19:14:21.851666] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-09T19:14:21.851872] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-09T19:14:21.852801] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-09T19:14:21.852894] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-09T19:14:21.854180] [DEBUG] [LOCAL ] GOOS: Trimmed 65114 records to 45117 (keeping 200 days of data) [2025-10-09T19:14:21.983820] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T19:14:22.147432] [DEBUG] [LOCAL ] GOOS: Primary data saved (45117 records). [2025-10-09T19:14:22.147565] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-09T19:14:22.147669] [INFO ] [MAIN ] Update Progress: 957/2373 symbols completed. GOOS took 39.2s. Estimated remaining: 3h 18m 44s. Rate: 7.1 symbols/min [2025-10-09T19:14:22.396677] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-09T19:14:22.602815] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T19:14:23.196793] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-09T19:14:23.544729] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T19:14:23.996730] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-09T19:14:24.751262] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T19:14:24.796688] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-09T19:14:25.413768] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T19:14:25.596735] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-09T19:14:26.060572] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T19:14:26.396736] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-09T19:14:26.511719] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T19:14:26.514679] [INFO ] [REMOTE ] GOTU: Full fetch complete (58701 records). [2025-10-09T19:14:26.514764] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-09T19:14:26.926439] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-09T19:14:26.926514] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-09T19:14:26.927317] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-09T19:14:26.927379] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-09T19:14:26.928454] [DEBUG] [LOCAL ] GOTU: Trimmed 58701 records to 37996 (keeping 200 days of data) [2025-10-09T19:14:27.145113] [DEBUG] [LOCAL ] GOTU: Primary data saved (37996 records). [2025-10-09T19:14:27.145295] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-09T19:14:27.145888] [INFO ] [MAIN ] Update Progress: 958/2373 symbols completed. GOTU took 32.9s. Estimated remaining: 3h 18m 30s. Rate: 7.1 symbols/min [2025-10-09T19:14:27.196756] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-09T19:14:27.879005] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-09T19:14:27.883489] [INFO ] [REMOTE ] GPC: Full fetch complete (68787 records). [2025-10-09T19:14:27.883631] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-09T19:14:28.222635] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T19:14:28.262192] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-09T19:14:28.301401] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-09T19:14:28.301487] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-09T19:14:28.302492] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-09T19:14:28.302564] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-09T19:14:28.304056] [DEBUG] [LOCAL ] GPC: Trimmed 68787 records to 46526 (keeping 200 days of data) [2025-10-09T19:14:28.607771] [DEBUG] [LOCAL ] GPC: Primary data saved (46526 records). [2025-10-09T19:14:28.607962] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-09T19:14:28.608057] [INFO ] [MAIN ] Update Progress: 959/2373 symbols completed. GPC took 25.8s. Estimated remaining: 3h 18m 12s. Rate: 7.1 symbols/min [2025-10-09T19:14:29.226740] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T19:14:29.229827] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-09T19:14:30.419600] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-09T19:14:30.423964] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-09T19:14:31.569840] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T19:14:31.574407] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-09T19:14:32.456254] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T19:14:32.459165] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-09T19:14:33.454948] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T19:14:33.458542] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-09T19:14:34.138802] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:14:34.142889] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-09T19:14:34.983377] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-09T19:14:34.986968] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-09T19:14:35.949281] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T19:14:35.955452] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-09T19:14:37.002354] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T19:14:37.004095] [INFO ] [REMOTE ] GPI: Full fetch complete (21138 records). [2025-10-09T19:14:37.004195] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-09T19:14:37.385313] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-09T19:14:37.385393] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-09T19:14:37.385901] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-09T19:14:37.385962] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-09T19:14:37.386519] [DEBUG] [LOCAL ] GPI: Trimmed 21138 records to 14741 (keeping 200 days of data) [2025-10-09T19:14:37.481965] [DEBUG] [LOCAL ] GPI: Primary data saved (14741 records). [2025-10-09T19:14:37.482119] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-09T19:14:37.482220] [INFO ] [MAIN ] Update Progress: 960/2373 symbols completed. GPI took 24.5s. Estimated remaining: 3h 18m 4s. Rate: 7.1 symbols/min [2025-10-09T19:14:38.062787] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:38.205036] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:38.252944] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:38.237809] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:14:38.270865] [DEBUG] [LOCAL ] GPJA: Loaded 4265 existing records from primary storage. [2025-10-09T19:14:38.271283] [INFO ] [MAIN ] GPJA: Loaded 4265 existing records. [2025-10-09T19:14:38.354138] [DEBUG] [LOCAL ] GPMT: Loaded 25869 existing records from primary storage. [2025-10-09T19:14:38.378591] [INFO ] [MAIN ] GPMT: Loaded 25869 existing records. [2025-10-09T19:14:38.624312] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:38.625135] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-09T19:14:38.625334] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-09T19:14:38.688421] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-09T19:14:38.689564] [DEBUG] [LOCAL ] GPK: Loaded 52672 existing records from primary storage. [2025-10-09T19:14:38.711973] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-09T19:14:38.737521] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:38.776617] [INFO ] [MAIN ] GPK: Loaded 52672 existing records. [2025-10-09T19:14:38.770861] [DEBUG] [LOCAL ] GPN: Loaded 52027 existing records from primary storage. [2025-10-09T19:14:38.796922] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-09T19:14:38.802445] [INFO ] [MAIN ] GPN: Loaded 52027 existing records. [2025-10-09T19:14:38.826675] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-09T19:14:38.896932] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-09T19:14:38.927803] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-09T19:14:39.487240] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:39.502830] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-09T19:14:39.492397] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:14:39.525467] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-09T19:14:39.562880] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-09T19:14:39.621842] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-09T19:14:39.611550] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-09T19:14:39.651207] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-09T19:14:39.769938] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-09T19:14:39.784635] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-09T19:14:40.078551] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:40.136030] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-09T19:14:40.218766] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:40.265007] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-09T19:14:40.539589] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:40.551505] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-09T19:14:40.658463] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:14:40.658874] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-09T19:14:40.885631] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T19:14:40.887790] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-09T19:14:41.574194] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-09T19:14:41.577355] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-09T19:14:41.614564] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T19:14:41.620919] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-09T19:14:41.829032] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T19:14:41.839197] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-09T19:14:42.171694] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:14:42.182068] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-09T19:14:42.186053] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T19:14:42.396744] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-09T19:14:42.634470] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:14:42.868838] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T19:14:43.196711] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-09T19:14:43.247902] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:14:43.511768] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T19:14:43.907408] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-09T19:14:43.996783] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-09T19:14:44.469546] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-09T19:14:44.796767] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-09T19:14:45.596715] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-09T19:14:45.936309] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T19:14:46.187206] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-09T19:14:46.396737] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-09T19:14:47.196784] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-09T19:14:48.002828] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-09T19:14:48.005420] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-09T19:14:48.796674] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-09T19:14:48.850638] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-09T19:14:49.108444] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T19:14:49.596722] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-09T19:14:50.162593] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-09T19:14:50.396688] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-09T19:14:50.566158] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T19:14:51.196809] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-09T19:14:51.616576] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-09T19:14:51.996687] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-09T19:14:52.117118] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T19:14:52.796715] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-09T19:14:53.282453] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T19:14:53.558921] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T19:14:53.596678] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-09T19:14:54.396781] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-09T19:14:55.196750] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-09T19:14:55.316717] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:14:55.772189] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T19:14:55.996761] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-09T19:14:56.796755] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-09T19:14:57.048206] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:14:57.183562] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-09T19:14:57.596800] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-09T19:14:58.079107] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-09T19:14:58.396734] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-09T19:14:59.029968] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:14:59.196700] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-09T19:14:59.943468] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:14:59.996692] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-09T19:15:00.796703] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-09T19:15:00.893322] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-09T19:15:01.404756] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T19:15:01.405679] [INFO ] [REMOTE ] GPJA: Full fetch complete (7182 records). [2025-10-09T19:15:01.405765] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-09T19:15:01.606226] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-09T19:15:01.801129] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-09T19:15:01.801338] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-09T19:15:01.801614] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-09T19:15:01.801732] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-09T19:15:01.802195] [DEBUG] [LOCAL ] GPJA: Trimmed 7182 records to 4288 (keeping 200 days of data) [2025-10-09T19:15:01.834850] [DEBUG] [LOCAL ] GPJA: Primary data saved (4288 records). [2025-10-09T19:15:01.866205] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-09T19:15:01.869526] [INFO ] [MAIN ] Update Progress: 961/2373 symbols completed. GPJA took 24.4s. Estimated remaining: 3h 18m 19s. Rate: 7.1 symbols/min [2025-10-09T19:15:01.904881] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-09T19:15:02.064200] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:02.093605] [DEBUG] [LOCAL ] GPOR: Loaded 23230 existing records from primary storage. [2025-10-09T19:15:02.093970] [INFO ] [MAIN ] GPOR: Loaded 23230 existing records. [2025-10-09T19:15:02.287535] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:02.287852] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-09T19:15:02.287909] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-09T19:15:02.288102] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-09T19:15:02.288159] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-09T19:15:02.401804] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-09T19:15:02.685782] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:02.807610] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T19:15:03.196717] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-09T19:15:03.996691] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-09T19:15:04.338889] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-09T19:15:04.593683] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-09T19:15:04.796734] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-09T19:15:04.988824] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T19:15:05.596757] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-09T19:15:06.396707] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-09T19:15:06.590853] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T19:15:07.196694] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-09T19:15:07.294394] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T19:15:07.600197] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T19:15:07.905112] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T19:15:07.996731] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-09T19:15:08.796785] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-09T19:15:08.878215] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T19:15:08.880280] [INFO ] [REMOTE ] GPMT: Full fetch complete (37014 records). [2025-10-09T19:15:08.880354] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-09T19:15:09.250178] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-09T19:15:09.250257] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-09T19:15:09.250878] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-09T19:15:09.250940] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-09T19:15:09.251777] [DEBUG] [LOCAL ] GPMT: Trimmed 37014 records to 26009 (keeping 200 days of data) [2025-10-09T19:15:09.401765] [DEBUG] [LOCAL ] GPMT: Primary data saved (26009 records). [2025-10-09T19:15:09.401899] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-09T19:15:09.402015] [INFO ] [MAIN ] Update Progress: 962/2373 symbols completed. GPMT took 31.9s. Estimated remaining: 3h 18m 9s. Rate: 7.1 symbols/min [2025-10-09T19:15:09.575633] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:09.598353] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-09T19:15:09.615404] [DEBUG] [LOCAL ] GPRK: Loaded 39463 existing records from primary storage. [2025-10-09T19:15:09.615748] [INFO ] [MAIN ] GPRK: Loaded 39463 existing records. [2025-10-09T19:15:09.790413] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:09.790696] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-09T19:15:09.790755] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-09T19:15:09.790996] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-09T19:15:09.791053] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-09T19:15:10.174216] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:10.396680] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-09T19:15:10.539444] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T19:15:11.126024] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T19:15:11.130742] [INFO ] [REMOTE ] GPK: Full fetch complete (75619 records). [2025-10-09T19:15:11.130895] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-09T19:15:11.201911] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-09T19:15:11.545888] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-09T19:15:11.546038] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-09T19:15:11.547017] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-09T19:15:11.547099] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-09T19:15:11.548601] [DEBUG] [LOCAL ] GPK: Trimmed 75619 records to 53056 (keeping 200 days of data) [2025-10-09T19:15:11.805483] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:15:11.910550] [DEBUG] [LOCAL ] GPK: Primary data saved (53056 records). [2025-10-09T19:15:11.910710] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-09T19:15:11.910806] [INFO ] [MAIN ] Update Progress: 963/2373 symbols completed. GPK took 34.4s. Estimated remaining: 3h 17m 52s. Rate: 7.1 symbols/min [2025-10-09T19:15:12.004008] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-09T19:15:12.085443] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:12.116936] [DEBUG] [LOCAL ] GRBK: Loaded 26912 existing records from primary storage. [2025-10-09T19:15:12.117526] [INFO ] [MAIN ] GRBK: Loaded 26912 existing records. [2025-10-09T19:15:12.297350] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:12.297610] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-09T19:15:12.297720] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-09T19:15:12.298088] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-09T19:15:12.298206] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-09T19:15:12.656074] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:12.796693] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-09T19:15:13.009452] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T19:15:13.312165] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T19:15:13.596766] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-09T19:15:13.971940] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T19:15:14.396686] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-09T19:15:14.808998] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-09T19:15:15.196721] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-09T19:15:15.996705] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-09T19:15:16.087812] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T19:15:16.425148] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T19:15:16.796782] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-09T19:15:17.295516] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T19:15:17.596720] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-09T19:15:18.396709] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-09T19:15:18.501309] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T19:15:18.506174] [INFO ] [REMOTE ] GPN: Full fetch complete (74908 records). [2025-10-09T19:15:18.506332] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-09T19:15:18.925973] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-09T19:15:18.926242] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-09T19:15:18.934534] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-09T19:15:18.935522] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-09T19:15:18.935603] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-09T19:15:18.937021] [DEBUG] [LOCAL ] GPN: Trimmed 74908 records to 52403 (keeping 200 days of data) [2025-10-09T19:15:19.218203] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-09T19:15:19.264450] [DEBUG] [LOCAL ] GPN: Primary data saved (52403 records). [2025-10-09T19:15:19.264581] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-09T19:15:19.265605] [INFO ] [MAIN ] Update Progress: 964/2373 symbols completed. GPN took 41.8s. Estimated remaining: 3h 17m 42s. Rate: 7.1 symbols/min [2025-10-09T19:15:19.432911] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:19.444255] [DEBUG] [LOCAL ] GRC: Loaded 9202 existing records from primary storage. [2025-10-09T19:15:19.444477] [INFO ] [MAIN ] GRC: Loaded 9202 existing records. [2025-10-09T19:15:19.620956] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:19.633078] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-09T19:15:19.633725] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-09T19:15:19.634190] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T19:15:19.634233] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-09T19:15:19.639161] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-09T19:15:19.982089] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:19.996664] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-09T19:15:20.773596] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-09T19:15:20.796666] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-09T19:15:20.831446] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T19:15:21.593678] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T19:15:21.596672] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-09T19:15:22.396724] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-09T19:15:22.628961] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T19:15:23.196687] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-09T19:15:23.651147] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:15:23.996733] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-09T19:15:23.998482] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T19:15:24.796719] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-09T19:15:25.488020] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:15:25.596701] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-09T19:15:25.939708] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:15:26.396729] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-09T19:15:27.084028] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T19:15:27.196718] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-09T19:15:27.566892] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T19:15:27.996732] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-09T19:15:28.595573] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:15:28.627737] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-09T19:15:28.796751] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-09T19:15:29.579262] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T19:15:29.596720] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-09T19:15:30.396803] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-09T19:15:30.946781] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:15:31.146110] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T19:15:31.196689] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-09T19:15:31.937074] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T19:15:31.996693] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-09T19:15:32.748115] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-09T19:15:32.796751] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-09T19:15:33.596679] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-09T19:15:34.067382] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T19:15:34.363082] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T19:15:34.396720] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-09T19:15:35.196776] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-09T19:15:35.568250] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T19:15:35.996797] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-09T19:15:36.097333] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-09T19:15:36.796739] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-09T19:15:37.518100] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T19:15:37.596727] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-09T19:15:37.616844] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T19:15:37.618481] [INFO ] [REMOTE ] GRC: Full fetch complete (13254 records). [2025-10-09T19:15:37.618578] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-09T19:15:38.055456] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-09T19:15:38.055541] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-09T19:15:38.055913] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-09T19:15:38.055977] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-09T19:15:38.056612] [DEBUG] [LOCAL ] GRC: Trimmed 13254 records to 9268 (keeping 200 days of data) [2025-10-09T19:15:38.122947] [DEBUG] [LOCAL ] GRC: Primary data saved (9268 records). [2025-10-09T19:15:38.123127] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-09T19:15:38.123228] [INFO ] [MAIN ] Update Progress: 965/2373 symbols completed. GRC took 18.9s. Estimated remaining: 3h 17m 49s. Rate: 7.1 symbols/min [2025-10-09T19:15:38.322629] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:38.343974] [DEBUG] [LOCAL ] GRDN: Loaded 20937 existing records from primary storage. [2025-10-09T19:15:38.344218] [INFO ] [MAIN ] GRDN: Loaded 20937 existing records. [2025-10-09T19:15:38.403679] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-09T19:15:38.599730] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:38.599969] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-09T19:15:38.600018] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-09T19:15:38.600289] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-09T19:15:38.600349] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-09T19:15:38.988720] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:39.046602] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T19:15:39.196723] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-09T19:15:39.639206] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T19:15:39.641760] [INFO ] [REMOTE ] GPOR: Full fetch complete (35055 records). [2025-10-09T19:15:39.641838] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-09T19:15:40.000036] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-09T19:15:40.009356] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-09T19:15:40.010239] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-09T19:15:40.011020] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-09T19:15:40.011097] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-09T19:15:40.012194] [DEBUG] [LOCAL ] GPOR: Trimmed 35055 records to 23434 (keeping 200 days of data) [2025-10-09T19:15:40.154397] [DEBUG] [LOCAL ] GPOR: Primary data saved (23434 records). [2025-10-09T19:15:40.154530] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-09T19:15:40.154612] [INFO ] [MAIN ] Update Progress: 966/2373 symbols completed. GPOR took 38.3s. Estimated remaining: 3h 17m 31s. Rate: 7.1 symbols/min [2025-10-09T19:15:40.331868] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:40.372616] [DEBUG] [LOCAL ] GRMN: Loaded 40656 existing records from primary storage. [2025-10-09T19:15:40.372943] [INFO ] [MAIN ] GRMN: Loaded 40656 existing records. [2025-10-09T19:15:40.552802] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:40.553016] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-09T19:15:40.553064] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-09T19:15:40.554517] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-09T19:15:40.554576] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-09T19:15:40.710741] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-09T19:15:40.734756] [INFO ] [REMOTE ] GPRK: Full fetch complete (57695 records). [2025-10-09T19:15:40.754955] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-09T19:15:40.800927] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-09T19:15:41.132924] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:41.340522] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-09T19:15:41.340682] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-09T19:15:41.341485] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-09T19:15:41.341673] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-09T19:15:41.343019] [DEBUG] [LOCAL ] GPRK: Trimmed 57695 records to 39734 (keeping 200 days of data) [2025-10-09T19:15:41.449594] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T19:15:41.597183] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-09T19:15:41.628034] [DEBUG] [LOCAL ] GPRK: Primary data saved (39734 records). [2025-10-09T19:15:41.628184] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-09T19:15:41.628273] [INFO ] [MAIN ] Update Progress: 967/2373 symbols completed. GPRK took 32.2s. Estimated remaining: 3h 17m 13s. Rate: 7.1 symbols/min [2025-10-09T19:15:41.804353] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:41.850080] [DEBUG] [LOCAL ] GRND: Loaded 49969 existing records from primary storage. [2025-10-09T19:15:41.850468] [INFO ] [MAIN ] GRND: Loaded 49969 existing records. [2025-10-09T19:15:42.045771] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T19:15:42.044540] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:42.050758] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-09T19:15:42.050808] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-09T19:15:42.051012] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-09T19:15:42.051070] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-09T19:15:42.402440] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-09T19:15:42.450337] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:43.196698] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-09T19:15:43.273707] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T19:15:43.771585] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T19:15:43.996690] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-09T19:15:44.065141] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-09T19:15:44.796724] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-09T19:15:45.409356] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:15:45.596787] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-09T19:15:45.927508] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T19:15:46.396722] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-09T19:15:46.918166] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T19:15:47.196737] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-09T19:15:47.630506] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T19:15:47.996741] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-09T19:15:48.706138] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:15:48.796768] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-09T19:15:49.596746] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-09T19:15:49.764212] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T19:15:49.927098] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T19:15:50.098085] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-09T19:15:50.396783] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-09T19:15:51.196677] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-09T19:15:51.597407] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:15:51.996735] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-09T19:15:52.298960] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:15:52.796805] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-09T19:15:53.520878] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T19:15:53.596717] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-09T19:15:54.184150] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T19:15:54.396695] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-09T19:15:54.612413] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T19:15:55.196726] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-09T19:15:55.841524] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T19:15:55.996687] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-09T19:15:56.346564] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:15:56.349430] [INFO ] [REMOTE ] GRBK: Full fetch complete (40548 records). [2025-10-09T19:15:56.349505] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-09T19:15:56.737468] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-09T19:15:56.737549] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-09T19:15:56.738299] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-09T19:15:56.738362] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-09T19:15:56.739256] [DEBUG] [LOCAL ] GRBK: Trimmed 40548 records to 27216 (keeping 200 days of data) [2025-10-09T19:15:56.803341] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-09T19:15:56.908211] [DEBUG] [LOCAL ] GRBK: Primary data saved (27216 records). [2025-10-09T19:15:56.908351] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-09T19:15:56.908458] [INFO ] [MAIN ] Update Progress: 968/2373 symbols completed. GRBK took 45.0s. Estimated remaining: 3h 17m 14s. Rate: 7.1 symbols/min [2025-10-09T19:15:57.097850] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:15:57.131764] [DEBUG] [LOCAL ] GRNT: Loaded 33908 existing records from primary storage. [2025-10-09T19:15:57.132046] [INFO ] [MAIN ] GRNT: Loaded 33908 existing records. [2025-10-09T19:15:57.317725] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:15:57.318009] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-09T19:15:57.318083] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-09T19:15:57.319246] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-09T19:15:57.319308] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-09T19:15:57.605781] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-09T19:15:57.720123] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:15:57.753855] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T19:15:57.781339] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T19:15:58.396712] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-09T19:15:59.038752] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:15:59.196690] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-09T19:15:59.419714] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:15:59.996719] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-09T19:16:00.601983] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:16:00.796723] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-09T19:16:01.311517] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T19:16:01.596719] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-09T19:16:02.396743] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-09T19:16:02.550027] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T19:16:02.581271] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T19:16:03.196730] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-09T19:16:03.807924] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T19:16:03.996736] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-09T19:16:04.128601] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-09T19:16:04.796750] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-09T19:16:05.596689] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-09T19:16:05.723356] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T19:16:05.787707] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T19:16:06.396769] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-09T19:16:07.127887] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:16:07.196732] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-09T19:16:07.492888] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T19:16:07.996807] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-09T19:16:08.796684] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-09T19:16:08.851233] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T19:16:09.154284] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T19:16:09.596778] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-09T19:16:09.721139] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T19:16:10.396730] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-09T19:16:10.825763] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T19:16:10.829208] [INFO ] [REMOTE ] GRMN: Full fetch complete (59727 records). [2025-10-09T19:16:10.829313] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-09T19:16:11.198531] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-09T19:16:11.219544] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-09T19:16:11.219684] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-09T19:16:11.221561] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-09T19:16:11.221669] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-09T19:16:11.229434] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T19:16:11.232607] [DEBUG] [LOCAL ] GRMN: Trimmed 59727 records to 40895 (keeping 200 days of data) [2025-10-09T19:16:11.233770] [INFO ] [REMOTE ] GRDN: Full fetch complete (26298 records). [2025-10-09T19:16:11.233884] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-09T19:16:11.810955] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-09T19:16:11.811057] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-09T19:16:11.812115] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-09T19:16:11.812673] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-09T19:16:11.815498] [DEBUG] [LOCAL ] GRDN: Trimmed 26298 records to 21074 (keeping 200 days of data) [2025-10-09T19:16:12.019875] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-09T19:16:12.085382] [DEBUG] [LOCAL ] GRDN: Primary data saved (21074 records). [2025-10-09T19:16:12.086046] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-09T19:16:12.086379] [INFO ] [MAIN ] Update Progress: 969/2373 symbols completed. GRDN took 34.0s. Estimated remaining: 3h 17m 16s. Rate: 7.1 symbols/min [2025-10-09T19:16:12.265432] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:12.278445] [DEBUG] [LOCAL ] GRMN: Primary data saved (40895 records). [2025-10-09T19:16:12.278585] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-09T19:16:12.278703] [INFO ] [MAIN ] Update Progress: 970/2373 symbols completed. GRMN took 32.1s. Estimated remaining: 3h 16m 55s. Rate: 7.1 symbols/min [2025-10-09T19:16:12.362669] [DEBUG] [LOCAL ] GROV: Loaded 8857 existing records from primary storage. [2025-10-09T19:16:12.381579] [INFO ] [MAIN ] GROV: Loaded 8857 existing records. [2025-10-09T19:16:12.542201] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:12.655500] [DEBUG] [LOCAL ] GRX: Loaded 4764 existing records from primary storage. [2025-10-09T19:16:12.689219] [INFO ] [MAIN ] GRX: Loaded 4764 existing records. [2025-10-09T19:16:12.697233] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:12.733258] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-09T19:16:12.740581] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-09T19:16:12.778591] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-09T19:16:12.783889] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-09T19:16:12.993622] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:13.035847] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-09T19:16:13.067218] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-09T19:16:13.099352] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-09T19:16:13.136952] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-09T19:16:13.383491] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-09T19:16:13.381636] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:13.416116] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-09T19:16:13.602283] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-09T19:16:13.635565] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T19:16:13.736414] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:14.396786] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-09T19:16:14.429692] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T19:16:15.006355] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-09T19:16:15.138464] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T19:16:15.196698] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-09T19:16:15.805502] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T19:16:15.996722] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-09T19:16:16.796703] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-09T19:16:16.891225] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T19:16:17.596717] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-09T19:16:17.947303] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T19:16:18.005511] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-09T19:16:18.396722] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-09T19:16:19.196720] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-09T19:16:19.603703] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-09T19:16:19.996755] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-09T19:16:20.015362] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:16:20.019779] [INFO ] [REMOTE ] GRND: Full fetch complete (71139 records). [2025-10-09T19:16:20.019920] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-09T19:16:20.414962] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T19:16:20.418479] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-09T19:16:20.419880] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-09T19:16:20.421588] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-09T19:16:20.421682] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-09T19:16:20.423249] [DEBUG] [LOCAL ] GRND: Trimmed 71139 records to 50333 (keeping 200 days of data) [2025-10-09T19:16:20.720201] [DEBUG] [LOCAL ] GRND: Primary data saved (50333 records). [2025-10-09T19:16:20.720343] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-09T19:16:20.720426] [INFO ] [MAIN ] Update Progress: 971/2373 symbols completed. GRND took 39.1s. Estimated remaining: 3h 16m 47s. Rate: 7.1 symbols/min [2025-10-09T19:16:20.801853] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-09T19:16:20.895573] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:20.948897] [DEBUG] [LOCAL ] GS: Loaded 51771 existing records from primary storage. [2025-10-09T19:16:20.949245] [INFO ] [MAIN ] GS: Loaded 51771 existing records. [2025-10-09T19:16:21.133413] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:21.133693] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-09T19:16:21.133750] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-09T19:16:21.135070] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-09T19:16:21.135129] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-09T19:16:21.499051] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:21.596696] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-09T19:16:21.684525] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-09T19:16:22.396729] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-09T19:16:22.963625] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T19:16:23.196735] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-09T19:16:23.360032] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-09T19:16:23.996725] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-09T19:16:24.601884] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T19:16:24.796710] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-09T19:16:25.596691] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-09T19:16:25.736342] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T19:16:26.137933] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T19:16:26.192204] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T19:16:26.396714] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-09T19:16:27.162305] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T19:16:27.196727] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-09T19:16:27.867157] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-09T19:16:27.996753] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-09T19:16:28.796738] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-09T19:16:29.472552] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T19:16:29.596744] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-09T19:16:29.857638] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T19:16:30.084278] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T19:16:30.396733] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-09T19:16:31.196733] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-09T19:16:31.567474] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T19:16:31.996749] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-09T19:16:32.586456] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-09T19:16:32.587549] [INFO ] [REMOTE ] GRX: Full fetch complete (6570 records). [2025-10-09T19:16:32.587619] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-09T19:16:32.803090] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-09T19:16:32.956565] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-09T19:16:32.956694] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-09T19:16:32.956935] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-09T19:16:32.957015] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-09T19:16:32.957430] [DEBUG] [LOCAL ] GRX: Trimmed 6570 records to 4805 (keeping 200 days of data) [2025-10-09T19:16:32.989072] [DEBUG] [LOCAL ] GRX: Primary data saved (4805 records). [2025-10-09T19:16:32.989238] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-09T19:16:32.989341] [INFO ] [MAIN ] Update Progress: 972/2373 symbols completed. GRX took 20.7s. Estimated remaining: 3h 16m 44s. Rate: 7.1 symbols/min [2025-10-09T19:16:33.162280] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:33.207785] [DEBUG] [LOCAL ] GSBD: Loaded 39374 existing records from primary storage. [2025-10-09T19:16:33.208113] [INFO ] [MAIN ] GSBD: Loaded 39374 existing records. [2025-10-09T19:16:33.387323] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:33.387737] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-09T19:16:33.387848] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-09T19:16:33.399274] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-09T19:16:33.404478] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-09T19:16:33.488012] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-09T19:16:33.603556] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-09T19:16:33.720371] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T19:16:33.800318] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:34.396749] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-09T19:16:34.984864] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-09T19:16:35.196745] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-09T19:16:35.906932] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:16:35.960403] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-09T19:16:35.996673] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-09T19:16:36.796762] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-09T19:16:37.596741] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-09T19:16:37.868412] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T19:16:37.904910] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T19:16:38.396798] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-09T19:16:38.913510] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-09T19:16:39.196748] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-09T19:16:39.783221] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:16:39.996717] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-09T19:16:40.796843] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-09T19:16:40.967975] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-09T19:16:41.575298] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T19:16:41.596669] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-09T19:16:42.249750] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-09T19:16:42.396717] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-09T19:16:42.694282] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T19:16:43.196728] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-09T19:16:43.449339] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T19:16:43.996727] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-09T19:16:44.695607] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T19:16:44.796742] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-09T19:16:45.401784] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T19:16:45.441375] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-09T19:16:45.596707] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-09T19:16:46.396782] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-09T19:16:46.558359] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T19:16:46.561387] [INFO ] [REMOTE ] GRNT: Full fetch complete (48425 records). [2025-10-09T19:16:46.561474] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-09T19:16:46.961772] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-09T19:16:46.961850] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-09T19:16:46.962556] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-09T19:16:46.962596] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-09T19:16:46.963545] [DEBUG] [LOCAL ] GRNT: Trimmed 48425 records to 34158 (keeping 200 days of data) [2025-10-09T19:16:47.162484] [DEBUG] [LOCAL ] GRNT: Primary data saved (34158 records). [2025-10-09T19:16:47.162617] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-09T19:16:47.162728] [INFO ] [MAIN ] Update Progress: 973/2373 symbols completed. GRNT took 50.3s. Estimated remaining: 3h 16m 44s. Rate: 7.1 symbols/min [2025-10-09T19:16:47.204931] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-09T19:16:47.335328] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:47.384420] [DEBUG] [LOCAL ] GSK: Loaded 53500 existing records from primary storage. [2025-10-09T19:16:47.384753] [INFO ] [MAIN ] GSK: Loaded 53500 existing records. [2025-10-09T19:16:47.561259] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:47.561454] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-09T19:16:47.561501] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-09T19:16:47.562581] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-09T19:16:47.562668] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-09T19:16:47.858666] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T19:16:47.900708] [INFO ] [REMOTE ] GROV: Full fetch complete (14187 records). [2025-10-09T19:16:47.931700] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:47.932172] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-09T19:16:48.000940] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-09T19:16:48.223846] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T19:16:48.344122] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-09T19:16:48.344222] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-09T19:16:48.344569] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-09T19:16:48.344612] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-09T19:16:48.345132] [DEBUG] [LOCAL ] GROV: Trimmed 14187 records to 8881 (keeping 200 days of data) [2025-10-09T19:16:48.394794] [DEBUG] [LOCAL ] GROV: Primary data saved (8881 records). [2025-10-09T19:16:48.394917] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-09T19:16:48.395007] [INFO ] [MAIN ] Update Progress: 974/2373 symbols completed. GROV took 36.3s. Estimated remaining: 3h 16m 25s. Rate: 7.1 symbols/min [2025-10-09T19:16:48.560218] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:48.593684] [DEBUG] [LOCAL ] GSL: Loaded 33224 existing records from primary storage. [2025-10-09T19:16:48.593960] [INFO ] [MAIN ] GSL: Loaded 33224 existing records. [2025-10-09T19:16:48.767772] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:48.767986] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-09T19:16:48.768034] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-09T19:16:48.769034] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-09T19:16:48.769095] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-09T19:16:48.802010] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-09T19:16:49.127026] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:49.596688] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-09T19:16:50.037678] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-09T19:16:50.361488] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T19:16:50.396686] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-09T19:16:51.006913] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:16:51.196752] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-09T19:16:51.996747] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-09T19:16:52.139911] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:16:52.262382] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-09T19:16:52.796700] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-09T19:16:53.596811] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-09T19:16:53.756562] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T19:16:54.072846] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-09T19:16:54.396781] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-09T19:16:55.094671] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T19:16:55.196702] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-09T19:16:55.592200] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-09T19:16:55.996777] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-09T19:16:56.796690] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-09T19:16:57.190449] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-09T19:16:57.194799] [INFO ] [REMOTE ] GS: Full fetch complete (75635 records). [2025-10-09T19:16:57.194955] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-09T19:16:57.602078] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-09T19:16:57.615866] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-09T19:16:57.616916] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T19:16:57.624152] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-09T19:16:57.625396] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-09T19:16:57.625829] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-09T19:16:57.627348] [DEBUG] [LOCAL ] GS: Trimmed 75635 records to 52147 (keeping 200 days of data) [2025-10-09T19:16:57.970637] [DEBUG] [LOCAL ] GS: Primary data saved (52147 records). [2025-10-09T19:16:57.970831] [INFO ] [MAIN ] GS: Full history saved. [2025-10-09T19:16:57.971819] [INFO ] [MAIN ] Update Progress: 975/2373 symbols completed. GS took 37.3s. Estimated remaining: 3h 16m 18s. Rate: 7.1 symbols/min [2025-10-09T19:16:58.138767] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:16:58.194309] [DEBUG] [LOCAL ] GTES: Loaded 50433 existing records from primary storage. [2025-10-09T19:16:58.194627] [INFO ] [MAIN ] GTES: Loaded 50433 existing records. [2025-10-09T19:16:58.369989] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:16:58.370209] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-09T19:16:58.370265] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-09T19:16:58.371319] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-09T19:16:58.371379] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-09T19:16:58.402469] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-09T19:16:58.742236] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:16:58.773888] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T19:16:58.815674] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T19:16:59.196729] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-09T19:16:59.949725] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:16:59.996674] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-09T19:17:00.796745] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-09T19:17:00.974294] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T19:17:01.500150] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T19:17:01.596689] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-09T19:17:02.302491] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:17:02.396688] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-09T19:17:02.507168] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T19:17:03.196709] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-09T19:17:03.745931] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T19:17:03.996719] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-09T19:17:04.246011] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-09T19:17:04.796749] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-09T19:17:05.106676] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:17:05.596719] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-09T19:17:06.222462] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T19:17:06.396725] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-09T19:17:06.997088] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T19:17:07.196715] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-09T19:17:07.820556] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-09T19:17:07.996700] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-09T19:17:08.796696] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-09T19:17:08.923573] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T19:17:09.598237] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-09T19:17:09.603967] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T19:17:10.110839] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-09T19:17:10.396773] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-09T19:17:11.180128] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T19:17:11.184183] [INFO ] [REMOTE ] GSBD: Full fetch complete (58497 records). [2025-10-09T19:17:11.184275] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-09T19:17:11.205309] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-09T19:17:11.589525] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-09T19:17:11.589626] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-09T19:17:11.590627] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-09T19:17:11.590717] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-09T19:17:11.592022] [DEBUG] [LOCAL ] GSBD: Trimmed 58497 records to 39733 (keeping 200 days of data) [2025-10-09T19:17:11.852085] [DEBUG] [LOCAL ] GSBD: Primary data saved (39733 records). [2025-10-09T19:17:11.852262] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-09T19:17:11.852357] [INFO ] [MAIN ] Update Progress: 976/2373 symbols completed. GSBD took 38.9s. Estimated remaining: 3h 16m 18s. Rate: 7.1 symbols/min [2025-10-09T19:17:12.001774] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-09T19:17:12.025807] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:12.067819] [DEBUG] [LOCAL ] GTLS: Loaded 42973 existing records from primary storage. [2025-10-09T19:17:12.068107] [INFO ] [MAIN ] GTLS: Loaded 42973 existing records. [2025-10-09T19:17:12.245861] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:12.246181] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-09T19:17:12.246243] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-09T19:17:12.247482] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-09T19:17:12.247543] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-09T19:17:12.612873] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:12.642343] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-09T19:17:12.796695] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-09T19:17:12.961978] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T19:17:13.389923] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T19:17:13.392818] [INFO ] [REMOTE ] GSL: Full fetch complete (47969 records). [2025-10-09T19:17:13.392904] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-09T19:17:13.602019] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-09T19:17:13.782377] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-09T19:17:13.782468] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-09T19:17:13.783202] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-09T19:17:13.783265] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-09T19:17:13.784337] [DEBUG] [LOCAL ] GSL: Trimmed 47969 records to 33451 (keeping 200 days of data) [2025-10-09T19:17:13.990496] [DEBUG] [LOCAL ] GSL: Primary data saved (33451 records). [2025-10-09T19:17:13.990602] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-09T19:17:13.991554] [INFO ] [MAIN ] Update Progress: 977/2373 symbols completed. GSL took 25.6s. Estimated remaining: 3h 16m 0s. Rate: 7.1 symbols/min [2025-10-09T19:17:14.186219] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:14.189027] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:17:14.249982] [DEBUG] [LOCAL ] GTN: Loaded 45251 existing records from primary storage. [2025-10-09T19:17:14.250489] [INFO ] [MAIN ] GTN: Loaded 45251 existing records. [2025-10-09T19:17:14.401931] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-09T19:17:14.458614] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:14.458911] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-09T19:17:14.458970] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-09T19:17:14.460362] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-09T19:17:14.460447] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-09T19:17:14.834891] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:15.196766] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-09T19:17:15.369490] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T19:17:15.872555] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:17:15.996724] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-09T19:17:16.631264] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:17:16.796766] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-09T19:17:17.596689] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-09T19:17:17.637359] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-09T19:17:18.328556] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T19:17:18.396668] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-09T19:17:18.870201] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T19:17:19.196775] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-09T19:17:19.996700] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-09T19:17:20.072128] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T19:17:20.467263] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T19:17:20.796720] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-09T19:17:21.596780] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-09T19:17:21.802000] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-09T19:17:22.390001] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:17:22.398293] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-09T19:17:22.886250] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T19:17:23.196758] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-09T19:17:23.996699] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-09T19:17:24.294410] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T19:17:24.538452] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:17:24.796679] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-09T19:17:25.447697] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-09T19:17:25.596702] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-09T19:17:26.372882] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T19:17:26.396683] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-09T19:17:27.162575] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:17:27.196663] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-09T19:17:27.926107] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:17:27.996761] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-09T19:17:28.807204] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-09T19:17:28.814962] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T19:17:29.596736] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-09T19:17:29.699940] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T19:17:30.396708] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-09T19:17:30.533260] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T19:17:30.999630] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:17:31.196720] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-09T19:17:31.996677] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-09T19:17:32.338963] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-09T19:17:32.684839] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T19:17:32.796707] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-09T19:17:33.261246] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:17:33.596801] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-09T19:17:34.316734] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T19:17:34.321002] [INFO ] [REMOTE ] GTES: Full fetch complete (73784 records). [2025-10-09T19:17:34.321114] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-09T19:17:34.401966] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-09T19:17:34.717169] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-09T19:17:34.717253] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-09T19:17:34.718274] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-09T19:17:34.718341] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-09T19:17:34.719840] [DEBUG] [LOCAL ] GTES: Trimmed 73784 records to 50804 (keeping 200 days of data) [2025-10-09T19:17:35.052923] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:17:35.076011] [DEBUG] [LOCAL ] GTES: Primary data saved (50804 records). [2025-10-09T19:17:35.076205] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-09T19:17:35.076372] [INFO ] [MAIN ] Update Progress: 978/2373 symbols completed. GTES took 37.1s. Estimated remaining: 3h 16m 10s. Rate: 7.1 symbols/min [2025-10-09T19:17:35.201866] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-09T19:17:35.254222] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:35.283720] [DEBUG] [LOCAL ] GTY: Loaded 30191 existing records from primary storage. [2025-10-09T19:17:35.283995] [INFO ] [MAIN ] GTY: Loaded 30191 existing records. [2025-10-09T19:17:35.457848] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:35.458086] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-09T19:17:35.458135] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-09T19:17:35.459098] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-09T19:17:35.459174] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-09T19:17:35.822583] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:35.996747] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-09T19:17:36.138863] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:17:36.796695] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-09T19:17:36.981337] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:17:37.596703] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-09T19:17:37.890481] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-09T19:17:37.911405] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T19:17:37.915324] [INFO ] [REMOTE ] GTN: Full fetch complete (66207 records). [2025-10-09T19:17:37.915433] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-09T19:17:38.298462] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-09T19:17:38.298556] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-09T19:17:38.299496] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-09T19:17:38.299574] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-09T19:17:38.300992] [DEBUG] [LOCAL ] GTN: Trimmed 66207 records to 45558 (keeping 200 days of data) [2025-10-09T19:17:38.396860] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-09T19:17:38.571321] [DEBUG] [LOCAL ] GTN: Primary data saved (45558 records). [2025-10-09T19:17:38.571459] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-09T19:17:38.572300] [INFO ] [MAIN ] Update Progress: 979/2373 symbols completed. GTN took 24.6s. Estimated remaining: 3h 15m 54s. Rate: 7.1 symbols/min [2025-10-09T19:17:38.747676] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:38.762261] [DEBUG] [LOCAL ] GUG: Loaded 12241 existing records from primary storage. [2025-10-09T19:17:38.762487] [INFO ] [MAIN ] GUG: Loaded 12241 existing records. [2025-10-09T19:17:38.947337] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:38.947569] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-09T19:17:38.947616] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-09T19:17:38.948064] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-09T19:17:38.948123] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-09T19:17:39.206239] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-09T19:17:39.341406] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:39.343319] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-09T19:17:39.996709] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-09T19:17:40.311297] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-09T19:17:40.315938] [INFO ] [REMOTE ] GSK: Full fetch complete (77476 records). [2025-10-09T19:17:40.316075] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-09T19:17:40.648978] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-09T19:17:40.743323] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-09T19:17:40.743407] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-09T19:17:40.744375] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-09T19:17:40.744442] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-09T19:17:40.746040] [DEBUG] [LOCAL ] GSK: Trimmed 77476 records to 53890 (keeping 200 days of data) [2025-10-09T19:17:40.803259] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-09T19:17:41.087422] [DEBUG] [LOCAL ] GSK: Primary data saved (53890 records). [2025-10-09T19:17:41.087529] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-09T19:17:41.088116] [INFO ] [MAIN ] Update Progress: 980/2373 symbols completed. GSK took 53.9s. Estimated remaining: 3h 15m 37s. Rate: 7.1 symbols/min [2025-10-09T19:17:41.273347] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:41.289732] [DEBUG] [LOCAL ] GUT: Loaded 15479 existing records from primary storage. [2025-10-09T19:17:41.290027] [INFO ] [MAIN ] GUT: Loaded 15479 existing records. [2025-10-09T19:17:41.470583] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:41.470834] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-09T19:17:41.470891] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-09T19:17:41.471531] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-09T19:17:41.471590] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-09T19:17:41.585040] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T19:17:41.599243] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-09T19:17:41.634794] [INFO ] [REMOTE ] GTLS: Full fetch complete (61378 records). [2025-10-09T19:17:41.635156] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-09T19:17:41.956309] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T19:17:41.990732] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:42.265408] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-09T19:17:42.265488] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-09T19:17:42.266355] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-09T19:17:42.266417] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-09T19:17:42.268234] [DEBUG] [LOCAL ] GTLS: Trimmed 61378 records to 43271 (keeping 200 days of data) [2025-10-09T19:17:42.438205] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-09T19:17:42.532188] [DEBUG] [LOCAL ] GTLS: Primary data saved (43271 records). [2025-10-09T19:17:42.532336] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-09T19:17:42.532421] [INFO ] [MAIN ] Update Progress: 981/2373 symbols completed. GTLS took 30.7s. Estimated remaining: 3h 15m 19s. Rate: 7.1 symbols/min [2025-10-09T19:17:42.712025] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:17:42.744977] [DEBUG] [LOCAL ] GVA: Loaded 32831 existing records from primary storage. [2025-10-09T19:17:42.745316] [INFO ] [MAIN ] GVA: Loaded 32831 existing records. [2025-10-09T19:17:42.929173] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:17:42.929589] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-09T19:17:42.929682] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-09T19:17:42.936112] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-09T19:17:42.945233] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-09T19:17:43.007171] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:17:43.205034] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-09T19:17:43.338573] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:17:43.464606] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:17:43.996744] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-09T19:17:44.271109] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T19:17:44.796785] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-09T19:17:45.382104] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:17:45.596747] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-09T19:17:45.810942] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:17:46.388168] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T19:17:46.396668] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-09T19:17:47.196699] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-09T19:17:47.240452] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T19:17:47.996720] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-09T19:17:48.059156] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:17:48.796726] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-09T19:17:48.885921] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-09T19:17:49.596749] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-09T19:17:50.255531] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T19:17:50.396703] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-09T19:17:50.801094] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T19:17:50.953900] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T19:17:51.196785] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-09T19:17:51.996781] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-09T19:17:52.556010] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:17:52.796800] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-09T19:17:53.296969] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T19:17:53.596769] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-09T19:17:53.705826] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T19:17:54.396734] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-09T19:17:54.685884] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T19:17:55.196784] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-09T19:17:55.842039] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T19:17:55.866963] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T19:17:55.996730] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-09T19:17:56.796751] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-09T19:17:57.222795] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-09T19:17:57.596730] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-09T19:17:57.834940] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T19:17:58.396730] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-09T19:17:58.547489] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-09T19:17:59.198771] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-09T19:17:59.201230] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-09T19:17:59.996694] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-09T19:18:00.054457] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T19:18:00.796730] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-09T19:18:01.319874] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-09T19:18:01.596685] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-09T19:18:01.837808] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T19:18:02.396719] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-09T19:18:02.461404] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T19:18:03.196736] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-09T19:18:03.671976] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-09T19:18:03.996754] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-09T19:18:04.609603] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T19:18:04.796719] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-09T19:18:04.892969] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T19:18:05.596739] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-09T19:18:05.978779] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:18:06.312342] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T19:18:06.396719] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-09T19:18:07.196700] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-09T19:18:07.261413] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T19:18:07.996745] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-09T19:18:08.214469] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T19:18:08.779076] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T19:18:08.780604] [INFO ] [REMOTE ] GUG: Full fetch complete (19438 records). [2025-10-09T19:18:08.780705] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-09T19:18:08.803707] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-09T19:18:09.168257] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-09T19:18:09.168593] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-09T19:18:09.169117] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-09T19:18:09.169182] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-09T19:18:09.169966] [DEBUG] [LOCAL ] GUG: Trimmed 19438 records to 12290 (keeping 200 days of data) [2025-10-09T19:18:09.252694] [DEBUG] [LOCAL ] GUG: Primary data saved (12290 records). [2025-10-09T19:18:09.252873] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-09T19:18:09.252968] [INFO ] [MAIN ] Update Progress: 982/2373 symbols completed. GUG took 30.7s. Estimated remaining: 3h 15m 37s. Rate: 7.1 symbols/min [2025-10-09T19:18:09.433781] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:09.452379] [DEBUG] [LOCAL ] GWH: Loaded 17046 existing records from primary storage. [2025-10-09T19:18:09.452590] [INFO ] [MAIN ] GWH: Loaded 17046 existing records. [2025-10-09T19:18:09.600323] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-09T19:18:09.630258] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:09.630624] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-09T19:18:09.630730] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-09T19:18:09.631343] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-09T19:18:09.631405] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-09T19:18:10.055181] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:10.181087] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T19:18:10.396722] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-09T19:18:10.932146] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T19:18:11.196796] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-09T19:18:11.783113] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:18:11.996731] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-09T19:18:12.530734] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T19:18:12.533966] [INFO ] [REMOTE ] GVA: Full fetch complete (48424 records). [2025-10-09T19:18:12.534052] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-09T19:18:12.801895] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-09T19:18:12.934143] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-09T19:18:12.934284] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-09T19:18:12.935139] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-09T19:18:12.935254] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-09T19:18:12.936429] [DEBUG] [LOCAL ] GVA: Trimmed 48424 records to 33049 (keeping 200 days of data) [2025-10-09T19:18:13.040542] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T19:18:13.051886] [INFO ] [REMOTE ] GTY: Full fetch complete (43761 records). [2025-10-09T19:18:13.053283] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-09T19:18:13.551439] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-09T19:18:13.551536] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-09T19:18:13.552299] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-09T19:18:13.552687] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-09T19:18:13.556370] [DEBUG] [LOCAL ] GTY: Trimmed 43761 records to 30428 (keeping 200 days of data) [2025-10-09T19:18:13.560050] [DEBUG] [LOCAL ] GVA: Primary data saved (33049 records). [2025-10-09T19:18:13.560329] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-09T19:18:13.560440] [INFO ] [MAIN ] Update Progress: 983/2373 symbols completed. GVA took 31.0s. Estimated remaining: 3h 15m 22s. Rate: 7.1 symbols/min [2025-10-09T19:18:13.625375] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-09T19:18:13.845392] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:13.942474] [DEBUG] [LOCAL ] GWRE: Loaded 40142 existing records from primary storage. [2025-10-09T19:18:13.952438] [INFO ] [MAIN ] GWRE: Loaded 40142 existing records. [2025-10-09T19:18:14.034996] [DEBUG] [LOCAL ] GTY: Primary data saved (30428 records). [2025-10-09T19:18:14.052113] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-09T19:18:14.064361] [INFO ] [MAIN ] Update Progress: 984/2373 symbols completed. GTY took 39.0s. Estimated remaining: 3h 15m 3s. Rate: 7.1 symbols/min [2025-10-09T19:18:14.255518] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:14.265995] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-09T19:18:14.271187] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-09T19:18:14.291070] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-09T19:18:14.295852] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-09T19:18:14.341999] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:14.591538] [DEBUG] [LOCAL ] GWW: Loaded 19426 existing records from primary storage. [2025-10-09T19:18:14.613391] [INFO ] [MAIN ] GWW: Loaded 19426 existing records. [2025-10-09T19:18:14.765094] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:14.806401] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-09T19:18:14.798608] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-09T19:18:14.890984] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:14.891220] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-09T19:18:14.891274] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-09T19:18:14.891918] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-09T19:18:14.891976] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-09T19:18:15.203230] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-09T19:18:15.243834] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:15.996751] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-09T19:18:16.337070] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:18:16.380455] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (3.58 seconds). [2025-10-09T19:18:16.592117] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T19:18:16.789105] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-09T19:18:16.796670] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-09T19:18:17.596709] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-09T19:18:17.894681] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:18:18.396699] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-09T19:18:18.437728] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T19:18:19.196769] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-09T19:18:19.771323] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T19:18:19.974481] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T19:18:19.996673] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-09T19:18:20.741391] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T19:18:20.796710] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-09T19:18:21.596761] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-09T19:18:21.890245] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-09T19:18:22.396725] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-09T19:18:22.403228] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T19:18:22.405144] [INFO ] [REMOTE ] GUT: Full fetch complete (22617 records). [2025-10-09T19:18:22.405217] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-09T19:18:22.768732] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-09T19:18:22.768810] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-09T19:18:22.769266] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-09T19:18:22.769356] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-09T19:18:22.769999] [DEBUG] [LOCAL ] GUT: Trimmed 22617 records to 15593 (keeping 200 days of data) [2025-10-09T19:18:22.864122] [DEBUG] [LOCAL ] GUT: Primary data saved (15593 records). [2025-10-09T19:18:22.864245] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-09T19:18:22.864366] [INFO ] [MAIN ] Update Progress: 985/2373 symbols completed. GUT took 41.8s. Estimated remaining: 3h 14m 55s. Rate: 7.1 symbols/min [2025-10-09T19:18:23.046600] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:23.090949] [DEBUG] [LOCAL ] GXO: Loaded 47078 existing records from primary storage. [2025-10-09T19:18:23.091388] [INFO ] [MAIN ] GXO: Loaded 47078 existing records. [2025-10-09T19:18:23.173114] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T19:18:23.199060] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-09T19:18:23.282165] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:23.282378] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-09T19:18:23.282426] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-09T19:18:23.283777] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-09T19:18:23.283837] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-09T19:18:23.645985] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:23.996736] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-09T19:18:24.273147] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-09T19:18:24.796779] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-09T19:18:25.568984] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-09T19:18:25.596712] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-09T19:18:25.767923] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-09T19:18:26.396764] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-09T19:18:27.020490] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T19:18:27.196700] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-09T19:18:27.445454] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T19:18:27.996739] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-09T19:18:28.614757] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T19:18:28.650150] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T19:18:28.796867] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-09T19:18:29.596736] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-09T19:18:30.252425] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:18:30.302875] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:18:30.396679] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-09T19:18:31.196710] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-09T19:18:31.711924] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T19:18:31.996710] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-09T19:18:32.265061] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T19:18:32.796755] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-09T19:18:33.596776] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-09T19:18:33.642177] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T19:18:33.702693] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T19:18:34.341465] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-09T19:18:34.396671] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-09T19:18:35.196746] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-09T19:18:35.456751] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-09T19:18:35.996732] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-09T19:18:36.507720] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T19:18:36.796765] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-09T19:18:37.054268] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-09T19:18:37.596740] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-09T19:18:38.396715] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-09T19:18:38.470107] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T19:18:38.508763] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-09T19:18:39.196723] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-09T19:18:39.450525] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T19:18:39.996731] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-09T19:18:40.801859] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-09T19:18:40.820154] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T19:18:40.845822] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T19:18:40.847899] [INFO ] [REMOTE ] GWW: Full fetch complete (29112 records). [2025-10-09T19:18:40.847983] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-09T19:18:41.217488] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-09T19:18:41.217600] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-09T19:18:41.218128] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-09T19:18:41.218191] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-09T19:18:41.218949] [DEBUG] [LOCAL ] GWW: Trimmed 29112 records to 19575 (keeping 200 days of data) [2025-10-09T19:18:41.343769] [DEBUG] [LOCAL ] GWW: Primary data saved (19575 records). [2025-10-09T19:18:41.343902] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-09T19:18:41.343989] [INFO ] [MAIN ] Update Progress: 986/2373 symbols completed. GWW took 27.3s. Estimated remaining: 3h 15m 1s. Rate: 7.1 symbols/min [2025-10-09T19:18:41.512836] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:41.516262] [DEBUG] [LOCAL ] GYLD: Loaded 1535 existing records from primary storage. [2025-10-09T19:18:41.516403] [INFO ] [MAIN ] GYLD: Loaded 1535 existing records. [2025-10-09T19:18:41.606090] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-09T19:18:41.696882] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:41.697088] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-09T19:18:41.697142] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-09T19:18:41.697342] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-09T19:18:41.697401] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-09T19:18:42.044632] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:42.396742] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-09T19:18:42.463090] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:18:43.035565] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:18:43.196755] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-09T19:18:43.677707] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T19:18:43.680517] [INFO ] [REMOTE ] GWH: Full fetch complete (22117 records). [2025-10-09T19:18:43.680593] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-09T19:18:43.933952] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T19:18:44.003430] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-09T19:18:44.049847] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-09T19:18:44.050038] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-09T19:18:44.050516] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-09T19:18:44.050560] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-09T19:18:44.051309] [DEBUG] [LOCAL ] GWH: Trimmed 22117 records to 17262 (keeping 200 days of data) [2025-10-09T19:18:44.156290] [DEBUG] [LOCAL ] GWH: Primary data saved (17262 records). [2025-10-09T19:18:44.156450] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-09T19:18:44.156568] [INFO ] [MAIN ] Update Progress: 987/2373 symbols completed. GWH took 34.9s. Estimated remaining: 3h 14m 44s. Rate: 7.1 symbols/min [2025-10-09T19:18:44.332418] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:44.382637] [DEBUG] [LOCAL ] H: Loaded 44514 existing records from primary storage. [2025-10-09T19:18:44.383021] [INFO ] [MAIN ] H: Loaded 44514 existing records. [2025-10-09T19:18:44.565212] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:44.565404] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-09T19:18:44.565451] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-09T19:18:44.567046] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-09T19:18:44.567112] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-09T19:18:44.804224] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-09T19:18:44.934325] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:45.224128] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T19:18:45.534388] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:18:45.596686] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-09T19:18:46.396725] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-09T19:18:47.203893] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-09T19:18:47.209422] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T19:18:47.621525] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T19:18:47.636406] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T19:18:47.996746] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-09T19:18:48.796735] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-09T19:18:49.495081] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T19:18:49.596696] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-09T19:18:50.363532] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:18:50.396683] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-09T19:18:51.073864] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T19:18:51.196713] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-09T19:18:51.759987] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:18:51.996717] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-09T19:18:52.637796] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:18:52.641619] [INFO ] [REMOTE ] GXO: Full fetch complete (69729 records). [2025-10-09T19:18:52.641769] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-09T19:18:52.801990] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-09T19:18:53.029389] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-09T19:18:53.029480] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-09T19:18:53.030417] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-09T19:18:53.030482] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-09T19:18:53.031873] [DEBUG] [LOCAL ] GXO: Trimmed 69729 records to 47389 (keeping 200 days of data) [2025-10-09T19:18:53.271050] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T19:18:53.275030] [INFO ] [REMOTE ] GWRE: Full fetch complete (60477 records). [2025-10-09T19:18:53.275678] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-09T19:18:53.335936] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T19:18:53.601868] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-09T19:18:53.677743] [DEBUG] [LOCAL ] GXO: Primary data saved (47389 records). [2025-10-09T19:18:53.684004] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-09T19:18:53.695317] [INFO ] [MAIN ] Update Progress: 988/2373 symbols completed. GXO took 30.8s. Estimated remaining: 3h 14m 37s. Rate: 7.1 symbols/min [2025-10-09T19:18:53.906075] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-09T19:18:53.916478] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-09T19:18:53.943935] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-09T19:18:53.944057] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-09T19:18:53.961679] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:53.963540] [DEBUG] [LOCAL ] GWRE: Trimmed 60477 records to 40388 (keeping 200 days of data) [2025-10-09T19:18:54.105020] [DEBUG] [LOCAL ] HAE: Loaded 39439 existing records from primary storage. [2025-10-09T19:18:54.106432] [INFO ] [MAIN ] HAE: Loaded 39439 existing records. [2025-10-09T19:18:54.397719] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-09T19:18:54.401796] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:54.413973] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-09T19:18:54.414960] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-09T19:18:54.416431] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-09T19:18:54.416814] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-09T19:18:54.590767] [DEBUG] [LOCAL ] GWRE: Primary data saved (40388 records). [2025-10-09T19:18:54.632697] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-09T19:18:54.683472] [INFO ] [MAIN ] Update Progress: 989/2373 symbols completed. GWRE took 41.1s. Estimated remaining: 3h 14m 19s. Rate: 7.1 symbols/min [2025-10-09T19:18:54.882510] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T19:18:54.906582] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:54.980137] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:18:55.008156] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:18:55.049680] [DEBUG] [LOCAL ] HAFN: Loaded 43141 existing records from primary storage. [2025-10-09T19:18:55.050018] [INFO ] [MAIN ] HAFN: Loaded 43141 existing records. [2025-10-09T19:18:55.198092] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-09T19:18:55.227865] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:18:55.228078] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-09T19:18:55.228147] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-09T19:18:55.228760] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-09T19:18:55.228821] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-09T19:18:55.575152] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:18:55.646489] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-09T19:18:55.996743] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-09T19:18:56.796762] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-09T19:18:57.219893] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T19:18:57.311391] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:18:57.596701] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-09T19:18:58.396730] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-09T19:18:59.005155] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:18:59.196713] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-09T19:18:59.304346] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T19:18:59.996737] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-09T19:19:00.736862] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T19:19:00.796677] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-09T19:19:01.596725] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-09T19:19:01.737836] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T19:19:02.028778] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T19:19:02.396727] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-09T19:19:02.464963] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T19:19:03.196732] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-09T19:19:03.489489] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-09T19:19:03.959768] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T19:19:03.996673] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-09T19:19:04.796742] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-09T19:19:05.171475] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-09T19:19:05.580285] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T19:19:05.596668] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-09T19:19:06.396771] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-09T19:19:07.196749] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-09T19:19:07.445844] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-09T19:19:07.752957] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:19:07.882107] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-09T19:19:07.882885] [INFO ] [REMOTE ] GYLD: Full fetch complete (2083 records). [2025-10-09T19:19:07.882956] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-09T19:19:08.001862] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-09T19:19:08.242527] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-09T19:19:08.242619] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-09T19:19:08.242771] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-09T19:19:08.242823] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-09T19:19:08.243141] [DEBUG] [LOCAL ] GYLD: Trimmed 2083 records to 1552 (keeping 200 days of data) [2025-10-09T19:19:08.253366] [DEBUG] [LOCAL ] GYLD: Primary data saved (1552 records). [2025-10-09T19:19:08.253426] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-09T19:19:08.253521] [INFO ] [MAIN ] Update Progress: 990/2373 symbols completed. GYLD took 26.9s. Estimated remaining: 3h 14m 17s. Rate: 7.1 symbols/min [2025-10-09T19:19:08.430064] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:08.482011] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-09T19:19:08.482333] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-09T19:19:08.658338] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:08.658593] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-09T19:19:08.658679] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-09T19:19:08.660058] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-09T19:19:08.660121] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-09T19:19:08.803213] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-09T19:19:09.058243] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:09.586008] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T19:19:09.596667] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-09T19:19:10.396706] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-09T19:19:10.541779] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T19:19:11.196683] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-09T19:19:11.297952] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T19:19:11.996687] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-09T19:19:12.360551] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-09T19:19:12.796725] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-09T19:19:12.826289] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T19:19:13.389841] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T19:19:13.596772] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-09T19:19:14.411224] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-09T19:19:14.447150] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T19:19:15.103517] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T19:19:15.196708] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-09T19:19:15.996713] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-09T19:19:16.040090] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:19:16.618310] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T19:19:16.796761] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-09T19:19:16.903079] [DEBUG] [REMOTE ] HAE: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-09T19:19:16.903566] [WARN ] [REMOTE ] HAE: No data returned for month 2025-07 [2025-10-09T19:19:16.903702] [FATAL] [REMOTE ] HAE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:19:16.903816] [FATAL] [MAIN ] HAE: Failed to fetch primary data. [2025-10-09T19:19:16.903887] [WARN ] [MAIN ] HAE: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:19:16.903974] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-09T19:19:16.904360] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-09T19:19:16.904707] [INFO ] [LOCAL ] HAE: Starting deletion of derivative data. [2025-10-09T19:19:16.905056] [DEBUG] [LOCAL ] HAE: Deleted derivative data file. [2025-10-09T19:19:16.905440] [INFO ] [MAIN ] Update Progress: 991/2373 symbols completed. HAE took 23.2s. Estimated remaining: 3h 14m 9s. Rate: 7.1 symbols/min [2025-10-09T19:19:17.072476] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:17.119206] [DEBUG] [LOCAL ] HASI: Loaded 47306 existing records from primary storage. [2025-10-09T19:19:17.119522] [INFO ] [MAIN ] HASI: Loaded 47306 existing records. [2025-10-09T19:19:17.294046] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:17.294307] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-09T19:19:17.294357] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-09T19:19:17.295662] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-09T19:19:17.295724] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-09T19:19:17.601932] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-09T19:19:17.691090] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:17.724137] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T19:19:18.396731] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-09T19:19:19.065461] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:19:19.196707] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-09T19:19:19.595708] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T19:19:19.996778] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-09T19:19:20.380997] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T19:19:20.796713] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-09T19:19:21.596679] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-09T19:19:21.927594] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T19:19:22.333328] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T19:19:22.396694] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-09T19:19:23.198773] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-09T19:19:23.201104] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T19:19:23.996690] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-09T19:19:24.410116] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T19:19:24.796686] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-09T19:19:24.827346] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T19:19:25.596689] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-09T19:19:25.626063] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:19:26.396729] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-09T19:19:27.081079] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-09T19:19:27.149628] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T19:19:27.196668] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-09T19:19:27.891849] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T19:19:27.996707] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-09T19:19:28.631042] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T19:19:28.634889] [INFO ] [REMOTE ] H: Full fetch complete (62642 records). [2025-10-09T19:19:28.634998] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-09T19:19:28.807730] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-09T19:19:29.021553] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-09T19:19:29.021668] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-09T19:19:29.022548] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-09T19:19:29.022616] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-09T19:19:29.023999] [DEBUG] [LOCAL ] H: Trimmed 62642 records to 44843 (keeping 200 days of data) [2025-10-09T19:19:29.289008] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T19:19:29.371336] [DEBUG] [LOCAL ] H: Primary data saved (44843 records). [2025-10-09T19:19:29.371545] [INFO ] [MAIN ] H: Full history saved. [2025-10-09T19:19:29.373638] [INFO ] [MAIN ] Update Progress: 992/2373 symbols completed. H took 45.2s. Estimated remaining: 3h 14m 6s. Rate: 7.1 symbols/min [2025-10-09T19:19:29.556148] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:29.596761] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-09T19:19:29.622508] [DEBUG] [LOCAL ] HAYW: Loaded 48747 existing records from primary storage. [2025-10-09T19:19:29.623043] [INFO ] [MAIN ] HAYW: Loaded 48747 existing records. [2025-10-09T19:19:29.818174] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:29.818480] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-09T19:19:29.818533] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-09T19:19:29.819203] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-09T19:19:29.819266] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-09T19:19:30.194189] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:30.396755] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-09T19:19:30.474896] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T19:19:30.991826] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-09T19:19:31.196740] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-09T19:19:31.547370] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:19:31.551156] [INFO ] [REMOTE ] HAFN: Full fetch complete (65227 records). [2025-10-09T19:19:31.551262] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-09T19:19:31.927063] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-09T19:19:31.927145] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-09T19:19:31.927995] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-09T19:19:31.928058] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-09T19:19:31.929419] [DEBUG] [LOCAL ] HAFN: Trimmed 65227 records to 43476 (keeping 200 days of data) [2025-10-09T19:19:32.012252] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-09T19:19:32.177116] [DEBUG] [LOCAL ] HAFN: Primary data saved (43476 records). [2025-10-09T19:19:32.177252] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-09T19:19:32.177332] [INFO ] [MAIN ] Update Progress: 993/2373 symbols completed. HAFN took 37.5s. Estimated remaining: 3h 13m 50s. Rate: 7.1 symbols/min [2025-10-09T19:19:32.342400] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:32.350087] [DEBUG] [LOCAL ] HBB: Loaded 6485 existing records from primary storage. [2025-10-09T19:19:32.350253] [INFO ] [MAIN ] HBB: Loaded 6485 existing records. [2025-10-09T19:19:32.522569] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:32.522856] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-09T19:19:32.522909] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-09T19:19:32.523186] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-09T19:19:32.523245] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-09T19:19:32.797175] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-09T19:19:32.884241] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:33.004889] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:19:33.555835] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:19:33.596716] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-09T19:19:34.396756] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-09T19:19:34.458673] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T19:19:35.156788] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T19:19:35.196686] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-09T19:19:35.560294] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-09T19:19:35.996722] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-09T19:19:36.779203] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-09T19:19:36.796667] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-09T19:19:37.596713] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-09T19:19:37.825255] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:19:38.311463] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:19:38.396679] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-09T19:19:38.935145] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:19:39.196766] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-09T19:19:39.981043] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-09T19:19:39.996694] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-09T19:19:40.796723] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-09T19:19:40.817385] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:19:40.825773] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-09T19:19:40.825938] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-09T19:19:41.239126] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-09T19:19:41.239232] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-09T19:19:41.240451] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-09T19:19:41.240532] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-09T19:19:41.242214] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 54108 (keeping 200 days of data) [2025-10-09T19:19:41.370908] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T19:19:41.518580] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T19:19:41.613071] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-09T19:19:41.645071] [DEBUG] [LOCAL ] HAL: Primary data saved (54108 records). [2025-10-09T19:19:41.645275] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-09T19:19:41.645442] [INFO ] [MAIN ] Update Progress: 994/2373 symbols completed. HAL took 33.4s. Estimated remaining: 3h 13m 43s. Rate: 7.1 symbols/min [2025-10-09T19:19:41.831403] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:41.881048] [DEBUG] [LOCAL ] HBI: Loaded 52987 existing records from primary storage. [2025-10-09T19:19:41.881385] [INFO ] [MAIN ] HBI: Loaded 52987 existing records. [2025-10-09T19:19:42.073971] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:42.079359] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-09T19:19:42.079176] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T19:19:42.079531] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-09T19:19:42.082420] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-09T19:19:42.082486] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-09T19:19:42.401985] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-09T19:19:42.443301] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:42.843151] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-09T19:19:43.196731] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-09T19:19:43.996752] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-09T19:19:44.449937] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T19:19:44.531520] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-09T19:19:44.796754] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-09T19:19:45.596743] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-09T19:19:46.204012] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T19:19:46.396704] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-09T19:19:47.076539] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T19:19:47.125553] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T19:19:47.196675] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-09T19:19:47.996700] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-09T19:19:48.796748] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-09T19:19:48.935068] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T19:19:49.462394] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:19:49.596741] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-09T19:19:50.396748] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-09T19:19:50.426325] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T19:19:51.003851] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-09T19:19:51.197139] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-09T19:19:51.198864] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T19:19:51.996776] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-09T19:19:52.683406] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T19:19:52.796679] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-09T19:19:53.510482] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T19:19:53.596697] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-09T19:19:54.261338] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:19:54.396695] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-09T19:19:54.623276] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T19:19:55.196802] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-09T19:19:55.738761] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-09T19:19:55.996755] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-09T19:19:56.796692] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-09T19:19:56.989494] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T19:19:57.524932] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T19:19:57.596736] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-09T19:19:58.109025] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T19:19:58.114462] [INFO ] [REMOTE ] HAYW: Full fetch complete (70752 records). [2025-10-09T19:19:58.114616] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-09T19:19:58.403345] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-09T19:19:58.506827] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-09T19:19:58.506926] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-09T19:19:58.507863] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-09T19:19:58.507927] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-09T19:19:58.509365] [DEBUG] [LOCAL ] HAYW: Trimmed 70752 records to 49097 (keeping 200 days of data) [2025-10-09T19:19:58.795947] [DEBUG] [LOCAL ] HAYW: Primary data saved (49097 records). [2025-10-09T19:19:58.796084] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-09T19:19:58.797054] [INFO ] [MAIN ] Update Progress: 995/2373 symbols completed. HAYW took 29.4s. Estimated remaining: 3h 13m 47s. Rate: 7.1 symbols/min [2025-10-09T19:19:58.964757] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:19:59.019711] [DEBUG] [LOCAL ] HBM: Loaded 52928 existing records from primary storage. [2025-10-09T19:19:59.020053] [INFO ] [MAIN ] HBM: Loaded 52928 existing records. [2025-10-09T19:19:59.204439] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:19:59.198700] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-09T19:19:59.206382] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-09T19:19:59.206497] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-09T19:19:59.208268] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-09T19:19:59.208330] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-09T19:19:59.597388] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-09T19:19:59.622443] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:19:59.933379] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T19:20:00.004408] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:20:00.005981] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-09T19:20:00.011425] [INFO ] [REMOTE ] HASI: Full fetch complete (68025 records). [2025-10-09T19:20:00.011560] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-09T19:20:00.446435] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-09T19:20:00.446530] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-09T19:20:00.447479] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-09T19:20:00.447545] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-09T19:20:00.449017] [DEBUG] [LOCAL ] HASI: Trimmed 68025 records to 47632 (keeping 200 days of data) [2025-10-09T19:20:00.746464] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-09T19:20:00.757951] [DEBUG] [LOCAL ] HASI: Primary data saved (47632 records). [2025-10-09T19:20:00.758104] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-09T19:20:00.758810] [INFO ] [MAIN ] Update Progress: 996/2373 symbols completed. HASI took 43.9s. Estimated remaining: 3h 13m 29s. Rate: 7.1 symbols/min [2025-10-09T19:20:00.801808] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-09T19:20:00.933468] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:00.980865] [DEBUG] [LOCAL ] HCA: Loaded 46889 existing records from primary storage. [2025-10-09T19:20:00.981227] [INFO ] [MAIN ] HCA: Loaded 46889 existing records. [2025-10-09T19:20:01.158764] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:01.159054] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-09T19:20:01.159102] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-09T19:20:01.160666] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-09T19:20:01.160729] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-09T19:20:01.442102] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T19:20:01.532589] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:01.596677] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-09T19:20:02.396732] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-09T19:20:03.196694] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-09T19:20:03.298958] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T19:20:03.730447] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T19:20:03.731392] [INFO ] [REMOTE ] HBB: Full fetch complete (9439 records). [2025-10-09T19:20:03.731461] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-09T19:20:04.001381] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-09T19:20:04.110461] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-09T19:20:04.110717] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-09T19:20:04.111003] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-09T19:20:04.111142] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-09T19:20:04.111825] [DEBUG] [LOCAL ] HBB: Trimmed 9439 records to 6516 (keeping 200 days of data) [2025-10-09T19:20:04.165598] [DEBUG] [LOCAL ] HBB: Primary data saved (6516 records). [2025-10-09T19:20:04.181700] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-09T19:20:04.181895] [INFO ] [MAIN ] Update Progress: 997/2373 symbols completed. HBB took 32.0s. Estimated remaining: 3h 13m 14s. Rate: 7.1 symbols/min [2025-10-09T19:20:04.183721] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T19:20:04.796748] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-09T19:20:05.596696] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-09T19:20:05.747219] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T19:20:06.292004] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T19:20:06.396733] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-09T19:20:06.707274] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T19:20:07.196774] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-09T19:20:07.717923] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T19:20:07.996730] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-09T19:20:08.796827] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-09T19:20:09.033314] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T19:20:09.596729] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-09T19:20:09.736097] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:20:10.110589] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T19:20:10.396723] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-09T19:20:11.196759] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-09T19:20:11.374988] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:20:11.996721] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-09T19:20:12.069491] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T19:20:12.796763] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-09T19:20:12.919900] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:20:13.427488] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T19:20:13.596730] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-09T19:20:14.396754] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-09T19:20:14.484953] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-09T19:20:15.196694] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-09T19:20:15.285875] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-09T19:20:15.996747] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-09T19:20:16.050908] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T19:20:16.055836] [INFO ] [REMOTE ] HBI: Full fetch complete (76872 records). [2025-10-09T19:20:16.055979] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-09T19:20:16.501087] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-09T19:20:16.501184] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-09T19:20:16.502245] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-09T19:20:16.502341] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-09T19:20:16.505744] [DEBUG] [LOCAL ] HBI: Trimmed 76872 records to 53371 (keeping 200 days of data) [2025-10-09T19:20:16.755146] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T19:20:16.809705] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-09T19:20:16.861972] [DEBUG] [LOCAL ] HBI: Primary data saved (53371 records). [2025-10-09T19:20:16.862142] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-09T19:20:16.862232] [INFO ] [MAIN ] Update Progress: 998/2373 symbols completed. HBI took 35.2s. Estimated remaining: 3h 13m 11s. Rate: 7.1 symbols/min [2025-10-09T19:20:17.651514] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T19:20:17.661201] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-09T19:20:18.288251] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T19:20:18.396672] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-09T19:20:19.466257] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:20:19.477462] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-09T19:20:20.042317] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T19:20:20.053290] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-09T19:20:21.145426] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-09T19:20:21.155275] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-09T19:20:21.493806] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:20:21.596702] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-09T19:20:22.735345] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T19:20:22.750468] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-09T19:20:23.380163] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:20:23.391795] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-09T19:20:24.268851] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T19:20:24.273351] [INFO ] [REMOTE ] HCA: Full fetch complete (68748 records). [2025-10-09T19:20:24.273564] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-09T19:20:24.687370] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-09T19:20:24.687474] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-09T19:20:24.688548] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-09T19:20:24.688621] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-09T19:20:24.690151] [DEBUG] [LOCAL ] HCA: Trimmed 68748 records to 47261 (keeping 200 days of data) [2025-10-09T19:20:25.003268] [DEBUG] [LOCAL ] HCA: Primary data saved (47261 records). [2025-10-09T19:20:25.003441] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-09T19:20:25.004163] [INFO ] [MAIN ] Update Progress: 999/2373 symbols completed. HCA took 24.2s. Estimated remaining: 3h 13m 3s. Rate: 7.1 symbols/min [2025-10-09T19:20:25.197485] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T19:20:25.209275] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-09T19:20:26.978897] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-09T19:20:26.984105] [INFO ] [REMOTE ] HBM: Full fetch complete (76357 records). [2025-10-09T19:20:26.984217] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-09T19:20:27.384528] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-09T19:20:27.384606] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-09T19:20:27.385610] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-09T19:20:27.385695] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-09T19:20:27.387306] [DEBUG] [LOCAL ] HBM: Trimmed 76357 records to 53318 (keeping 200 days of data) [2025-10-09T19:20:27.719460] [DEBUG] [LOCAL ] HBM: Primary data saved (53318 records). [2025-10-09T19:20:27.719616] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-09T19:20:27.720717] [INFO ] [MAIN ] Update Progress: 1000/2373 symbols completed. HBM took 28.9s. Estimated remaining: 3h 12m 46s. Rate: 7.1 symbols/min [2025-10-09T19:20:28.521395] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:28.533339] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:28.544709] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-09T19:20:28.545981] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:28.537493] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:28.547381] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-09T19:20:28.547926] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-09T19:20:28.548200] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-09T19:20:28.548263] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-09T19:20:28.548298] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-09T19:20:28.668500] [DEBUG] [LOCAL ] HCI: Loaded 14077 existing records from primary storage. [2025-10-09T19:20:28.685028] [INFO ] [MAIN ] HCI: Loaded 14077 existing records. [2025-10-09T19:20:29.138775] [DEBUG] [LOCAL ] HD: Loaded 53492 existing records from primary storage. [2025-10-09T19:20:29.101394] [DEBUG] [LOCAL ] HCC: Loaded 45290 existing records from primary storage. [2025-10-09T19:20:29.159798] [INFO ] [MAIN ] HCC: Loaded 45290 existing records. [2025-10-09T19:20:29.159373] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:29.217437] [INFO ] [MAIN ] HD: Loaded 53492 existing records. [2025-10-09T19:20:29.302260] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-09T19:20:29.377914] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-09T19:20:29.423894] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:29.442359] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-09T19:20:29.458001] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-09T19:20:29.464825] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-09T19:20:29.620024] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:29.713128] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-09T19:20:29.723448] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:29.723561] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-09T19:20:29.741083] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-09T19:20:29.748089] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-09T19:20:29.755620] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-09T19:20:29.759171] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-09T19:20:29.779709] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-09T19:20:29.843941] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-09T19:20:29.886926] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-09T19:20:30.013248] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-09T19:20:30.418310] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-09T19:20:30.502603] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-09T19:20:30.526015] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:30.573470] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-09T19:20:30.661544] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:30.674728] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-09T19:20:30.776939] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:30.777241] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-09T19:20:30.907336] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-09T19:20:30.908281] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-09T19:20:31.146692] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-09T19:20:31.147540] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-09T19:20:31.382586] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-09T19:20:31.383420] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-09T19:20:31.629519] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-09T19:20:31.648943] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T19:20:31.883824] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T19:20:31.996734] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-09T19:20:32.324261] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T19:20:32.796774] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-09T19:20:32.946885] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-09T19:20:33.596759] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-09T19:20:33.831452] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-09T19:20:34.109093] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T19:20:34.396718] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-09T19:20:34.702253] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-09T19:20:35.196776] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-09T19:20:35.431326] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-09T19:20:35.996758] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-09T19:20:36.736033] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T19:20:36.796677] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-09T19:20:37.596720] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-09T19:20:37.652781] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:20:38.396732] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-09T19:20:39.021965] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T19:20:39.196688] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-09T19:20:39.412958] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-09T19:20:39.996712] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-09T19:20:40.501426] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T19:20:40.586150] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-09T19:20:40.796750] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-09T19:20:41.223702] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-09T19:20:41.224332] [INFO ] [REMOTE ] HCXY: Full fetch complete (526 records). [2025-10-09T19:20:41.224397] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-09T19:20:41.396992] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-09T19:20:41.397154] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:20:41.397199] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:20:41.397268] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-09T19:20:41.397330] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-09T19:20:41.397366] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-09T19:20:41.397426] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-09T19:20:41.397503] [INFO ] [MAIN ] Update Progress: 1001/2373 symbols completed. HCXY took 13.7s. Estimated remaining: 3h 12m 45s. Rate: 7.1 symbols/min [2025-10-09T19:20:41.560659] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:41.607465] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-09T19:20:41.610346] [DEBUG] [LOCAL ] HDB: Loaded 51940 existing records from primary storage. [2025-10-09T19:20:41.610767] [INFO ] [MAIN ] HDB: Loaded 51940 existing records. [2025-10-09T19:20:41.788973] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:41.789219] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-09T19:20:41.789268] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-09T19:20:41.790575] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-09T19:20:41.790635] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-09T19:20:42.153677] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:42.396694] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-09T19:20:43.196740] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-09T19:20:43.370330] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T19:20:43.629781] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T19:20:43.996686] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-09T19:20:44.134031] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-09T19:20:44.796712] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-09T19:20:45.596698] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-09T19:20:45.639451] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:20:46.396761] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-09T19:20:46.547242] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:20:47.196734] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-09T19:20:47.380551] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T19:20:47.892763] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T19:20:47.996709] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-09T19:20:48.796715] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-09T19:20:48.835459] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:20:49.596736] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-09T19:20:49.968742] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-09T19:20:50.053806] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T19:20:50.396695] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-09T19:20:50.943538] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:20:51.196699] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-09T19:20:51.364998] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-09T19:20:51.996738] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-09T19:20:52.682463] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-09T19:20:52.796676] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-09T19:20:53.596696] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-09T19:20:54.072969] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-09T19:20:54.316213] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-09T19:20:54.396758] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-09T19:20:55.196700] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-09T19:20:55.396526] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T19:20:55.440581] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-09T19:20:55.996735] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-09T19:20:56.630980] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T19:20:56.635022] [INFO ] [REMOTE ] HCC: Full fetch complete (64613 records). [2025-10-09T19:20:56.635191] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-09T19:20:56.799605] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-09T19:20:57.011373] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:20:57.038282] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-09T19:20:57.038367] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-09T19:20:57.039446] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-09T19:20:57.039527] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-09T19:20:57.041032] [DEBUG] [LOCAL ] HCC: Trimmed 64613 records to 45604 (keeping 200 days of data) [2025-10-09T19:20:57.321890] [DEBUG] [LOCAL ] HCC: Primary data saved (45604 records). [2025-10-09T19:20:57.322034] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-09T19:20:57.322139] [INFO ] [MAIN ] Update Progress: 1002/2373 symbols completed. HCC took 29.6s. Estimated remaining: 3h 12m 47s. Rate: 7.1 symbols/min [2025-10-09T19:20:57.488367] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:20:57.538805] [DEBUG] [LOCAL ] HE: Loaded 48999 existing records from primary storage. [2025-10-09T19:20:57.539135] [INFO ] [MAIN ] HE: Loaded 48999 existing records. [2025-10-09T19:20:57.609013] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-09T19:20:57.755432] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:20:57.755703] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-09T19:20:57.755822] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-09T19:20:57.756091] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-09T19:20:57.756149] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-09T19:20:58.120360] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:20:58.396716] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-09T19:20:58.654331] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T19:20:59.053135] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-09T19:20:59.196717] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-09T19:20:59.857443] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T19:20:59.996739] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-09T19:21:00.796681] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-09T19:21:00.877867] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T19:21:00.970805] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T19:21:00.972555] [INFO ] [REMOTE ] HCI: Full fetch complete (19577 records). [2025-10-09T19:21:00.972631] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-09T19:21:01.342349] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-09T19:21:01.342435] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-09T19:21:01.342905] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-09T19:21:01.342968] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-09T19:21:01.343586] [DEBUG] [LOCAL ] HCI: Trimmed 19577 records to 14236 (keeping 200 days of data) [2025-10-09T19:21:01.438470] [DEBUG] [LOCAL ] HCI: Primary data saved (14236 records). [2025-10-09T19:21:01.438631] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-09T19:21:01.438760] [INFO ] [MAIN ] Update Progress: 1003/2373 symbols completed. HCI took 33.7s. Estimated remaining: 3h 12m 33s. Rate: 7.1 symbols/min [2025-10-09T19:21:01.601969] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-09T19:21:01.625335] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:01.665054] [DEBUG] [LOCAL ] HEI: Loaded 31659 existing records from primary storage. [2025-10-09T19:21:01.665524] [INFO ] [MAIN ] HEI: Loaded 31659 existing records. [2025-10-09T19:21:01.851770] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:21:01.851989] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-09T19:21:01.852037] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-09T19:21:01.852262] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-09T19:21:01.852321] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-09T19:21:02.215027] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:02.396748] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-09T19:21:02.619949] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T19:21:03.196746] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-09T19:21:03.657275] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-09T19:21:03.888930] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T19:21:03.996679] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-09T19:21:04.796762] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-09T19:21:05.105351] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T19:21:05.535173] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:21:05.596768] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-09T19:21:06.396747] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-09T19:21:06.714006] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-09T19:21:06.989565] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T19:21:07.196760] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-09T19:21:07.566977] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T19:21:07.996813] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-09T19:21:08.796752] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-09T19:21:08.951343] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T19:21:09.596686] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-09T19:21:10.216807] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-09T19:21:10.396689] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-09T19:21:10.553803] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T19:21:11.196687] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-09T19:21:11.277751] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T19:21:11.996697] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-09T19:21:12.469236] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-09T19:21:12.543846] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T19:21:12.796702] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-09T19:21:13.294324] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T19:21:13.596779] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-09T19:21:14.410249] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-09T19:21:14.448177] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T19:21:15.196750] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-09T19:21:15.693625] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-09T19:21:15.698243] [INFO ] [REMOTE ] HD: Full fetch complete (77446 records). [2025-10-09T19:21:15.698367] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-09T19:21:16.001264] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-09T19:21:16.109869] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-09T19:21:16.110028] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-09T19:21:16.111149] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-09T19:21:16.111287] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-09T19:21:16.133853] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T19:21:16.142082] [DEBUG] [LOCAL ] HD: Trimmed 77446 records to 53881 (keeping 200 days of data) [2025-10-09T19:21:16.488883] [DEBUG] [LOCAL ] HD: Primary data saved (53881 records). [2025-10-09T19:21:16.489045] [INFO ] [MAIN ] HD: Full history saved. [2025-10-09T19:21:16.490050] [INFO ] [MAIN ] Update Progress: 1004/2373 symbols completed. HD took 48.8s. Estimated remaining: 3h 12m 33s. Rate: 7.1 symbols/min [2025-10-09T19:21:16.664961] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:16.676026] [DEBUG] [LOCAL ] HEQ: Loaded 6596 existing records from primary storage. [2025-10-09T19:21:16.676322] [INFO ] [MAIN ] HEQ: Loaded 6596 existing records. [2025-10-09T19:21:16.801895] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-09T19:21:16.862813] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:21:16.863303] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-09T19:21:16.863418] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-09T19:21:16.863706] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-09T19:21:16.863807] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-09T19:21:17.061046] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T19:21:17.277802] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:17.596688] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-09T19:21:17.804323] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T19:21:18.200545] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-09T19:21:18.407461] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-09T19:21:18.409820] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T19:21:19.196729] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-09T19:21:19.676563] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-09T19:21:19.996723] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-09T19:21:20.236788] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-09T19:21:20.241370] [INFO ] [REMOTE ] HDB: Full fetch complete (75322 records). [2025-10-09T19:21:20.241495] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-09T19:21:20.661963] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-09T19:21:20.662060] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-09T19:21:20.663043] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-09T19:21:20.663179] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-09T19:21:20.664751] [DEBUG] [LOCAL ] HDB: Trimmed 75322 records to 52326 (keeping 200 days of data) [2025-10-09T19:21:20.800902] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-09T19:21:21.005764] [DEBUG] [LOCAL ] HDB: Primary data saved (52326 records). [2025-10-09T19:21:21.005926] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-09T19:21:21.006592] [INFO ] [MAIN ] Update Progress: 1005/2373 symbols completed. HDB took 39.6s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-09T19:21:21.188624] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:21.234040] [DEBUG] [LOCAL ] HESM: Loaded 48300 existing records from primary storage. [2025-10-09T19:21:21.234336] [INFO ] [MAIN ] HESM: Loaded 48300 existing records. [2025-10-09T19:21:21.411939] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:21:21.412484] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-09T19:21:21.412844] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-09T19:21:21.414156] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-09T19:21:21.414217] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-09T19:21:21.519815] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-09T19:21:21.607148] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-09T19:21:21.795141] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:21.834949] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T19:21:22.297540] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-09T19:21:22.396730] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-09T19:21:23.196768] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-09T19:21:23.806598] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T19:21:23.996739] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-09T19:21:24.224427] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:21:24.796706] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-09T19:21:25.596734] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-09T19:21:25.708510] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T19:21:26.145559] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T19:21:26.396736] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-09T19:21:27.188311] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T19:21:27.196714] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-09T19:21:27.692943] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T19:21:27.790867] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T19:21:27.996684] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-09T19:21:28.796733] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-09T19:21:28.866430] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-09T19:21:29.596768] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-09T19:21:30.102124] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T19:21:30.396746] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-09T19:21:31.029736] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T19:21:31.196710] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-09T19:21:31.585539] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T19:21:31.624416] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T19:21:31.996705] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-09T19:21:32.796696] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-09T19:21:33.246947] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:21:33.596729] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-09T19:21:34.396729] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-09T19:21:34.429459] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:21:34.440072] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T19:21:34.439820] [INFO ] [REMOTE ] HE: Full fetch complete (72200 records). [2025-10-09T19:21:34.442460] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-09T19:21:34.442947] [INFO ] [REMOTE ] HEI: Full fetch complete (47960 records). [2025-10-09T19:21:34.443149] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-09T19:21:34.926065] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-09T19:21:35.197576] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-09T19:21:35.314890] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-09T19:21:35.315235] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-09T19:21:35.315347] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-09T19:21:35.316373] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-09T19:21:35.316458] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-09T19:21:35.316589] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-09T19:21:35.317597] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-09T19:21:35.318296] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-09T19:21:35.319253] [DEBUG] [LOCAL ] HE: Trimmed 72200 records to 49337 (keeping 200 days of data) [2025-10-09T19:21:35.320505] [DEBUG] [LOCAL ] HEI: Trimmed 47960 records to 31775 (keeping 200 days of data) [2025-10-09T19:21:35.642776] [DEBUG] [LOCAL ] HEI: Primary data saved (31775 records). [2025-10-09T19:21:35.642931] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-09T19:21:35.643036] [INFO ] [MAIN ] Update Progress: 1006/2373 symbols completed. HEI took 34.2s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-09T19:21:35.908928] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:35.909747] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-09T19:21:35.910068] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-09T19:21:35.911031] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-09T19:21:35.911329] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-09T19:21:35.911952] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-09T19:21:35.912318] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-09T19:21:36.003895] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-09T19:21:36.290824] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:36.355134] [DEBUG] [LOCAL ] HE: Primary data saved (49337 records). [2025-10-09T19:21:36.355290] [INFO ] [MAIN ] HE: Full history saved. [2025-10-09T19:21:36.355386] [INFO ] [MAIN ] Update Progress: 1007/2373 symbols completed. HE took 39.0s. Estimated remaining: 3h 12m 1s. Rate: 7.1 symbols/min [2025-10-09T19:21:36.521737] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:36.521895] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-09T19:21:36.521950] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-09T19:21:36.522059] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-09T19:21:36.522101] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-09T19:21:36.522141] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-09T19:21:36.522172] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-09T19:21:36.806006] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T19:21:36.806191] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-09T19:21:36.922810] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:36.948613] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T19:21:37.129266] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-09T19:21:37.596747] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-09T19:21:37.902573] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-09T19:21:38.396733] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-09T19:21:38.840165] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-09T19:21:39.196730] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-09T19:21:39.454360] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-09T19:21:39.996804] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-09T19:21:40.575750] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-09T19:21:40.796799] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-09T19:21:41.050450] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-09T19:21:41.596722] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-09T19:21:41.835934] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-09T19:21:42.396801] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-09T19:21:42.981712] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-09T19:21:43.196754] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-09T19:21:43.539469] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-09T19:21:43.996763] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-09T19:21:44.251334] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-09T19:21:44.796720] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-09T19:21:45.596740] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-09T19:21:46.324107] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:21:46.396712] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-09T19:21:46.451039] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T19:21:46.452630] [INFO ] [REMOTE ] HEQ: Full fetch complete (9436 records). [2025-10-09T19:21:46.452732] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-09T19:21:46.813273] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-09T19:21:46.813355] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-09T19:21:46.813583] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-09T19:21:46.813624] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-09T19:21:46.814079] [DEBUG] [LOCAL ] HEQ: Trimmed 9436 records to 6643 (keeping 200 days of data) [2025-10-09T19:21:46.854242] [DEBUG] [LOCAL ] HEQ: Primary data saved (6643 records). [2025-10-09T19:21:46.854349] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-09T19:21:46.854435] [INFO ] [MAIN ] Update Progress: 1008/2373 symbols completed. HEQ took 30.4s. Estimated remaining: 3h 11m 55s. Rate: 7.1 symbols/min [2025-10-09T19:21:47.048961] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:47.067566] [DEBUG] [LOCAL ] HFRO: Loaded 17481 existing records from primary storage. [2025-10-09T19:21:47.067831] [INFO ] [MAIN ] HFRO: Loaded 17481 existing records. [2025-10-09T19:21:47.206392] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-09T19:21:47.249468] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:21:47.249892] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-09T19:21:47.249950] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-09T19:21:47.250501] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-09T19:21:47.250563] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-09T19:21:47.534066] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-09T19:21:47.617527] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:47.650231] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:21:47.996722] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-09T19:21:48.236482] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-09T19:21:48.796824] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-09T19:21:49.150896] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-09T19:21:49.596720] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-09T19:21:49.823612] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-09T19:21:50.396726] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-09T19:21:50.628295] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-09T19:21:51.196795] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-09T19:21:51.996759] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-09T19:21:52.081462] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T19:21:52.412315] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T19:21:52.796704] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-09T19:21:53.152808] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-09T19:21:53.153485] [INFO ] [REMOTE ] HF: Full fetch complete (443 records). [2025-10-09T19:21:53.153557] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-09T19:21:53.404340] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-09T19:21:53.404511] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:21:53.404581] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:21:53.404670] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-09T19:21:53.404778] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-09T19:21:53.404822] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-09T19:21:53.404864] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-09T19:21:53.404920] [INFO ] [MAIN ] Update Progress: 1009/2373 symbols completed. HF took 17.8s. Estimated remaining: 3h 11m 44s. Rate: 7.1 symbols/min [2025-10-09T19:21:53.568727] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:21:53.568865] [DEBUG] [LOCAL ] HGER: No existing data file found in primary storage. [2025-10-09T19:21:53.568901] [WARN ] [MAIN ] HGER: No existing data found, performing full refresh instead. [2025-10-09T19:21:53.569009] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-09T19:21:53.569048] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-09T19:21:53.569089] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-09T19:21:53.569120] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-09T19:21:53.601789] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-09T19:21:53.919100] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:21:54.396744] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-09T19:21:54.815837] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-09T19:21:55.208253] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-09T19:21:55.213586] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-09T19:21:55.996746] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-09T19:21:56.326682] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T19:21:56.711565] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T19:21:56.796703] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-09T19:21:57.596750] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-09T19:21:57.941793] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-09T19:21:58.231401] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T19:21:58.396761] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-09T19:21:59.117607] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T19:21:59.196729] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-09T19:21:59.556307] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-09T19:21:59.996737] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-09T19:22:00.789468] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T19:22:00.796675] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-09T19:22:01.596689] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-09T19:22:01.650613] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T19:22:02.396783] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-09T19:22:02.640462] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-09T19:22:03.196727] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-09T19:22:03.332578] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:22:03.956562] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-09T19:22:03.996689] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-09T19:22:04.761154] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T19:22:04.796668] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-09T19:22:05.311331] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-09T19:22:05.596718] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-09T19:22:06.396780] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-09T19:22:06.511772] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T19:22:06.822085] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-09T19:22:07.196751] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-09T19:22:07.996697] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-09T19:22:08.318365] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-09T19:22:08.332241] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T19:22:08.796741] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-09T19:22:09.248991] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-09T19:22:09.596727] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-09T19:22:10.381317] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:22:10.396665] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-09T19:22:11.196717] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-09T19:22:11.529370] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-09T19:22:11.531932] [INFO ] [REMOTE ] HGER: Full fetch complete (17783 records). [2025-10-09T19:22:11.532013] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-09T19:22:11.914492] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-09T19:22:11.914570] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-09T19:22:11.914963] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-09T19:22:11.915025] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-09T19:22:11.915598] [DEBUG] [LOCAL ] HGER: Trimmed 17783 records to 14502 (keeping 200 days of data) [2025-10-09T19:22:11.998023] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-09T19:22:12.002753] [DEBUG] [LOCAL ] HGER: Primary data saved (14502 records). [2025-10-09T19:22:12.002905] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-09T19:22:12.002981] [INFO ] [MAIN ] Update Progress: 1010/2373 symbols completed. HGER took 18.6s. Estimated remaining: 3h 11m 49s. Rate: 7.1 symbols/min [2025-10-09T19:22:12.169414] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:12.179432] [DEBUG] [LOCAL ] HGLB: Loaded 9688 existing records from primary storage. [2025-10-09T19:22:12.179636] [INFO ] [MAIN ] HGLB: Loaded 9688 existing records. [2025-10-09T19:22:12.351238] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:12.351468] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-09T19:22:12.351515] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-09T19:22:12.351963] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-09T19:22:12.352022] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-09T19:22:12.533075] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T19:22:12.606974] [INFO ] [REMOTE ] HFND: Full fetch complete (1788 records). [2025-10-09T19:22:12.618047] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-09T19:22:12.797683] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-09T19:22:12.828164] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:12.899344] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-09T19:22:12.899834] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:22:12.899984] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:22:12.900126] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-09T19:22:12.900229] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-09T19:22:12.900297] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-09T19:22:12.911916] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-09T19:22:12.913094] [INFO ] [MAIN ] Update Progress: 1011/2373 symbols completed. HFND took 36.6s. Estimated remaining: 3h 11m 31s. Rate: 7.1 symbols/min [2025-10-09T19:22:12.913565] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:22:12.981019] [INFO ] [REMOTE ] HESM: Full fetch complete (69401 records). [2025-10-09T19:22:12.981174] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-09T19:22:13.255301] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:13.476010] [DEBUG] [LOCAL ] HGTY: Loaded 13249 existing records from primary storage. [2025-10-09T19:22:13.515772] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-09T19:22:13.512299] [INFO ] [MAIN ] HGTY: Loaded 13249 existing records. [2025-10-09T19:22:13.521048] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-09T19:22:13.569905] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-09T19:22:13.602343] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-09T19:22:13.602413] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-09T19:22:13.655419] [DEBUG] [LOCAL ] HESM: Trimmed 69401 records to 48669 (keeping 200 days of data) [2025-10-09T19:22:13.824468] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:13.825295] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-09T19:22:13.825496] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-09T19:22:13.856693] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-09T19:22:13.857369] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-09T19:22:14.092705] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T19:22:14.390257] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:14.396840] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-09T19:22:14.425638] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T19:22:14.489951] [DEBUG] [LOCAL ] HESM: Primary data saved (48669 records). [2025-10-09T19:22:14.490115] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-09T19:22:14.490936] [INFO ] [MAIN ] Update Progress: 1012/2373 symbols completed. HESM took 53.5s. Estimated remaining: 3h 11m 13s. Rate: 7.1 symbols/min [2025-10-09T19:22:14.659188] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:14.705044] [DEBUG] [LOCAL ] HGV: Loaded 46408 existing records from primary storage. [2025-10-09T19:22:14.705385] [INFO ] [MAIN ] HGV: Loaded 46408 existing records. [2025-10-09T19:22:14.884193] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:14.884448] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-09T19:22:14.884519] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-09T19:22:14.884943] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-09T19:22:14.885003] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-09T19:22:15.206325] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-09T19:22:15.258063] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:15.266151] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T19:22:15.996713] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-09T19:22:16.198953] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T19:22:16.796719] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-09T19:22:17.335918] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T19:22:17.543028] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T19:22:17.596721] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-09T19:22:18.144583] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T19:22:18.396726] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-09T19:22:19.196691] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-09T19:22:19.206285] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T19:22:19.996687] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-09T19:22:20.050138] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-09T19:22:20.749698] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T19:22:20.796777] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-09T19:22:21.596685] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-09T19:22:21.713729] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:22:22.396721] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-09T19:22:23.052532] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T19:22:23.146068] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-09T19:22:23.196677] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-09T19:22:23.667797] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T19:22:23.996739] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-09T19:22:24.796704] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-09T19:22:25.027857] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:22:25.596794] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-09T19:22:26.158877] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T19:22:26.319473] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T19:22:26.396705] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-09T19:22:27.096121] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T19:22:27.196704] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-09T19:22:27.975542] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T19:22:27.996730] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-09T19:22:28.513030] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-09T19:22:28.796778] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-09T19:22:29.254354] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T19:22:29.596805] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-09T19:22:30.386244] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-09T19:22:30.396666] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-09T19:22:31.169370] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T19:22:31.196717] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-09T19:22:31.946030] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T19:22:31.996742] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-09T19:22:32.767970] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-09T19:22:32.796714] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-09T19:22:33.449220] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T19:22:33.450880] [INFO ] [REMOTE ] HGLB: Full fetch complete (14811 records). [2025-10-09T19:22:33.450975] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-09T19:22:33.601941] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-09T19:22:33.832716] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-09T19:22:33.832797] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-09T19:22:33.833141] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-09T19:22:33.833201] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-09T19:22:33.833714] [DEBUG] [LOCAL ] HGLB: Trimmed 14811 records to 9747 (keeping 200 days of data) [2025-10-09T19:22:33.891429] [DEBUG] [LOCAL ] HGLB: Primary data saved (9747 records). [2025-10-09T19:22:33.891532] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-09T19:22:33.891611] [INFO ] [MAIN ] Update Progress: 1013/2373 symbols completed. HGLB took 21.9s. Estimated remaining: 3h 11m 19s. Rate: 7.1 symbols/min [2025-10-09T19:22:34.055115] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:34.090524] [DEBUG] [LOCAL ] HHH: Loaded 32955 existing records from primary storage. [2025-10-09T19:22:34.090821] [INFO ] [MAIN ] HHH: Loaded 32955 existing records. [2025-10-09T19:22:34.263887] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:34.264127] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-09T19:22:34.264174] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-09T19:22:34.265066] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-09T19:22:34.265125] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-09T19:22:34.418170] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-09T19:22:34.558553] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-09T19:22:34.640866] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:35.196728] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-09T19:22:35.874269] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-09T19:22:35.996707] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-09T19:22:36.209783] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:22:36.796696] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-09T19:22:37.003264] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T19:22:37.596689] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-09T19:22:37.773665] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T19:22:38.396720] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-09T19:22:39.201802] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-09T19:22:39.220503] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-09T19:22:39.244752] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T19:22:39.996718] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-09T19:22:40.589612] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T19:22:40.796678] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-09T19:22:41.068200] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-09T19:22:41.596708] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-09T19:22:41.975756] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-09T19:22:42.396736] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-09T19:22:42.498975] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-09T19:22:42.500733] [INFO ] [REMOTE ] HFRO: Full fetch complete (28536 records). [2025-10-09T19:22:42.500813] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-09T19:22:42.866830] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-09T19:22:42.866910] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-09T19:22:42.867529] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-09T19:22:42.867569] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-09T19:22:42.868282] [DEBUG] [LOCAL ] HFRO: Trimmed 28536 records to 17557 (keeping 200 days of data) [2025-10-09T19:22:42.975875] [DEBUG] [LOCAL ] HFRO: Primary data saved (17557 records). [2025-10-09T19:22:42.976008] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-09T19:22:42.976103] [INFO ] [MAIN ] Update Progress: 1014/2373 symbols completed. HFRO took 56.1s. Estimated remaining: 3h 11m 12s. Rate: 7.1 symbols/min [2025-10-09T19:22:43.141785] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:43.177429] [DEBUG] [LOCAL ] HI: Loaded 35330 existing records from primary storage. [2025-10-09T19:22:43.177751] [INFO ] [MAIN ] HI: Loaded 35330 existing records. [2025-10-09T19:22:43.208034] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-09T19:22:43.271265] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-09T19:22:43.296537] [INFO ] [REMOTE ] HGTY: Full fetch complete (17309 records). [2025-10-09T19:22:43.307381] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-09T19:22:43.487867] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:43.498386] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-09T19:22:43.508728] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-09T19:22:43.542080] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-09T19:22:43.562109] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-09T19:22:43.939154] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-09T19:22:43.956871] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-09T19:22:43.969140] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-09T19:22:43.969234] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-09T19:22:44.002202] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-09T19:22:44.002703] [DEBUG] [LOCAL ] HGTY: Trimmed 17309 records to 13314 (keeping 200 days of data) [2025-10-09T19:22:44.207837] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:44.230608] [DEBUG] [LOCAL ] HGTY: Primary data saved (13314 records). [2025-10-09T19:22:44.230810] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-09T19:22:44.230924] [INFO ] [MAIN ] Update Progress: 1015/2373 symbols completed. HGTY took 31.3s. Estimated remaining: 3h 10m 54s. Rate: 7.1 symbols/min [2025-10-09T19:22:44.408013] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:22:44.466145] [DEBUG] [LOCAL ] HIG: Loaded 51163 existing records from primary storage. [2025-10-09T19:22:44.466515] [INFO ] [MAIN ] HIG: Loaded 51163 existing records. [2025-10-09T19:22:44.645882] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:22:44.646126] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-09T19:22:44.646195] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-09T19:22:44.647069] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-09T19:22:44.647128] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-09T19:22:44.803749] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-09T19:22:44.955449] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T19:22:45.043014] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:22:45.352798] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:22:45.596717] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-09T19:22:46.238506] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:22:46.396748] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-09T19:22:46.882378] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:22:47.196784] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-09T19:22:47.996798] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-09T19:22:48.195767] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T19:22:48.792429] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T19:22:48.800731] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-09T19:22:49.244771] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:22:49.596733] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-09T19:22:50.396907] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-09T19:22:50.470065] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T19:22:50.827822] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T19:22:51.196737] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-09T19:22:51.599100] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-09T19:22:51.996745] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-09T19:22:52.796733] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-09T19:22:53.596777] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-09T19:23:05.572936] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (11.98 seconds). [2025-10-09T19:23:05.579926] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-09T19:23:05.771407] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (13.77 seconds). [2025-10-09T19:23:05.779440] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-09T19:23:06.263442] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (15.07 seconds). [2025-10-09T19:23:06.273069] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-09T19:23:06.961269] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (14.16 seconds). [2025-10-09T19:23:06.973102] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-09T19:23:07.017610] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T19:23:07.025147] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-09T19:23:07.211947] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T19:23:07.220168] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-09T19:23:07.674244] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-09T19:23:07.685237] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-09T19:23:08.426544] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T19:23:08.434493] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-09T19:23:08.567394] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-09T19:23:08.578880] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-09T19:23:08.781496] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-09T19:23:08.791807] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-09T19:23:09.579484] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T19:23:09.591734] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-09T19:23:09.600470] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-09T19:23:09.604013] [INFO ] [REMOTE ] HHH: Full fetch complete (45710 records). [2025-10-09T19:23:09.604127] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-09T19:23:10.033737] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-09T19:23:10.033975] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-09T19:23:10.034869] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-09T19:23:10.034983] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-09T19:23:10.036236] [DEBUG] [LOCAL ] HHH: Trimmed 45710 records to 33138 (keeping 200 days of data) [2025-10-09T19:23:10.183798] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-09T19:23:10.204333] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-09T19:23:10.288910] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T19:23:10.308524] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-09T19:23:10.315531] [DEBUG] [LOCAL ] HHH: Primary data saved (33138 records). [2025-10-09T19:23:10.316737] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-09T19:23:10.316854] [INFO ] [MAIN ] Update Progress: 1016/2373 symbols completed. HHH took 36.4s. Estimated remaining: 3h 11m 9s. Rate: 7.1 symbols/min [2025-10-09T19:23:10.504534] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:10.546885] [DEBUG] [LOCAL ] HII: Loaded 34069 existing records from primary storage. [2025-10-09T19:23:10.547204] [INFO ] [MAIN ] HII: Loaded 34069 existing records. [2025-10-09T19:23:10.732035] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:10.732291] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-09T19:23:10.732341] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-09T19:23:10.733121] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-09T19:23:10.733180] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-09T19:23:11.104863] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:11.105243] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-09T19:23:11.274000] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T19:23:11.285250] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-09T19:23:11.699955] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T19:23:11.707206] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-09T19:23:12.252238] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T19:23:12.260234] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-09T19:23:12.851725] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-09T19:23:12.862816] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-09T19:23:13.076909] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T19:23:13.084606] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-09T19:23:13.752495] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T19:23:13.760232] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-09T19:23:14.512096] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T19:23:14.523573] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-09T19:23:14.569236] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-09T19:23:14.577568] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-09T19:23:15.221378] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T19:23:15.230225] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-09T19:23:15.557936] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T19:23:15.565450] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-09T19:23:15.751994] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T19:23:15.762792] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-09T19:23:16.199589] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (6.00 seconds). [2025-10-09T19:23:16.203936] [INFO ] [REMOTE ] HGV: Full fetch complete (65826 records). [2025-10-09T19:23:16.204083] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-09T19:23:16.599114] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-09T19:23:16.599214] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-09T19:23:16.600229] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-09T19:23:16.600381] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-09T19:23:16.603213] [DEBUG] [LOCAL ] HGV: Trimmed 65826 records to 46691 (keeping 200 days of data) [2025-10-09T19:23:16.746152] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:23:16.763348] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-09T19:23:16.862735] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T19:23:16.868208] [INFO ] [REMOTE ] HI: Full fetch complete (49975 records). [2025-10-09T19:23:16.869124] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-09T19:23:17.279367] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-09T19:23:17.279812] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-09T19:23:17.281333] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-09T19:23:17.281420] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-09T19:23:17.286095] [DEBUG] [LOCAL ] HI: Trimmed 49975 records to 35577 (keeping 200 days of data) [2025-10-09T19:23:17.460459] [DEBUG] [LOCAL ] HGV: Primary data saved (46691 records). [2025-10-09T19:23:17.460700] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-09T19:23:17.461405] [INFO ] [MAIN ] Update Progress: 1017/2373 symbols completed. HGV took 1m 3s. Estimated remaining: 3h 10m 59s. Rate: 7.1 symbols/min [2025-10-09T19:23:17.695776] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-09T19:23:17.761597] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:17.764744] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-09T19:23:17.785081] [DEBUG] [LOCAL ] HI: Primary data saved (35577 records). [2025-10-09T19:23:17.785201] [INFO ] [MAIN ] HI: Full history saved. [2025-10-09T19:23:17.786242] [INFO ] [MAIN ] Update Progress: 1018/2373 symbols completed. HI took 34.8s. Estimated remaining: 3h 10m 39s. Rate: 7.1 symbols/min [2025-10-09T19:23:17.996453] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:17.997723] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-09T19:23:17.998062] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-09T19:23:18.195176] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:18.195443] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-09T19:23:18.195549] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-09T19:23:18.196316] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-09T19:23:18.197238] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-09T19:23:18.197113] [DEBUG] [LOCAL ] HIO: Loaded 24054 existing records from primary storage. [2025-10-09T19:23:18.239365] [INFO ] [MAIN ] HIO: Loaded 24054 existing records. [2025-10-09T19:23:18.677827] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:18.693882] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-09T19:23:18.746335] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-09T19:23:18.764835] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-09T19:23:18.768971] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:18.765825] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-09T19:23:18.806547] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-09T19:23:19.056105] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-09T19:23:19.113249] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-09T19:23:19.206299] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:19.206832] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-09T19:23:19.219685] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:23:19.226015] [INFO ] [REMOTE ] HIG: Full fetch complete (73183 records). [2025-10-09T19:23:19.226198] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-09T19:23:19.623465] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-09T19:23:19.623572] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-09T19:23:19.624923] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-09T19:23:19.625023] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-09T19:23:19.626788] [DEBUG] [LOCAL ] HIG: Trimmed 73183 records to 51520 (keeping 200 days of data) [2025-10-09T19:23:19.970510] [DEBUG] [LOCAL ] HIG: Primary data saved (51520 records). [2025-10-09T19:23:19.970728] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-09T19:23:19.970833] [INFO ] [MAIN ] Update Progress: 1019/2373 symbols completed. HIG took 35.7s. Estimated remaining: 3h 10m 23s. Rate: 7.1 symbols/min [2025-10-09T19:23:20.140954] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:20.163888] [DEBUG] [LOCAL ] HIPO: Loaded 21980 existing records from primary storage. [2025-10-09T19:23:20.164150] [INFO ] [MAIN ] HIPO: Loaded 21980 existing records. [2025-10-09T19:23:20.345470] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:20.345814] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-09T19:23:20.345864] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-09T19:23:20.346127] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-09T19:23:20.346185] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-09T19:23:20.546745] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T19:23:20.600733] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-09T19:23:20.749771] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:23:20.770086] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:20.771968] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-09T19:23:20.771554] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-09T19:23:21.276129] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-09T19:23:21.288201] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-09T19:23:21.839681] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T19:23:21.844243] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-09T19:23:21.904235] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-09T19:23:22.183840] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T19:23:22.396790] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-09T19:23:22.626856] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T19:23:23.179151] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T19:23:23.196665] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-09T19:23:23.653306] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T19:23:23.996778] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-09T19:23:24.796822] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-09T19:23:25.286039] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T19:23:25.599227] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-09T19:23:25.604597] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-10-09T19:23:25.656872] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:23:26.396790] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-09T19:23:26.678547] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T19:23:27.196782] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-09T19:23:27.652013] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-09T19:23:27.996784] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-09T19:23:28.284218] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T19:23:28.796734] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-09T19:23:29.596740] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-09T19:23:29.979466] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T19:23:30.401936] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-09T19:23:30.422398] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-09T19:23:30.751129] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-09T19:23:31.196738] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-09T19:23:31.554596] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:23:31.558073] [INFO ] [REMOTE ] HII: Full fetch complete (52513 records). [2025-10-09T19:23:31.558205] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-09T19:23:31.945279] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-09T19:23:31.945387] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-09T19:23:31.946251] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-09T19:23:31.946315] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-09T19:23:31.947630] [DEBUG] [LOCAL ] HII: Trimmed 52513 records to 34262 (keeping 200 days of data) [2025-10-09T19:23:32.006058] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-09T19:23:32.168386] [DEBUG] [LOCAL ] HII: Primary data saved (34262 records). [2025-10-09T19:23:32.168541] [INFO ] [MAIN ] HII: Full history saved. [2025-10-09T19:23:32.168628] [INFO ] [MAIN ] Update Progress: 1020/2373 symbols completed. HII took 21.9s. Estimated remaining: 3h 10m 19s. Rate: 7.1 symbols/min [2025-10-09T19:23:32.334434] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:32.378527] [DEBUG] [LOCAL ] HIW: Loaded 44497 existing records from primary storage. [2025-10-09T19:23:32.378883] [INFO ] [MAIN ] HIW: Loaded 44497 existing records. [2025-10-09T19:23:32.557935] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:32.558166] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-09T19:23:32.558212] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-09T19:23:32.558684] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-09T19:23:32.558742] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-09T19:23:32.801821] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-09T19:23:32.913055] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:33.119621] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T19:23:33.476192] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-09T19:23:33.596695] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-09T19:23:33.834015] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T19:23:34.396728] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-09T19:23:34.613880] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:23:35.196732] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-09T19:23:35.242968] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T19:23:35.996748] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-09T19:23:36.440773] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-09T19:23:36.796685] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-09T19:23:36.893595] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-09T19:23:37.596718] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-09T19:23:38.396788] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-09T19:23:38.728250] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T19:23:39.196814] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-09T19:23:39.415772] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T19:23:39.521561] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-09T19:23:39.996728] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-09T19:23:40.586350] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:23:40.796707] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-09T19:23:41.008403] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:23:41.596724] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-09T19:23:42.328864] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-09T19:23:42.396679] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-09T19:23:42.633945] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-09T19:23:43.196751] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-09T19:23:43.874704] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T19:23:43.996721] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-09T19:23:44.796785] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-09T19:23:45.483721] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-09T19:23:45.502574] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T19:23:45.596671] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-09T19:23:45.627497] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-09T19:23:45.629398] [INFO ] [REMOTE ] HIPO: Full fetch complete (31397 records). [2025-10-09T19:23:45.629480] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-09T19:23:45.996871] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-09T19:23:45.996948] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-09T19:23:45.997562] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-09T19:23:45.997623] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-09T19:23:45.998393] [DEBUG] [LOCAL ] HIPO: Trimmed 31397 records to 22079 (keeping 200 days of data) [2025-10-09T19:23:46.127009] [DEBUG] [LOCAL ] HIPO: Primary data saved (22079 records). [2025-10-09T19:23:46.127134] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-09T19:23:46.127242] [INFO ] [MAIN ] Update Progress: 1021/2373 symbols completed. HIPO took 26.2s. Estimated remaining: 3h 10m 18s. Rate: 7.1 symbols/min [2025-10-09T19:23:46.292737] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:46.312979] [DEBUG] [LOCAL ] HIX: Loaded 20688 existing records from primary storage. [2025-10-09T19:23:46.313214] [INFO ] [MAIN ] HIX: Loaded 20688 existing records. [2025-10-09T19:23:46.404580] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-09T19:23:46.492287] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:46.492462] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-09T19:23:46.492509] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-09T19:23:46.492821] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-09T19:23:46.492878] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-09T19:23:46.844806] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:47.205023] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-09T19:23:47.221994] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:23:47.996732] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-09T19:23:48.489283] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T19:23:48.796765] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-09T19:23:49.094934] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T19:23:49.159439] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-09T19:23:49.596756] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-09T19:23:50.160036] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T19:23:50.396738] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-09T19:23:50.791720] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:23:50.795258] [INFO ] [REMOTE ] HIO: Full fetch complete (37783 records). [2025-10-09T19:23:50.795381] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-09T19:23:51.200048] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-09T19:23:51.264031] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-09T19:23:51.264165] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-09T19:23:51.264898] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-09T19:23:51.264962] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-09T19:23:51.265772] [DEBUG] [LOCAL ] HIO: Trimmed 37783 records to 24258 (keeping 200 days of data) [2025-10-09T19:23:51.407106] [DEBUG] [LOCAL ] HIO: Primary data saved (24258 records). [2025-10-09T19:23:51.407241] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-09T19:23:51.407341] [INFO ] [MAIN ] Update Progress: 1022/2373 symbols completed. HIO took 33.6s. Estimated remaining: 3h 10m 5s. Rate: 7.1 symbols/min [2025-10-09T19:23:51.573384] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:23:51.592344] [DEBUG] [LOCAL ] HKD: Loaded 18518 existing records from primary storage. [2025-10-09T19:23:51.592585] [INFO ] [MAIN ] HKD: Loaded 18518 existing records. [2025-10-09T19:23:51.765575] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:23:51.765789] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-09T19:23:51.765837] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-09T19:23:51.766071] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-09T19:23:51.766127] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-09T19:23:52.009621] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-09T19:23:52.139336] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:23:52.445724] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:23:52.647143] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-09T19:23:52.796730] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-09T19:23:53.300858] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T19:23:53.596739] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-09T19:23:54.102452] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:23:54.396735] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-09T19:23:55.105451] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-09T19:23:55.137968] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-09T19:23:55.196725] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-09T19:23:55.996740] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-09T19:23:56.370539] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T19:23:56.599879] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-09T19:23:56.796731] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-09T19:23:57.596731] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-09T19:23:57.828517] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T19:23:58.396736] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-09T19:23:59.201944] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-09T19:23:59.219103] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-09T19:23:59.268634] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T19:23:59.996762] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-09T19:24:00.796773] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-09T19:24:01.206076] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T19:24:01.490529] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-09T19:24:01.596673] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-09T19:24:02.381696] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-09T19:24:02.396682] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-09T19:24:03.196774] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-09T19:24:03.633539] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T19:24:03.996766] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-09T19:24:04.315447] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T19:24:04.332884] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-09T19:24:04.337482] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-09T19:24:04.337609] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-09T19:24:04.740878] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-09T19:24:04.741005] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-09T19:24:04.742007] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-09T19:24:04.742484] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-09T19:24:04.744075] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 54207 (keeping 200 days of data) [2025-10-09T19:24:04.797131] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-09T19:24:05.075215] [DEBUG] [LOCAL ] HIMS: Primary data saved (54207 records). [2025-10-09T19:24:05.075359] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-09T19:24:05.076167] [INFO ] [MAIN ] Update Progress: 1023/2373 symbols completed. HIMS took 47.6s. Estimated remaining: 3h 10m 4s. Rate: 7.1 symbols/min [2025-10-09T19:24:05.250664] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:05.293700] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T19:24:05.297791] [INFO ] [REMOTE ] HIW: Full fetch complete (64767 records). [2025-10-09T19:24:05.297962] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-09T19:24:05.422768] [DEBUG] [LOCAL ] HL: Loaded 53672 existing records from primary storage. [2025-10-09T19:24:05.443553] [INFO ] [MAIN ] HL: Loaded 53672 existing records. [2025-10-09T19:24:05.618564] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-09T19:24:05.802053] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:05.806000] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-09T19:24:05.806407] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-09T19:24:05.817467] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-09T19:24:05.822696] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-09T19:24:05.990371] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-09T19:24:06.008791] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-09T19:24:06.023477] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-09T19:24:06.025221] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-09T19:24:06.048294] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T19:24:06.117061] [DEBUG] [LOCAL ] HIW: Trimmed 64767 records to 44796 (keeping 200 days of data) [2025-10-09T19:24:06.396396] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:06.397767] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-09T19:24:06.569278] [DEBUG] [LOCAL ] HIW: Primary data saved (44796 records). [2025-10-09T19:24:06.569421] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-09T19:24:06.569506] [INFO ] [MAIN ] Update Progress: 1024/2373 symbols completed. HIW took 34.4s. Estimated remaining: 3h 9m 46s. Rate: 7.1 symbols/min [2025-10-09T19:24:06.738968] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:06.775508] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-09T19:24:06.795793] [DEBUG] [LOCAL ] HLF: Loaded 48417 existing records from primary storage. [2025-10-09T19:24:06.796097] [INFO ] [MAIN ] HLF: Loaded 48417 existing records. [2025-10-09T19:24:06.970508] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:06.970772] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-09T19:24:06.970822] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-09T19:24:06.971176] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-09T19:24:06.971234] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-09T19:24:07.202028] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-09T19:24:07.327030] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:07.486084] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T19:24:07.996736] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-09T19:24:08.331040] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:24:08.746786] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T19:24:08.749919] [INFO ] [REMOTE ] HIX: Full fetch complete (30333 records). [2025-10-09T19:24:08.750069] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-09T19:24:08.802130] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-09T19:24:09.298866] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-09T19:24:09.298972] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-09T19:24:09.299850] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-09T19:24:09.299922] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-09T19:24:09.301062] [DEBUG] [LOCAL ] HIX: Trimmed 30333 records to 20748 (keeping 200 days of data) [2025-10-09T19:24:09.445901] [DEBUG] [LOCAL ] HIX: Primary data saved (20748 records). [2025-10-09T19:24:09.446088] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-09T19:24:09.446212] [INFO ] [MAIN ] Update Progress: 1025/2373 symbols completed. HIX took 23.3s. Estimated remaining: 3h 9m 30s. Rate: 7.1 symbols/min [2025-10-09T19:24:09.606633] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-09T19:24:09.641561] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:09.676660] [DEBUG] [LOCAL ] HLI: Loaded 30808 existing records from primary storage. [2025-10-09T19:24:09.676936] [INFO ] [MAIN ] HLI: Loaded 30808 existing records. [2025-10-09T19:24:09.855264] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:09.855510] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-09T19:24:09.855559] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-09T19:24:09.855864] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-09T19:24:09.855921] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-09T19:24:09.945494] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T19:24:10.218353] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:10.396732] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-09T19:24:11.196690] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-09T19:24:11.378997] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T19:24:11.559882] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T19:24:11.996751] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-09T19:24:12.796744] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-09T19:24:13.164422] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-09T19:24:13.214932] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T19:24:13.596790] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-09T19:24:14.154147] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T19:24:14.396725] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-09T19:24:15.196719] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-09T19:24:15.457408] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-09T19:24:15.498031] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T19:24:15.996734] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-09T19:24:16.542177] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T19:24:16.796771] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-09T19:24:17.352864] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-09T19:24:17.596736] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-09T19:24:18.396805] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-09T19:24:18.679358] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-09T19:24:18.822062] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T19:24:19.196725] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-09T19:24:19.353305] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-09T19:24:19.996828] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-09T19:24:20.513315] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T19:24:20.796754] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-09T19:24:21.596722] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-09T19:24:21.957759] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T19:24:21.994506] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-09T19:24:21.996893] [INFO ] [REMOTE ] HKD: Full fetch complete (28274 records). [2025-10-09T19:24:21.997002] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-09T19:24:22.396936] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-09T19:24:22.425456] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-09T19:24:22.425545] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-09T19:24:22.426180] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-09T19:24:22.426351] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-09T19:24:22.427307] [DEBUG] [LOCAL ] HKD: Trimmed 28274 records to 18664 (keeping 200 days of data) [2025-10-09T19:24:22.536623] [DEBUG] [LOCAL ] HKD: Primary data saved (18664 records). [2025-10-09T19:24:22.536807] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-09T19:24:22.536894] [INFO ] [MAIN ] Update Progress: 1026/2373 symbols completed. HKD took 31.1s. Estimated remaining: 3h 9m 28s. Rate: 7.1 symbols/min [2025-10-09T19:24:22.708046] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:22.745072] [DEBUG] [LOCAL ] HLIO: Loaded 27907 existing records from primary storage. [2025-10-09T19:24:22.745431] [INFO ] [MAIN ] HLIO: Loaded 27907 existing records. [2025-10-09T19:24:22.933890] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:22.934208] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-09T19:24:22.934371] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-09T19:24:22.934943] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-09T19:24:22.935012] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-09T19:24:23.075463] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T19:24:23.202089] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-09T19:24:23.397391] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:23.996715] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-09T19:24:24.431897] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-09T19:24:24.528069] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T19:24:24.796723] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-09T19:24:25.122478] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T19:24:25.596739] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-09T19:24:26.396701] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-09T19:24:26.802124] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T19:24:27.151732] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:24:27.196745] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-09T19:24:27.996676] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-09T19:24:28.032354] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:24:28.079908] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T19:24:28.796788] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-09T19:24:29.397808] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T19:24:29.467904] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T19:24:29.596729] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-09T19:24:30.396760] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-09T19:24:30.478312] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T19:24:31.196734] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-09T19:24:31.996710] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-09T19:24:32.103624] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T19:24:32.289675] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T19:24:32.796773] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-09T19:24:33.362884] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T19:24:33.596776] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-09T19:24:34.201236] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:24:34.396758] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-09T19:24:35.098430] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-09T19:24:35.196699] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-09T19:24:35.996680] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-09T19:24:36.230349] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T19:24:36.509737] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T19:24:36.796743] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-09T19:24:37.081226] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T19:24:37.596730] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-09T19:24:38.396789] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-09T19:24:38.764693] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-09T19:24:38.880602] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T19:24:39.196725] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-09T19:24:39.756775] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:24:39.996786] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-09T19:24:40.605177] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-09T19:24:40.796767] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-09T19:24:41.596779] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-09T19:24:41.761185] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T19:24:41.764409] [INFO ] [REMOTE ] HLI: Full fetch complete (45162 records). [2025-10-09T19:24:41.764529] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-09T19:24:42.170597] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-09T19:24:42.170739] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-09T19:24:42.171494] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-09T19:24:42.171565] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-09T19:24:42.172993] [DEBUG] [LOCAL ] HLI: Trimmed 45162 records to 31088 (keeping 200 days of data) [2025-10-09T19:24:42.203470] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-09T19:24:42.397283] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-09T19:24:42.417787] [DEBUG] [LOCAL ] HLI: Primary data saved (31088 records). [2025-10-09T19:24:42.417951] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-09T19:24:42.418038] [INFO ] [MAIN ] Update Progress: 1027/2373 symbols completed. HLI took 33.0s. Estimated remaining: 3h 9m 35s. Rate: 7.1 symbols/min [2025-10-09T19:24:42.586412] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:42.619465] [DEBUG] [LOCAL ] HLLY: Loaded 33454 existing records from primary storage. [2025-10-09T19:24:42.619847] [INFO ] [MAIN ] HLLY: Loaded 33454 existing records. [2025-10-09T19:24:42.801856] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:42.802239] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-09T19:24:42.802295] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-09T19:24:42.802570] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-09T19:24:42.802627] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-09T19:24:42.931753] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T19:24:42.969953] [INFO ] [REMOTE ] HLF: Full fetch complete (70955 records). [2025-10-09T19:24:42.978865] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-09T19:24:43.203452] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-09T19:24:43.445075] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:43.624161] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-09T19:24:43.624325] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-09T19:24:43.625307] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-09T19:24:43.625389] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-09T19:24:43.642298] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T19:24:43.648513] [DEBUG] [LOCAL ] HLF: Trimmed 70955 records to 48765 (keeping 200 days of data) [2025-10-09T19:24:43.935382] [DEBUG] [LOCAL ] HLF: Primary data saved (48765 records). [2025-10-09T19:24:43.935574] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-09T19:24:43.935707] [INFO ] [MAIN ] Update Progress: 1028/2373 symbols completed. HLF took 37.4s. Estimated remaining: 3h 9m 17s. Rate: 7.1 symbols/min [2025-10-09T19:24:44.001858] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-09T19:24:44.110750] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:44.160774] [DEBUG] [LOCAL ] HLN: Loaded 53097 existing records from primary storage. [2025-10-09T19:24:44.161113] [INFO ] [MAIN ] HLN: Loaded 53097 existing records. [2025-10-09T19:24:44.342697] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:44.342928] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-09T19:24:44.342977] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-09T19:24:44.343392] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-09T19:24:44.343455] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-09T19:24:44.699378] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:44.796667] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-09T19:24:45.330386] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T19:24:45.424125] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-09T19:24:45.431443] [INFO ] [REMOTE ] HL: Full fetch complete (77663 records). [2025-10-09T19:24:45.431570] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-09T19:24:45.602922] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-09T19:24:45.824369] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-09T19:24:45.824454] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-09T19:24:45.825442] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-09T19:24:45.825507] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-09T19:24:45.826942] [DEBUG] [LOCAL ] HL: Trimmed 77663 records to 54062 (keeping 200 days of data) [2025-10-09T19:24:46.161036] [DEBUG] [LOCAL ] HL: Primary data saved (54062 records). [2025-10-09T19:24:46.161465] [INFO ] [MAIN ] HL: Full history saved. [2025-10-09T19:24:46.162201] [INFO ] [MAIN ] Update Progress: 1029/2373 symbols completed. HL took 41.1s. Estimated remaining: 3h 9m 1s. Rate: 7.1 symbols/min [2025-10-09T19:24:46.334555] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:46.401337] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-09T19:24:46.403227] [DEBUG] [LOCAL ] HLT: Loaded 50612 existing records from primary storage. [2025-10-09T19:24:46.403493] [INFO ] [MAIN ] HLT: Loaded 50612 existing records. [2025-10-09T19:24:46.614969] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:46.617929] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-09T19:24:46.617989] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-09T19:24:46.619612] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-09T19:24:46.619565] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-09T19:24:46.623577] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-09T19:24:46.995141] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:47.049170] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T19:24:47.196729] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-09T19:24:47.694749] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T19:24:47.996729] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-09T19:24:48.796737] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-09T19:24:48.873193] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T19:24:49.194604] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-09T19:24:49.596746] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-09T19:24:50.140258] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T19:24:50.396746] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-09T19:24:50.629013] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-09T19:24:51.196764] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-09T19:24:51.731242] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T19:24:51.996746] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-09T19:24:52.429518] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T19:24:52.796716] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-09T19:24:53.086061] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T19:24:53.596784] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-09T19:24:53.666016] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-09T19:24:54.383184] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T19:24:54.396688] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-09T19:24:55.196722] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-09T19:24:55.541690] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T19:24:55.544635] [INFO ] [REMOTE ] HLIO: Full fetch complete (36417 records). [2025-10-09T19:24:55.544743] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-09T19:24:55.920103] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-09T19:24:55.920190] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-09T19:24:55.921014] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-09T19:24:55.921079] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-09T19:24:55.922022] [DEBUG] [LOCAL ] HLIO: Trimmed 36417 records to 28060 (keeping 200 days of data) [2025-10-09T19:24:56.017056] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-09T19:24:56.104403] [DEBUG] [LOCAL ] HLIO: Primary data saved (28060 records). [2025-10-09T19:24:56.104543] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-09T19:24:56.105488] [INFO ] [MAIN ] Update Progress: 1030/2373 symbols completed. HLIO took 33.6s. Estimated remaining: 3h 8m 54s. Rate: 7.1 symbols/min [2025-10-09T19:24:56.277250] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:24:56.329054] [DEBUG] [LOCAL ] HLX: Loaded 47588 existing records from primary storage. [2025-10-09T19:24:56.329402] [INFO ] [MAIN ] HLX: Loaded 47588 existing records. [2025-10-09T19:24:56.511727] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:24:56.512122] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-09T19:24:56.512223] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-09T19:24:56.512711] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-09T19:24:56.512781] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-09T19:24:56.800992] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-09T19:24:56.889584] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:24:56.915619] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T19:24:57.417170] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T19:24:57.596697] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-09T19:24:58.396703] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-09T19:24:58.546756] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T19:24:59.196766] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-09T19:24:59.337610] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T19:24:59.764907] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-09T19:24:59.996726] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-09T19:25:00.796701] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-09T19:25:01.008702] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T19:25:01.605050] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-09T19:25:01.646029] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T19:25:02.396722] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-09T19:25:02.683172] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-09T19:25:02.740798] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T19:25:03.196722] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-09T19:25:03.996739] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-09T19:25:04.103310] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T19:25:04.486240] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T19:25:04.796712] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-09T19:25:05.330084] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T19:25:05.596757] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-09T19:25:05.810328] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-09T19:25:06.396726] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-09T19:25:06.817479] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T19:25:07.196713] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-09T19:25:07.996690] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-09T19:25:08.447534] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T19:25:08.591144] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:25:08.796701] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-09T19:25:09.596710] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-09T19:25:09.721596] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-09T19:25:10.145270] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T19:25:10.396698] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-09T19:25:11.196727] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-09T19:25:11.293813] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T19:25:11.996757] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-09T19:25:12.087307] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T19:25:12.796815] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-09T19:25:13.091529] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-09T19:25:13.291765] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T19:25:13.596785] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-09T19:25:14.070255] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T19:25:14.073374] [INFO ] [REMOTE ] HLLY: Full fetch complete (46208 records). [2025-10-09T19:25:14.073456] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-09T19:25:14.401875] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-09T19:25:14.470069] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-09T19:25:14.470157] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-09T19:25:14.470912] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-09T19:25:14.470979] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-09T19:25:14.472282] [DEBUG] [LOCAL ] HLLY: Trimmed 46208 records to 33723 (keeping 200 days of data) [2025-10-09T19:25:14.667305] [DEBUG] [LOCAL ] HLLY: Primary data saved (33723 records). [2025-10-09T19:25:14.667451] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-09T19:25:14.667534] [INFO ] [MAIN ] Update Progress: 1031/2373 symbols completed. HLLY took 32.2s. Estimated remaining: 3h 8m 59s. Rate: 7.1 symbols/min [2025-10-09T19:25:14.834775] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:14.878853] [DEBUG] [LOCAL ] HMC: Loaded 46543 existing records from primary storage. [2025-10-09T19:25:14.879169] [INFO ] [MAIN ] HMC: Loaded 46543 existing records. [2025-10-09T19:25:15.057810] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:25:15.058091] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-09T19:25:15.058143] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-09T19:25:15.058475] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-09T19:25:15.058533] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-09T19:25:15.199690] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-09T19:25:15.413405] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:15.444905] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-09T19:25:15.854029] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-09T19:25:15.996728] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-09T19:25:16.804384] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-09T19:25:16.806901] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-09T19:25:17.366305] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T19:25:17.596735] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-09T19:25:18.396765] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-09T19:25:18.906763] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-09T19:25:19.196760] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-09T19:25:19.371606] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-09T19:25:19.753422] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:25:19.996732] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-09T19:25:20.590533] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T19:25:20.796740] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-09T19:25:21.596755] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-09T19:25:21.736713] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T19:25:22.094987] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T19:25:22.396758] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-09T19:25:23.196702] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-09T19:25:23.272569] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T19:25:23.276874] [INFO ] [REMOTE ] HLT: Full fetch complete (73515 records). [2025-10-09T19:25:23.276977] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-09T19:25:23.672972] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-09T19:25:23.673052] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-09T19:25:23.674012] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-09T19:25:23.674074] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-09T19:25:23.675507] [DEBUG] [LOCAL ] HLT: Trimmed 73515 records to 50968 (keeping 200 days of data) [2025-10-09T19:25:23.996787] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-09T19:25:24.010678] [DEBUG] [LOCAL ] HLT: Primary data saved (50968 records). [2025-10-09T19:25:24.010834] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-09T19:25:24.011401] [INFO ] [MAIN ] Update Progress: 1032/2373 symbols completed. HLT took 37.8s. Estimated remaining: 3h 8m 52s. Rate: 7.1 symbols/min [2025-10-09T19:25:24.256626] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:24.255134] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T19:25:24.292549] [DEBUG] [LOCAL ] HMN: Loaded 23391 existing records from primary storage. [2025-10-09T19:25:24.292839] [INFO ] [MAIN ] HMN: Loaded 23391 existing records. [2025-10-09T19:25:24.477954] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:25:24.478293] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-09T19:25:24.478413] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-09T19:25:24.478834] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-09T19:25:24.479004] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-09T19:25:24.632519] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T19:25:24.801891] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-09T19:25:24.870516] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:25.596785] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-09T19:25:25.731552] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-09T19:25:26.396694] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-09T19:25:26.674862] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T19:25:26.712838] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-09T19:25:27.196757] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-09T19:25:27.996711] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-09T19:25:28.103145] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T19:25:28.107637] [INFO ] [REMOTE ] HLN: Full fetch complete (76828 records). [2025-10-09T19:25:28.107812] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-09T19:25:28.500720] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-09T19:25:28.500810] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-09T19:25:28.501774] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-09T19:25:28.501838] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-09T19:25:28.503209] [DEBUG] [LOCAL ] HLN: Trimmed 76828 records to 53487 (keeping 200 days of data) [2025-10-09T19:25:28.759896] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T19:25:28.769160] [INFO ] [REMOTE ] HLX: Full fetch complete (68987 records). [2025-10-09T19:25:28.769403] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-09T19:25:28.814426] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-09T19:25:28.911860] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T19:25:29.229311] [DEBUG] [LOCAL ] HLN: Primary data saved (53487 records). [2025-10-09T19:25:29.239495] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-09T19:25:29.249183] [INFO ] [MAIN ] Update Progress: 1033/2373 symbols completed. HLN took 45.3s. Estimated remaining: 3h 8m 39s. Rate: 7.1 symbols/min [2025-10-09T19:25:29.392808] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-09T19:25:29.408716] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-09T19:25:29.420493] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-09T19:25:29.433729] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-09T19:25:29.467621] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:29.470489] [DEBUG] [LOCAL ] HLX: Trimmed 68987 records to 47890 (keeping 200 days of data) [2025-10-09T19:25:29.605404] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-09T19:25:29.611203] [DEBUG] [LOCAL ] HMY: Loaded 53135 existing records from primary storage. [2025-10-09T19:25:29.612853] [INFO ] [MAIN ] HMY: Loaded 53135 existing records. [2025-10-09T19:25:29.884581] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:25:29.886699] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-09T19:25:29.887079] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-09T19:25:29.888576] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-09T19:25:29.888967] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-09T19:25:30.304116] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:30.339071] [DEBUG] [LOCAL ] HLX: Primary data saved (47890 records). [2025-10-09T19:25:30.339384] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-09T19:25:30.340581] [INFO ] [MAIN ] Update Progress: 1034/2373 symbols completed. HLX took 34.2s. Estimated remaining: 3h 8m 21s. Rate: 7.1 symbols/min [2025-10-09T19:25:30.405749] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-09T19:25:30.518949] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:30.519266] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-09T19:25:30.519375] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-09T19:25:30.519711] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-09T19:25:30.519772] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-09T19:25:30.519817] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-09T19:25:30.519851] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-09T19:25:30.629924] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T19:25:30.835728] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T19:25:30.940178] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:31.196759] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-09T19:25:31.445879] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:25:31.446264] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-09T19:25:31.446383] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:25:31.446446] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-09T19:25:31.446508] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:25:31.446586] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-09T19:25:31.446678] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-09T19:25:31.446736] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-09T19:25:31.446795] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-09T19:25:31.446867] [INFO ] [MAIN ] Update Progress: 1035/2373 symbols completed. HNGE took 1.1s. Estimated remaining: 3h 8m 3s. Rate: 7.1 symbols/min [2025-10-09T19:25:31.613266] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:31.650049] [DEBUG] [LOCAL ] HNI: Loaded 29303 existing records from primary storage. [2025-10-09T19:25:31.650355] [INFO ] [MAIN ] HNI: Loaded 29303 existing records. [2025-10-09T19:25:31.840987] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:25:31.841318] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-09T19:25:31.841387] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-09T19:25:31.841858] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-09T19:25:31.841921] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-09T19:25:32.007692] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-09T19:25:32.216036] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:32.253155] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-09T19:25:32.796770] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-09T19:25:33.493042] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:25:33.596793] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-09T19:25:34.396773] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-09T19:25:34.764210] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-09T19:25:35.026542] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:25:35.196702] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-09T19:25:35.282911] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T19:25:35.996740] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-09T19:25:36.188911] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-09T19:25:36.796725] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-09T19:25:37.596739] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-09T19:25:37.725681] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T19:25:38.062690] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T19:25:38.396733] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-09T19:25:38.896552] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T19:25:39.196761] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-09T19:25:39.739761] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T19:25:39.996733] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-09T19:25:40.796739] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-09T19:25:41.121498] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T19:25:41.160887] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-09T19:25:41.596683] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-09T19:25:41.707945] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-09T19:25:42.396737] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-09T19:25:42.588370] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-09T19:25:43.196742] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-09T19:25:43.996677] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-09T19:25:44.469113] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T19:25:44.635335] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-09T19:25:44.796732] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-09T19:25:45.283570] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T19:25:45.596746] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-09T19:25:46.396851] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-09T19:25:46.640797] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-09T19:25:46.934483] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-09T19:25:47.196676] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-09T19:25:47.234243] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-09T19:25:47.996711] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-09T19:25:48.792338] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:25:48.796346] [INFO ] [REMOTE ] HMC: Full fetch complete (69121 records). [2025-10-09T19:25:48.796495] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-09T19:25:48.796701] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-09T19:25:49.187990] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-09T19:25:49.188134] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-09T19:25:49.189150] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-09T19:25:49.189216] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-09T19:25:49.190599] [DEBUG] [LOCAL ] HMC: Trimmed 69121 records to 46880 (keeping 200 days of data) [2025-10-09T19:25:49.477012] [DEBUG] [LOCAL ] HMC: Primary data saved (46880 records). [2025-10-09T19:25:49.477299] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-09T19:25:49.477466] [INFO ] [MAIN ] Update Progress: 1036/2373 symbols completed. HMC took 34.8s. Estimated remaining: 3h 8m 7s. Rate: 7.1 symbols/min [2025-10-09T19:25:49.599983] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-09T19:25:49.668362] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:25:49.683824] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T19:25:49.735118] [DEBUG] [LOCAL ] HOG: Loaded 51002 existing records from primary storage. [2025-10-09T19:25:49.735456] [INFO ] [MAIN ] HOG: Loaded 51002 existing records. [2025-10-09T19:25:49.942402] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:25:49.942789] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-09T19:25:49.942880] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-09T19:25:49.943622] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-09T19:25:49.943851] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-09T19:25:50.134114] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-09T19:25:50.369584] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:25:50.396681] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-09T19:25:50.766399] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T19:25:51.196728] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-09T19:25:51.996682] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-09T19:25:52.090959] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T19:25:52.323391] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T19:25:52.796741] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-09T19:25:53.596754] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-09T19:25:53.967750] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T19:25:54.008504] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T19:25:54.396780] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-09T19:25:55.105199] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-09T19:25:55.196691] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-09T19:25:55.349881] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T19:25:55.351916] [INFO ] [REMOTE ] HMN: Full fetch complete (31453 records). [2025-10-09T19:25:55.351987] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-09T19:25:55.780757] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-09T19:25:55.780850] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-09T19:25:55.781531] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-09T19:25:55.781594] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-09T19:25:55.782371] [DEBUG] [LOCAL ] HMN: Trimmed 31453 records to 23567 (keeping 200 days of data) [2025-10-09T19:25:55.942920] [DEBUG] [LOCAL ] HMN: Primary data saved (23567 records). [2025-10-09T19:25:55.943090] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-09T19:25:55.943215] [INFO ] [MAIN ] Update Progress: 1037/2373 symbols completed. HMN took 31.9s. Estimated remaining: 3h 7m 56s. Rate: 7.1 symbols/min [2025-10-09T19:25:55.996709] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-09T19:25:56.796710] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-09T19:25:56.863129] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-09T19:25:57.068707] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-09T19:25:57.596745] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-09T19:25:58.280294] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T19:25:58.396699] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-09T19:25:59.196729] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-09T19:25:59.712862] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-09T19:25:59.996746] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-09T19:26:00.131107] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-09T19:26:00.288877] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-09T19:26:00.796752] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-09T19:26:01.596765] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-09T19:26:02.076934] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-09T19:26:02.081602] [INFO ] [REMOTE ] HMY: Full fetch complete (76772 records). [2025-10-09T19:26:02.081750] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-09T19:26:02.499800] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-09T19:26:02.500029] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-09T19:26:02.501971] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-09T19:26:02.502126] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-09T19:26:02.504435] [DEBUG] [LOCAL ] HMY: Trimmed 76772 records to 53525 (keeping 200 days of data) [2025-10-09T19:26:02.777580] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T19:26:02.795325] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-09T19:26:02.843262] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T19:26:02.948774] [DEBUG] [LOCAL ] HMY: Primary data saved (53525 records). [2025-10-09T19:26:02.948944] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-09T19:26:02.949033] [INFO ] [MAIN ] Update Progress: 1038/2373 symbols completed. HMY took 33.7s. Estimated remaining: 3h 7m 46s. Rate: 7.1 symbols/min [2025-10-09T19:26:03.196782] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-09T19:26:04.394754] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T19:26:04.407097] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-09T19:26:04.440859] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T19:26:04.796760] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-09T19:26:05.983298] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T19:26:05.994800] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-09T19:26:06.225439] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T19:26:06.229909] [INFO ] [REMOTE ] HNI: Full fetch complete (41904 records). [2025-10-09T19:26:06.230130] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-09T19:26:06.627565] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-09T19:26:06.627752] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-09T19:26:06.628592] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-09T19:26:06.628639] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-09T19:26:06.629745] [DEBUG] [LOCAL ] HNI: Trimmed 41904 records to 29530 (keeping 200 days of data) [2025-10-09T19:26:06.822301] [DEBUG] [LOCAL ] HNI: Primary data saved (29530 records). [2025-10-09T19:26:06.822449] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-09T19:26:06.823957] [INFO ] [MAIN ] Update Progress: 1039/2373 symbols completed. HNI took 35.4s. Estimated remaining: 3h 7m 31s. Rate: 7.1 symbols/min [2025-10-09T19:26:07.857945] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T19:26:07.869828] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-09T19:26:09.548306] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T19:26:09.559419] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-09T19:26:11.561418] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-09T19:26:11.574581] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-09T19:26:13.297245] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:26:13.301630] [INFO ] [REMOTE ] HOG: Full fetch complete (74122 records). [2025-10-09T19:26:13.301814] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-09T19:26:13.686448] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-09T19:26:13.686556] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-09T19:26:13.687533] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-09T19:26:13.687598] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-09T19:26:13.689119] [DEBUG] [LOCAL ] HOG: Trimmed 74122 records to 51361 (keeping 200 days of data) [2025-10-09T19:26:14.005038] [DEBUG] [LOCAL ] HOG: Primary data saved (51361 records). [2025-10-09T19:26:14.005184] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-09T19:26:14.005282] [INFO ] [MAIN ] Update Progress: 1040/2373 symbols completed. HOG took 24.5s. Estimated remaining: 3h 7m 21s. Rate: 7.1 symbols/min [2025-10-09T19:26:14.756389] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:14.730844] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:14.699364] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:14.763376] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:14.812837] [DEBUG] [LOCAL ] HOV: Loaded 13912 existing records from primary storage. [2025-10-09T19:26:14.827614] [INFO ] [MAIN ] HOV: Loaded 13912 existing records. [2025-10-09T19:26:14.965855] [DEBUG] [LOCAL ] HOMB: Loaded 43436 existing records from primary storage. [2025-10-09T19:26:14.979276] [DEBUG] [LOCAL ] HOUS: Loaded 44857 existing records from primary storage. [2025-10-09T19:26:14.986496] [INFO ] [MAIN ] HOMB: Loaded 43436 existing records. [2025-10-09T19:26:15.008427] [INFO ] [MAIN ] HOUS: Loaded 44857 existing records. [2025-10-09T19:26:15.008298] [DEBUG] [LOCAL ] HP: Loaded 51643 existing records from primary storage. [2025-10-09T19:26:15.123269] [INFO ] [MAIN ] HP: Loaded 51643 existing records. [2025-10-09T19:26:15.137457] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:15.187089] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-09T19:26:15.224575] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-09T19:26:15.349413] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-09T19:26:15.358236] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-09T19:26:15.705912] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:15.738739] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-09T19:26:15.745149] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-09T19:26:15.748307] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:15.783324] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-09T19:26:15.789586] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-09T19:26:15.814974] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-09T19:26:15.822581] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-09T19:26:15.834059] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:15.851090] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-09T19:26:15.875599] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-09T19:26:15.875704] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-09T19:26:15.940233] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-09T19:26:15.975707] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-09T19:26:15.986088] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-09T19:26:16.795480] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:16.902684] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-09T19:26:17.066024] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:17.078410] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-09T19:26:17.216287] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:17.236380] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-09T19:26:17.254127] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:17.254755] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-09T19:26:18.153058] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T19:26:18.156866] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-09T19:26:18.568368] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:26:18.578476] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-09T19:26:18.640837] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T19:26:18.649731] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-09T19:26:18.882832] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-09T19:26:18.892060] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-09T19:26:18.954704] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T19:26:18.957765] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-09T19:26:19.759031] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T19:26:19.762102] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-09T19:26:19.955967] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T19:26:19.964866] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-09T19:26:20.121008] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-09T19:26:20.130464] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-09T19:26:20.205761] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T19:26:20.218082] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-09T19:26:20.235797] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-09T19:26:20.239114] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-09T19:26:20.961798] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T19:26:20.970890] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-09T19:26:21.136001] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T19:26:21.138797] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T19:26:21.141286] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-09T19:26:21.559460] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-09T19:26:21.596671] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-09T19:26:21.918938] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T19:26:22.110301] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T19:26:22.396718] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-09T19:26:23.148339] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T19:26:23.196694] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-09T19:26:23.340557] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:26:23.996728] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-09T19:26:24.726292] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T19:26:24.796695] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-09T19:26:25.596700] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-09T19:26:25.855817] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-09T19:26:26.096924] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T19:26:26.396709] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-09T19:26:26.579893] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T19:26:27.196713] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-09T19:26:27.939027] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:26:27.996675] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-09T19:26:28.626338] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:26:28.796704] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-09T19:26:29.296451] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T19:26:29.596714] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-09T19:26:30.320751] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T19:26:30.396685] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-09T19:26:31.196759] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-09T19:26:31.395847] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T19:26:31.861456] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:26:31.879052] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-09T19:26:31.996740] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-09T19:26:32.796776] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-09T19:26:33.523592] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:26:33.596674] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-09T19:26:34.332705] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T19:26:34.396747] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-09T19:26:35.170005] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T19:26:35.196706] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-09T19:26:35.323925] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T19:26:35.996698] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-09T19:26:36.659327] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T19:26:36.796772] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-09T19:26:37.596773] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-09T19:26:37.666453] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T19:26:38.354021] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-09T19:26:38.396682] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-09T19:26:39.209172] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-09T19:26:39.215684] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:26:39.851058] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:26:39.855617] [INFO ] [REMOTE ] HOMB: Full fetch complete (63935 records). [2025-10-09T19:26:39.855819] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-09T19:26:40.001972] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-09T19:26:40.252080] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-09T19:26:40.252159] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-09T19:26:40.253028] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-09T19:26:40.253093] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-09T19:26:40.254397] [DEBUG] [LOCAL ] HOMB: Trimmed 63935 records to 43753 (keeping 200 days of data) [2025-10-09T19:26:40.522389] [DEBUG] [LOCAL ] HOMB: Primary data saved (43753 records). [2025-10-09T19:26:40.522528] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-09T19:26:40.523242] [INFO ] [MAIN ] Update Progress: 1041/2373 symbols completed. HOMB took 26.5s. Estimated remaining: 3h 7m 36s. Rate: 7.1 symbols/min [2025-10-09T19:26:40.692016] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:40.744542] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-09T19:26:40.744922] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-09T19:26:40.806448] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-09T19:26:40.925851] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:40.926073] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-09T19:26:40.926159] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-09T19:26:40.926864] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-09T19:26:40.927070] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-09T19:26:41.255228] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-09T19:26:41.341915] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:41.596700] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-09T19:26:41.661744] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T19:26:41.666460] [INFO ] [REMOTE ] HOUS: Full fetch complete (63929 records). [2025-10-09T19:26:41.666590] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-09T19:26:41.779590] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T19:26:41.826830] [INFO ] [REMOTE ] HOV: Full fetch complete (19052 records). [2025-10-09T19:26:41.854845] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-09T19:26:42.257511] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-09T19:26:42.258295] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-09T19:26:42.285158] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-09T19:26:42.285257] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-09T19:26:42.400040] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-09T19:26:42.394548] [DEBUG] [LOCAL ] HOUS: Trimmed 63929 records to 45220 (keeping 200 days of data) [2025-10-09T19:26:42.527278] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-09T19:26:42.535973] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-09T19:26:42.536239] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-09T19:26:42.536679] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-09T19:26:42.574829] [DEBUG] [LOCAL ] HOV: Trimmed 19052 records to 14000 (keeping 200 days of data) [2025-10-09T19:26:42.774886] [DEBUG] [LOCAL ] HOV: Primary data saved (14000 records). [2025-10-09T19:26:42.775923] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-09T19:26:42.776894] [INFO ] [MAIN ] Update Progress: 1042/2373 symbols completed. HOV took 28.8s. Estimated remaining: 3h 7m 20s. Rate: 7.1 symbols/min [2025-10-09T19:26:42.973965] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:43.015664] [DEBUG] [LOCAL ] HOUS: Primary data saved (45220 records). [2025-10-09T19:26:43.015909] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-09T19:26:43.016840] [INFO ] [MAIN ] Update Progress: 1043/2373 symbols completed. HOUS took 29.0s. Estimated remaining: 3h 7m 1s. Rate: 7.1 symbols/min [2025-10-09T19:26:43.102240] [DEBUG] [LOCAL ] HPF: Loaded 7485 existing records from primary storage. [2025-10-09T19:26:43.129747] [INFO ] [MAIN ] HPF: Loaded 7485 existing records. [2025-10-09T19:26:43.270394] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:43.376150] [DEBUG] [LOCAL ] HPI: Loaded 10608 existing records from primary storage. [2025-10-09T19:26:43.398290] [INFO ] [MAIN ] HPI: Loaded 10608 existing records. [2025-10-09T19:26:43.398011] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:43.419514] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-09T19:26:43.435247] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-09T19:26:43.477265] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-09T19:26:43.487722] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-09T19:26:43.687522] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:43.691366] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-09T19:26:43.696985] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-09T19:26:43.750121] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-09T19:26:43.806068] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-09T19:26:43.982955] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-09T19:26:44.056693] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-09T19:26:44.174827] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:44.177460] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-09T19:26:44.388091] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:44.418960] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-09T19:26:44.796756] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-09T19:26:45.064196] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T19:26:45.596789] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-09T19:26:46.234120] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-09T19:26:46.261965] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T19:26:46.396784] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-09T19:26:46.594972] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T19:26:47.196741] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-09T19:26:47.996719] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-09T19:26:48.255576] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T19:26:48.282926] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T19:26:48.796785] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-09T19:26:49.596704] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-09T19:26:49.613412] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:26:49.617859] [INFO ] [REMOTE ] HP: Full fetch complete (73923 records). [2025-10-09T19:26:49.617977] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-09T19:26:50.014254] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-09T19:26:50.014399] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-09T19:26:50.015462] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-09T19:26:50.015533] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-09T19:26:50.017039] [DEBUG] [LOCAL ] HP: Trimmed 73923 records to 51959 (keeping 200 days of data) [2025-10-09T19:26:50.318507] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T19:26:50.357296] [DEBUG] [LOCAL ] HP: Primary data saved (51959 records). [2025-10-09T19:26:50.357404] [INFO ] [MAIN ] HP: Full history saved. [2025-10-09T19:26:50.357482] [INFO ] [MAIN ] Update Progress: 1044/2373 symbols completed. HP took 36.3s. Estimated remaining: 3h 6m 51s. Rate: 7.1 symbols/min [2025-10-09T19:26:50.400951] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-09T19:26:50.530910] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:26:50.580902] [DEBUG] [LOCAL ] HPP: Loaded 51041 existing records from primary storage. [2025-10-09T19:26:50.581230] [INFO ] [MAIN ] HPP: Loaded 51041 existing records. [2025-10-09T19:26:50.764955] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:26:50.765210] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-09T19:26:50.765343] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-09T19:26:50.765902] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-09T19:26:50.765962] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-09T19:26:50.885001] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-09T19:26:51.032189] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-09T19:26:51.190455] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:26:51.196671] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-09T19:26:51.996726] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-09T19:26:52.507517] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:26:52.796770] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-09T19:26:53.596749] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-09T19:26:54.124210] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-09T19:26:54.202795] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-09T19:26:54.396710] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-09T19:26:54.460873] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T19:26:55.196728] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-09T19:26:55.806701] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T19:26:55.996697] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-09T19:26:56.432065] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-09T19:26:56.796765] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-09T19:26:57.019943] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T19:26:57.596729] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-09T19:26:58.218524] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T19:26:58.396694] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-09T19:26:58.735687] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-09T19:26:59.175126] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T19:26:59.196665] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-09T19:26:59.996733] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-09T19:27:00.083711] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T19:27:00.796728] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-09T19:27:01.380440] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-09T19:27:01.596694] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-09T19:27:01.627889] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T19:27:02.334705] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-09T19:27:02.396725] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-09T19:27:03.168633] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T19:27:03.196667] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-09T19:27:03.941228] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-09T19:27:03.996758] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-09T19:27:04.796733] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-09T19:27:05.333844] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T19:27:05.581027] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T19:27:05.596664] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-09T19:27:06.396719] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-09T19:27:07.196719] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-09T19:27:07.444933] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:27:07.955262] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-09T19:27:07.996696] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-09T19:27:08.267607] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T19:27:08.473691] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T19:27:08.796787] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-09T19:27:09.596725] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-09T19:27:10.396862] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-09T19:27:10.551301] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T19:27:10.948877] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T19:27:10.950110] [INFO ] [REMOTE ] HPF: Full fetch complete (10714 records). [2025-10-09T19:27:10.950184] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-09T19:27:11.199422] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-09T19:27:11.324267] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-09T19:27:11.324427] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-09T19:27:11.324830] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-09T19:27:11.324907] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-09T19:27:11.325560] [DEBUG] [LOCAL ] HPF: Trimmed 10714 records to 7514 (keeping 200 days of data) [2025-10-09T19:27:11.399987] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T19:27:11.416545] [DEBUG] [LOCAL ] HPF: Primary data saved (7514 records). [2025-10-09T19:27:11.416810] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-09T19:27:11.417352] [INFO ] [MAIN ] Update Progress: 1045/2373 symbols completed. HPF took 28.6s. Estimated remaining: 3h 6m 59s. Rate: 7.1 symbols/min [2025-10-09T19:27:11.591898] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:11.650554] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-10-09T19:27:11.650960] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-10-09T19:27:11.825802] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:11.826002] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-09T19:27:11.826049] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-09T19:27:11.826533] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-09T19:27:11.826589] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-09T19:27:11.998844] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-09T19:27:12.176877] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:12.759833] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:27:12.796674] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-09T19:27:12.878409] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-09T19:27:13.596786] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-09T19:27:14.370095] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:27:14.391116] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T19:27:14.396669] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-09T19:27:15.196704] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-09T19:27:15.996810] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-09T19:27:16.188575] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T19:27:16.254608] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T19:27:16.796714] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-09T19:27:17.596713] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-09T19:27:17.679778] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T19:27:17.681330] [INFO ] [REMOTE ] HPI: Full fetch complete (13959 records). [2025-10-09T19:27:17.681402] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-09T19:27:18.046213] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-09T19:27:18.046350] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-09T19:27:18.046995] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-09T19:27:18.047248] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-09T19:27:18.048578] [DEBUG] [LOCAL ] HPI: Trimmed 13959 records to 10659 (keeping 200 days of data) [2025-10-09T19:27:18.147500] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-09T19:27:18.152591] [DEBUG] [LOCAL ] HPI: Primary data saved (10659 records). [2025-10-09T19:27:18.164895] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-09T19:27:18.165845] [INFO ] [MAIN ] Update Progress: 1046/2373 symbols completed. HPI took 35.1s. Estimated remaining: 3h 6m 48s. Rate: 7.1 symbols/min [2025-10-09T19:27:18.337408] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:18.351151] [DEBUG] [LOCAL ] HPS: Loaded 10270 existing records from primary storage. [2025-10-09T19:27:18.351392] [INFO ] [MAIN ] HPS: Loaded 10270 existing records. [2025-10-09T19:27:18.404243] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-09T19:27:18.534405] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:18.534721] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-09T19:27:18.534781] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-09T19:27:18.534972] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-09T19:27:18.535041] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-09T19:27:18.892685] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:19.196749] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-09T19:27:19.334929] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T19:27:19.339348] [INFO ] [REMOTE ] HPP: Full fetch complete (73290 records). [2025-10-09T19:27:19.339462] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-09T19:27:19.736975] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-09T19:27:19.737097] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-09T19:27:19.738156] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-09T19:27:19.738226] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-09T19:27:19.739773] [DEBUG] [LOCAL ] HPP: Trimmed 73290 records to 51424 (keeping 200 days of data) [2025-10-09T19:27:20.010444] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-09T19:27:20.027593] [DEBUG] [LOCAL ] HPP: Primary data saved (51424 records). [2025-10-09T19:27:20.027735] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-09T19:27:20.027826] [INFO ] [MAIN ] Update Progress: 1047/2373 symbols completed. HPP took 29.7s. Estimated remaining: 3h 6m 31s. Rate: 7.1 symbols/min [2025-10-09T19:27:20.153189] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T19:27:20.216112] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:20.245947] [DEBUG] [LOCAL ] HQH: Loaded 25511 existing records from primary storage. [2025-10-09T19:27:20.246265] [INFO ] [MAIN ] HQH: Loaded 25511 existing records. [2025-10-09T19:27:20.442118] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:20.442428] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-09T19:27:20.442561] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-09T19:27:20.443051] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-09T19:27:20.443108] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-09T19:27:20.696556] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-09T19:27:20.806536] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-09T19:27:20.845632] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:21.596738] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-09T19:27:21.897975] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-09T19:27:21.902805] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-09T19:27:21.902934] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-09T19:27:22.281674] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T19:27:22.307717] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-09T19:27:22.308685] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-09T19:27:22.309876] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-09T19:27:22.309965] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-09T19:27:22.311685] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 54087 (keeping 200 days of data) [2025-10-09T19:27:22.405121] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-09T19:27:22.464352] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T19:27:22.709485] [DEBUG] [LOCAL ] HPE: Primary data saved (54087 records). [2025-10-09T19:27:22.709680] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-09T19:27:22.710256] [INFO ] [MAIN ] Update Progress: 1048/2373 symbols completed. HPE took 42.2s. Estimated remaining: 3h 6m 15s. Rate: 7.1 symbols/min [2025-10-09T19:27:22.885760] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:22.911778] [DEBUG] [LOCAL ] HQL: Loaded 16673 existing records from primary storage. [2025-10-09T19:27:22.912058] [INFO ] [MAIN ] HQL: Loaded 16673 existing records. [2025-10-09T19:27:23.088836] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:23.089075] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-09T19:27:23.089122] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-09T19:27:23.089407] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-09T19:27:23.089465] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-09T19:27:23.201962] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-09T19:27:23.344008] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-09T19:27:23.462772] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:23.996788] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-09T19:27:24.796730] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-09T19:27:24.975826] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T19:27:25.023972] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-09T19:27:25.596749] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-09T19:27:25.707773] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-09T19:27:26.396775] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-09T19:27:27.201209] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-09T19:27:27.207330] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T19:27:27.480121] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T19:27:27.688486] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-09T19:27:27.996764] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-09T19:27:28.673317] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-09T19:27:28.796733] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-09T19:27:29.596730] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-09T19:27:29.752134] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-09T19:27:30.396710] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-09T19:27:31.196700] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-09T19:27:31.353148] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T19:27:31.376214] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T19:27:31.996700] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-09T19:27:32.019142] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T19:27:32.742855] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T19:27:32.796689] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-09T19:27:33.582855] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-09T19:27:33.596677] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-09T19:27:34.142799] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T19:27:34.396720] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-09T19:27:35.196707] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-09T19:27:35.215279] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-09T19:27:35.996790] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-09T19:27:36.162962] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T19:27:36.796769] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-09T19:27:37.596712] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-09T19:27:37.658439] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T19:27:37.788266] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-09T19:27:38.396734] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-09T19:27:38.469746] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T19:27:39.196714] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-09T19:27:39.237197] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T19:27:39.996713] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-09T19:27:40.180721] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-09T19:27:40.796777] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-09T19:27:41.596694] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-09T19:27:41.747301] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T19:27:41.823496] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:27:42.396696] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-09T19:27:42.621292] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-09T19:27:43.180954] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:27:43.196677] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-09T19:27:43.996777] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-09T19:27:44.755084] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T19:27:44.756547] [INFO ] [REMOTE ] HPS: Full fetch complete (15192 records). [2025-10-09T19:27:44.756618] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-09T19:27:44.801864] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-09T19:27:45.141193] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-09T19:27:45.141325] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-09T19:27:45.141736] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-09T19:27:45.141815] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-09T19:27:45.142749] [DEBUG] [LOCAL ] HPS: Trimmed 15192 records to 10353 (keeping 200 days of data) [2025-10-09T19:27:45.231260] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-09T19:27:45.261898] [DEBUG] [LOCAL ] HPS: Primary data saved (10353 records). [2025-10-09T19:27:45.262029] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-09T19:27:45.262154] [INFO ] [MAIN ] Update Progress: 1049/2373 symbols completed. HPS took 27.1s. Estimated remaining: 3h 6m 25s. Rate: 7.1 symbols/min [2025-10-09T19:27:45.435038] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:45.496036] [DEBUG] [LOCAL ] HR: Loaded 51997 existing records from primary storage. [2025-10-09T19:27:45.496390] [INFO ] [MAIN ] HR: Loaded 51997 existing records. [2025-10-09T19:27:45.599443] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-09T19:27:45.687068] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:45.687341] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-09T19:27:45.687581] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-09T19:27:45.694936] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-09T19:27:45.705951] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-09T19:27:45.712768] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-09T19:27:46.077136] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:46.396752] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-09T19:27:46.643559] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-09T19:27:47.196780] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-09T19:27:47.242944] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T19:27:47.996724] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-09T19:27:48.796784] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-09T19:27:49.013616] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T19:27:49.286439] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T19:27:49.596734] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-09T19:27:49.776738] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T19:27:50.396782] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-09T19:27:51.076687] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T19:27:51.196743] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-09T19:27:51.245534] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T19:27:51.996698] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-09T19:27:52.237562] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-09T19:27:52.240035] [INFO ] [REMOTE ] HQL: Full fetch complete (25098 records). [2025-10-09T19:27:52.240109] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-09T19:27:52.615088] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-09T19:27:52.615183] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-09T19:27:52.615780] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-09T19:27:52.615845] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-09T19:27:52.616785] [DEBUG] [LOCAL ] HQL: Trimmed 25098 records to 16859 (keeping 200 days of data) [2025-10-09T19:27:52.721392] [DEBUG] [LOCAL ] HQL: Primary data saved (16859 records). [2025-10-09T19:27:52.721547] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-09T19:27:52.721633] [INFO ] [MAIN ] Update Progress: 1050/2373 symbols completed. HQL took 30.0s. Estimated remaining: 3h 6m 15s. Rate: 7.1 symbols/min [2025-10-09T19:27:52.801903] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-09T19:27:52.893823] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:27:52.948540] [DEBUG] [LOCAL ] HRB: Loaded 48391 existing records from primary storage. [2025-10-09T19:27:52.949010] [INFO ] [MAIN ] HRB: Loaded 48391 existing records. [2025-10-09T19:27:53.133820] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:27:53.134034] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-09T19:27:53.134081] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-09T19:27:53.134697] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-09T19:27:53.134775] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-09T19:27:53.519929] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:27:53.524414] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T19:27:53.596749] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-09T19:27:54.064041] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:27:54.396697] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-09T19:27:54.989595] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:27:55.196831] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-09T19:27:55.996721] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-09T19:27:56.093105] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T19:27:56.796702] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-09T19:27:57.062226] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-09T19:27:57.349555] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T19:27:57.596723] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-09T19:27:58.149189] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-09T19:27:58.292867] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T19:27:58.396710] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-09T19:27:59.196761] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-09T19:27:59.443700] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T19:27:59.446360] [INFO ] [REMOTE ] HQH: Full fetch complete (37291 records). [2025-10-09T19:27:59.446431] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-09T19:27:59.822678] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-09T19:27:59.822766] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-09T19:27:59.823467] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-09T19:27:59.823515] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-09T19:27:59.824347] [DEBUG] [LOCAL ] HQH: Trimmed 37291 records to 25751 (keeping 200 days of data) [2025-10-09T19:27:59.983920] [DEBUG] [LOCAL ] HQH: Primary data saved (25751 records). [2025-10-09T19:27:59.984054] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-09T19:27:59.984158] [INFO ] [MAIN ] Update Progress: 1051/2373 symbols completed. HQH took 40.0s. Estimated remaining: 3h 6m 5s. Rate: 7.1 symbols/min [2025-10-09T19:28:00.005720] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-09T19:28:00.164631] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:00.200069] [DEBUG] [LOCAL ] HRI: Loaded 32605 existing records from primary storage. [2025-10-09T19:28:00.200345] [INFO ] [MAIN ] HRI: Loaded 32605 existing records. [2025-10-09T19:28:00.381803] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:00.382065] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-09T19:28:00.382114] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-09T19:28:00.382466] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-09T19:28:00.382525] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-09T19:28:00.740571] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:00.796670] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-09T19:28:01.111489] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T19:28:01.596724] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-09T19:28:01.775205] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-09T19:28:01.810099] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T19:28:02.396709] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-09T19:28:02.848170] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:28:03.196727] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-09T19:28:03.661469] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T19:28:03.996771] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-09T19:28:04.715550] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T19:28:04.720366] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-09T19:28:04.720478] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-09T19:28:04.801954] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-09T19:28:05.108459] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-09T19:28:05.108538] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-09T19:28:05.109452] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-09T19:28:05.109516] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-09T19:28:05.110999] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 54058 (keeping 200 days of data) [2025-10-09T19:28:05.447978] [DEBUG] [LOCAL ] HPQ: Primary data saved (54058 records). [2025-10-09T19:28:05.448133] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-09T19:28:05.449518] [INFO ] [MAIN ] Update Progress: 1052/2373 symbols completed. HPQ took 54.0s. Estimated remaining: 3h 5m 53s. Rate: 7.1 symbols/min [2025-10-09T19:28:05.597585] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-09T19:28:05.624792] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:05.721228] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-09T19:28:05.734967] [DEBUG] [LOCAL ] HRL: Loaded 53097 existing records from primary storage. [2025-10-09T19:28:05.735409] [INFO ] [MAIN ] HRL: Loaded 53097 existing records. [2025-10-09T19:28:05.910480] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:05.910709] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-09T19:28:05.910768] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-09T19:28:05.911247] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-09T19:28:05.911305] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-09T19:28:06.264986] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:06.295196] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T19:28:06.396672] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-09T19:28:06.912466] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T19:28:07.196734] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-09T19:28:07.996708] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-09T19:28:08.097500] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-09T19:28:08.678323] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-09T19:28:08.796710] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-09T19:28:09.596734] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-09T19:28:09.682904] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-09T19:28:10.396704] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-09T19:28:10.552630] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T19:28:11.196754] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-09T19:28:11.300675] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-09T19:28:11.999294] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-09T19:28:12.005532] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-09T19:28:12.796719] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-09T19:28:12.829189] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:28:12.834062] [INFO ] [REMOTE ] HR: Full fetch complete (74818 records). [2025-10-09T19:28:12.834262] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-09T19:28:13.266109] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-09T19:28:13.266253] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-09T19:28:13.267469] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-09T19:28:13.267981] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-09T19:28:13.269885] [DEBUG] [LOCAL ] HR: Trimmed 74818 records to 52363 (keeping 200 days of data) [2025-10-09T19:28:13.544754] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:28:13.610407] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-09T19:28:13.635065] [DEBUG] [LOCAL ] HR: Primary data saved (52363 records). [2025-10-09T19:28:13.635235] [INFO ] [MAIN ] HR: Full history saved. [2025-10-09T19:28:13.635383] [INFO ] [MAIN ] Update Progress: 1053/2373 symbols completed. HR took 28.4s. Estimated remaining: 3h 5m 44s. Rate: 7.1 symbols/min [2025-10-09T19:28:13.801466] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:13.835609] [DEBUG] [LOCAL ] HRTG: Loaded 33817 existing records from primary storage. [2025-10-09T19:28:13.835926] [INFO ] [MAIN ] HRTG: Loaded 33817 existing records. [2025-10-09T19:28:14.010606] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:14.010853] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-09T19:28:14.010901] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-09T19:28:14.011279] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-09T19:28:14.011337] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-09T19:28:14.372867] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:14.396672] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-09T19:28:14.472071] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-09T19:28:15.043278] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:28:15.138783] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-09T19:28:15.196670] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-09T19:28:15.996751] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-09T19:28:16.229822] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T19:28:16.796753] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-09T19:28:17.596718] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-09T19:28:17.834851] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T19:28:17.941966] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T19:28:18.396744] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-09T19:28:19.160058] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T19:28:19.196695] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-09T19:28:19.996695] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-09T19:28:20.246281] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T19:28:20.346346] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-09T19:28:20.796705] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-09T19:28:21.333147] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T19:28:21.596704] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-09T19:28:22.291622] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-09T19:28:22.396675] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-09T19:28:22.957883] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T19:28:23.196769] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-09T19:28:23.761424] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T19:28:23.996731] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-09T19:28:24.796691] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-09T19:28:24.906412] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T19:28:25.596696] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-09T19:28:25.639985] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T19:28:25.874838] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-09T19:28:26.396771] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-09T19:28:26.665840] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T19:28:27.196727] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-09T19:28:27.691623] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:28:27.996754] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-09T19:28:28.486499] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T19:28:28.796756] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-09T19:28:29.503017] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T19:28:29.596775] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-09T19:28:30.167767] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-09T19:28:30.396760] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-09T19:28:31.048448] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T19:28:31.196728] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-09T19:28:31.622736] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-09T19:28:31.625476] [INFO ] [REMOTE ] HRI: Full fetch complete (46206 records). [2025-10-09T19:28:31.625554] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-09T19:28:32.010324] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-09T19:28:32.028082] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-09T19:28:32.028149] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-09T19:28:32.028903] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-09T19:28:32.029056] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-09T19:28:32.030120] [DEBUG] [LOCAL ] HRI: Trimmed 46206 records to 32776 (keeping 200 days of data) [2025-10-09T19:28:32.236847] [DEBUG] [LOCAL ] HRI: Primary data saved (32776 records). [2025-10-09T19:28:32.236991] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-09T19:28:32.237076] [INFO ] [MAIN ] Update Progress: 1054/2373 symbols completed. HRI took 32.3s. Estimated remaining: 3h 5m 49s. Rate: 7.1 symbols/min [2025-10-09T19:28:32.405552] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:32.463271] [DEBUG] [LOCAL ] HSBC: Loaded 50946 existing records from primary storage. [2025-10-09T19:28:32.463663] [INFO ] [MAIN ] HSBC: Loaded 50946 existing records. [2025-10-09T19:28:32.647066] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:32.647453] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-09T19:28:32.664184] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-09T19:28:32.668453] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:28:32.675544] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-09T19:28:32.676291] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-09T19:28:32.801923] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-09T19:28:33.042580] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:33.601769] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-09T19:28:33.604787] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T19:28:33.609482] [INFO ] [REMOTE ] HRB: Full fetch complete (69914 records). [2025-10-09T19:28:33.609572] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-09T19:28:34.009684] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-09T19:28:34.009805] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-09T19:28:34.010857] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-09T19:28:34.010921] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-09T19:28:34.012329] [DEBUG] [LOCAL ] HRB: Trimmed 69914 records to 48723 (keeping 200 days of data) [2025-10-09T19:28:34.266027] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:28:34.344946] [DEBUG] [LOCAL ] HRB: Primary data saved (48723 records). [2025-10-09T19:28:34.345085] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-09T19:28:34.345727] [INFO ] [MAIN ] Update Progress: 1055/2373 symbols completed. HRB took 41.6s. Estimated remaining: 3h 5m 32s. Rate: 7.1 symbols/min [2025-10-09T19:28:34.408494] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-09T19:28:34.516451] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:34.533537] [DEBUG] [LOCAL ] HSHP: Loaded 15044 existing records from primary storage. [2025-10-09T19:28:34.533807] [INFO ] [MAIN ] HSHP: Loaded 15044 existing records. [2025-10-09T19:28:34.712730] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:34.712944] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-09T19:28:34.712994] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-09T19:28:34.713238] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-09T19:28:34.713295] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-09T19:28:35.069885] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:35.202932] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-09T19:28:35.208930] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T19:28:35.840844] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T19:28:35.996716] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-09T19:28:36.717985] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:28:36.796751] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-09T19:28:37.596696] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-09T19:28:37.820822] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T19:28:38.401873] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-09T19:28:38.423485] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T19:28:38.735513] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T19:28:39.196794] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-09T19:28:39.996738] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-09T19:28:40.222166] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:28:40.240157] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T19:28:40.245262] [INFO ] [REMOTE ] HRL: Full fetch complete (76683 records). [2025-10-09T19:28:40.245395] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-09T19:28:40.643814] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-09T19:28:40.643925] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-09T19:28:40.645847] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-09T19:28:40.645919] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-09T19:28:40.647526] [DEBUG] [LOCAL ] HRL: Trimmed 76683 records to 53484 (keeping 200 days of data) [2025-10-09T19:28:40.830486] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-09T19:28:40.981803] [DEBUG] [LOCAL ] HRL: Primary data saved (53484 records). [2025-10-09T19:28:40.981972] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-09T19:28:40.982773] [INFO ] [MAIN ] Update Progress: 1056/2373 symbols completed. HRL took 35.5s. Estimated remaining: 3h 5m 21s. Rate: 7.1 symbols/min [2025-10-09T19:28:41.154813] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:41.217247] [DEBUG] [LOCAL ] HSY: Loaded 50345 existing records from primary storage. [2025-10-09T19:28:41.217713] [INFO ] [MAIN ] HSY: Loaded 50345 existing records. [2025-10-09T19:28:41.395754] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:41.403882] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-09T19:28:41.404547] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-09T19:28:41.404903] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-09T19:28:41.408059] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-09T19:28:41.408314] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-09T19:28:41.439545] [INFO ] [REMOTE ] HRTG: Full fetch complete (43497 records). [2025-10-09T19:28:41.471401] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-09T19:28:41.601755] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-09T19:28:41.770218] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T19:28:42.205315] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:42.205519] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-09T19:28:42.205845] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-09T19:28:42.206681] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-09T19:28:42.206746] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-09T19:28:42.207616] [DEBUG] [LOCAL ] HRTG: Trimmed 43497 records to 34091 (keeping 200 days of data) [2025-10-09T19:28:42.398371] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-09T19:28:42.408672] [DEBUG] [LOCAL ] HRTG: Primary data saved (34091 records). [2025-10-09T19:28:42.408759] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-09T19:28:42.408838] [INFO ] [MAIN ] Update Progress: 1057/2373 symbols completed. HRTG took 28.8s. Estimated remaining: 3h 5m 4s. Rate: 7.1 symbols/min [2025-10-09T19:28:42.582254] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:42.582497] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-09T19:28:42.582553] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-09T19:28:42.582699] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-09T19:28:42.582760] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-09T19:28:42.582831] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-09T19:28:42.582908] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-09T19:28:42.927919] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:43.196676] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-09T19:28:43.411297] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:28:43.411680] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-09T19:28:43.411773] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:28:43.411821] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-09T19:28:43.411856] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:28:43.411894] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-09T19:28:43.411951] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-09T19:28:43.411987] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-09T19:28:43.412043] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-09T19:28:43.412114] [INFO ] [MAIN ] Update Progress: 1058/2373 symbols completed. HTB took 1.0s. Estimated remaining: 3h 4m 47s. Rate: 7.1 symbols/min [2025-10-09T19:28:43.581872] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:28:43.614901] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-09T19:28:43.637525] [DEBUG] [LOCAL ] HTD: Loaded 13925 existing records from primary storage. [2025-10-09T19:28:43.637855] [INFO ] [MAIN ] HTD: Loaded 13925 existing records. [2025-10-09T19:28:43.818952] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:28:43.819430] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-09T19:28:43.819676] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-09T19:28:43.820116] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-09T19:28:43.820194] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-09T19:28:44.001944] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-09T19:28:44.181109] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T19:28:44.253039] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:28:44.796778] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-09T19:28:45.304736] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-09T19:28:45.596720] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-09T19:28:46.015932] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-09T19:28:46.396734] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-09T19:28:47.196718] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-09T19:28:47.553503] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-09T19:28:47.996806] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-09T19:28:48.188926] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T19:28:48.525863] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-09T19:28:48.778401] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T19:28:48.796666] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-09T19:28:49.555716] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T19:28:49.596689] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-09T19:28:50.396720] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-09T19:28:51.196737] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-09T19:28:51.426525] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T19:28:51.525552] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T19:28:51.996721] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-09T19:28:52.796736] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-09T19:28:53.062531] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-09T19:28:53.490059] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T19:28:53.596686] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-09T19:28:53.612167] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T19:28:54.396765] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-09T19:28:55.196702] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-09T19:28:55.453026] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-09T19:28:55.996705] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-09T19:28:56.184083] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T19:28:56.207963] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-09T19:28:56.796718] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-09T19:28:57.596693] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-09T19:28:57.795751] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T19:28:58.396786] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-09T19:28:58.412829] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T19:28:58.585359] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T19:28:59.196799] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-09T19:28:59.296244] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-09T19:28:59.996721] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-09T19:29:00.796741] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-09T19:29:01.060479] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-09T19:29:01.057482] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T19:29:01.596725] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-09T19:29:02.225510] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-09T19:29:02.258929] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:29:02.396689] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-09T19:29:03.196781] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-09T19:29:03.996696] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-09T19:29:04.060556] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:29:04.781635] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T19:29:04.796661] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-09T19:29:04.935614] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T19:29:04.939980] [INFO ] [REMOTE ] HSBC: Full fetch complete (73811 records). [2025-10-09T19:29:04.940212] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-09T19:29:05.326819] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-09T19:29:05.326903] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-09T19:29:05.327902] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-09T19:29:05.327968] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-09T19:29:05.329627] [DEBUG] [LOCAL ] HSBC: Trimmed 73811 records to 51335 (keeping 200 days of data) [2025-10-09T19:29:05.614397] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-09T19:29:05.663787] [DEBUG] [LOCAL ] HSBC: Primary data saved (51335 records). [2025-10-09T19:29:05.663985] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-09T19:29:05.664141] [INFO ] [MAIN ] Update Progress: 1059/2373 symbols completed. HSBC took 33.4s. Estimated remaining: 3h 4m 55s. Rate: 7.1 symbols/min [2025-10-09T19:29:05.856028] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:05.856290] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-09T19:29:05.856363] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-09T19:29:05.856483] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-09T19:29:05.856528] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-09T19:29:05.856570] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-09T19:29:05.856605] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-09T19:29:05.972801] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T19:29:06.230805] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:06.396694] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-09T19:29:06.730669] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-09T19:29:07.196692] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-09T19:29:07.428907] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:29:07.532146] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-09T19:29:07.996733] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-09T19:29:08.541462] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-09T19:29:08.796717] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-09T19:29:09.593542] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T19:29:09.596767] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-09T19:29:10.396690] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-09T19:29:10.420635] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-09T19:29:10.422082] [INFO ] [REMOTE ] HSHP: Full fetch complete (23157 records). [2025-10-09T19:29:10.422152] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-09T19:29:10.783907] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-09T19:29:10.783985] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-09T19:29:10.784511] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-09T19:29:10.784568] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-09T19:29:10.785190] [DEBUG] [LOCAL ] HSHP: Trimmed 23157 records to 15090 (keeping 200 days of data) [2025-10-09T19:29:10.876888] [DEBUG] [LOCAL ] HSHP: Primary data saved (15090 records). [2025-10-09T19:29:10.877045] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-09T19:29:10.877135] [INFO ] [MAIN ] Update Progress: 1060/2373 symbols completed. HSHP took 36.5s. Estimated remaining: 3h 4m 43s. Rate: 7.1 symbols/min [2025-10-09T19:29:11.056637] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:11.108425] [DEBUG] [LOCAL ] HTGC: Loaded 47466 existing records from primary storage. [2025-10-09T19:29:11.108827] [INFO ] [MAIN ] HTGC: Loaded 47466 existing records. [2025-10-09T19:29:11.201784] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-09T19:29:11.328441] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:11.328847] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-09T19:29:11.329076] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-09T19:29:11.329573] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-09T19:29:11.329635] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-09T19:29:11.463143] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-09T19:29:11.671506] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T19:29:11.782703] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:11.996729] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-09T19:29:12.796729] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-09T19:29:13.596772] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-09T19:29:13.626857] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T19:29:13.787519] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-09T19:29:13.923991] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-09T19:29:14.396735] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-09T19:29:15.196729] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-09T19:29:15.344161] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:29:15.996710] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-09T19:29:16.796759] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-09T19:29:16.915105] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T19:29:16.917309] [INFO ] [REMOTE ] HTD: Full fetch complete (19116 records). [2025-10-09T19:29:16.917699] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-09T19:29:17.355596] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-09T19:29:17.355847] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-09T19:29:17.366003] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-09T19:29:17.367173] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-09T19:29:17.367289] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-09T19:29:17.368460] [DEBUG] [LOCAL ] HTD: Trimmed 19116 records to 14048 (keeping 200 days of data) [2025-10-09T19:29:17.454079] [DEBUG] [LOCAL ] HTD: Primary data saved (14048 records). [2025-10-09T19:29:17.454219] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-09T19:29:17.454306] [INFO ] [MAIN ] Update Progress: 1061/2373 symbols completed. HTD took 34.0s. Estimated remaining: 3h 4m 32s. Rate: 7.1 symbols/min [2025-10-09T19:29:17.601829] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-09T19:29:17.633105] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:17.669300] [DEBUG] [LOCAL ] HTH: Loaded 32417 existing records from primary storage. [2025-10-09T19:29:17.669594] [INFO ] [MAIN ] HTH: Loaded 32417 existing records. [2025-10-09T19:29:17.843109] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:17.843349] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-09T19:29:17.843397] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-09T19:29:17.843774] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-09T19:29:17.843832] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-09T19:29:18.202108] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:18.403984] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-09T19:29:18.423455] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T19:29:18.840307] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T19:29:19.196725] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-09T19:29:19.293616] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T19:29:19.298104] [INFO ] [REMOTE ] HSY: Full fetch complete (73513 records). [2025-10-09T19:29:19.298245] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-09T19:29:19.586987] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T19:29:19.691889] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-09T19:29:19.691978] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-09T19:29:19.693036] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-09T19:29:19.693106] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-09T19:29:19.694695] [DEBUG] [LOCAL ] HSY: Trimmed 73513 records to 50708 (keeping 200 days of data) [2025-10-09T19:29:20.001503] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-09T19:29:20.021700] [DEBUG] [LOCAL ] HSY: Primary data saved (50708 records). [2025-10-09T19:29:20.021791] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-09T19:29:20.022681] [INFO ] [MAIN ] Update Progress: 1062/2373 symbols completed. HSY took 39.0s. Estimated remaining: 3h 4m 16s. Rate: 7.1 symbols/min [2025-10-09T19:29:20.190694] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:20.230832] [DEBUG] [LOCAL ] HUBB: Loaded 36591 existing records from primary storage. [2025-10-09T19:29:20.231118] [INFO ] [MAIN ] HUBB: Loaded 36591 existing records. [2025-10-09T19:29:20.388143] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-09T19:29:20.411128] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:20.412204] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-09T19:29:20.412253] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-09T19:29:20.413026] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-09T19:29:20.413087] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-09T19:29:20.763028] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:20.796664] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-09T19:29:21.596717] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-09T19:29:21.706180] [DEBUG] [REMOTE ] HTH: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-09T19:29:21.706415] [WARN ] [REMOTE ] HTH: No data returned for month 2024-12 [2025-10-09T19:29:21.706503] [FATAL] [REMOTE ] HTH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:29:21.706549] [FATAL] [MAIN ] HTH: Failed to fetch primary data. [2025-10-09T19:29:21.706582] [WARN ] [MAIN ] HTH: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:29:21.706619] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-09T19:29:21.706709] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-09T19:29:21.706769] [INFO ] [LOCAL ] HTH: Starting deletion of derivative data. [2025-10-09T19:29:21.707045] [DEBUG] [LOCAL ] HTH: Deleted derivative data file. [2025-10-09T19:29:21.707136] [INFO ] [MAIN ] Update Progress: 1063/2373 symbols completed. HTH took 4.3s. Estimated remaining: 3h 3m 60s. Rate: 7.1 symbols/min [2025-10-09T19:29:21.915103] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:21.950843] [DEBUG] [LOCAL ] HUBS: Loaded 39673 existing records from primary storage. [2025-10-09T19:29:21.951142] [INFO ] [MAIN ] HUBS: Loaded 39673 existing records. [2025-10-09T19:29:22.137602] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:22.138097] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-09T19:29:22.138184] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-09T19:29:22.145027] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-09T19:29:22.154776] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-09T19:29:22.189812] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:29:22.401906] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-09T19:29:22.547316] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:23.196718] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-09T19:29:23.993975] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T19:29:24.002712] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-09T19:29:24.659564] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-09T19:29:24.796695] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-09T19:29:25.522825] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-09T19:29:25.596664] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-09T19:29:26.122533] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T19:29:26.396724] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-09T19:29:26.635288] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-09T19:29:27.196791] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-09T19:29:27.842278] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-09T19:29:27.996703] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-09T19:29:28.522432] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-09T19:29:28.796783] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-09T19:29:29.052523] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-09T19:29:29.610690] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-09T19:29:29.612814] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T19:29:30.396729] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-09T19:29:30.612303] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-09T19:29:30.998738] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-09T19:29:31.196692] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-09T19:29:31.492302] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-09T19:29:31.996727] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-09T19:29:32.346971] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-09T19:29:32.347621] [INFO ] [REMOTE ] HTFC: Full fetch complete (846 records). [2025-10-09T19:29:32.347741] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-09T19:29:32.526892] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-09T19:29:32.527083] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:29:32.527154] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:29:32.527228] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-09T19:29:32.527292] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-09T19:29:32.527329] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-09T19:29:32.527389] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-09T19:29:32.527472] [INFO ] [MAIN ] Update Progress: 1064/2373 symbols completed. HTFC took 26.9s. Estimated remaining: 3h 3m 54s. Rate: 7.1 symbols/min [2025-10-09T19:29:32.693465] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:32.741780] [DEBUG] [LOCAL ] HUM: Loaded 49032 existing records from primary storage. [2025-10-09T19:29:32.742081] [INFO ] [MAIN ] HUM: Loaded 49032 existing records. [2025-10-09T19:29:32.802588] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-09T19:29:32.920313] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:32.920511] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-09T19:29:32.920562] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-09T19:29:32.922263] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-09T19:29:32.922327] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-09T19:29:33.274512] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:33.596771] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-09T19:29:34.396713] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-09T19:29:34.522046] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:29:35.196710] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-09T19:29:35.372519] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T19:29:35.593917] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-09T19:29:35.996775] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-09T19:29:36.790978] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-09T19:29:36.798979] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-09T19:29:37.596748] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-09T19:29:37.743906] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:29:38.396682] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-09T19:29:38.592150] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T19:29:38.823625] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T19:29:39.196730] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-09T19:29:39.986783] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-09T19:29:40.000041] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-09T19:29:40.796773] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-09T19:29:40.974597] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T19:29:41.457012] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:29:41.596727] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-09T19:29:42.215351] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T19:29:42.396754] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-09T19:29:42.802441] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T19:29:43.196725] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-09T19:29:43.996688] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-09T19:29:44.225984] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-09T19:29:44.789704] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-09T19:29:44.797459] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-09T19:29:45.514027] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T19:29:45.596672] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-09T19:29:46.396769] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-09T19:29:46.795125] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T19:29:46.846437] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T19:29:47.196739] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-09T19:29:47.371771] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T19:29:47.996739] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-09T19:29:48.391079] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:29:48.395046] [INFO ] [REMOTE ] HUBS: Full fetch complete (55995 records). [2025-10-09T19:29:48.395146] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-09T19:29:48.770103] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-09T19:29:48.770188] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-09T19:29:48.771020] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-09T19:29:48.771083] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-09T19:29:48.772256] [DEBUG] [LOCAL ] HUBS: Trimmed 55995 records to 40004 (keeping 200 days of data) [2025-10-09T19:29:48.825629] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-09T19:29:49.017618] [DEBUG] [LOCAL ] HUBS: Primary data saved (40004 records). [2025-10-09T19:29:49.017791] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-09T19:29:49.017904] [INFO ] [MAIN ] Update Progress: 1065/2373 symbols completed. HUBS took 27.3s. Estimated remaining: 3h 3m 56s. Rate: 7.1 symbols/min [2025-10-09T19:29:49.228084] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:49.278278] [DEBUG] [LOCAL ] HUN: Loaded 53202 existing records from primary storage. [2025-10-09T19:29:49.278677] [INFO ] [MAIN ] HUN: Loaded 53202 existing records. [2025-10-09T19:29:49.454735] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:49.454971] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-09T19:29:49.455023] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-09T19:29:49.456294] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-09T19:29:49.456354] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-09T19:29:49.605714] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-09T19:29:49.819013] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:49.849108] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:29:50.396689] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-09T19:29:50.556500] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T19:29:50.936512] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T19:29:51.196793] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-09T19:29:51.860013] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T19:29:51.996702] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-09T19:29:52.796735] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-09T19:29:52.871404] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-09T19:29:53.596772] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-09T19:29:53.870312] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T19:29:54.368395] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T19:29:54.396704] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-09T19:29:55.196709] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-09T19:29:55.255378] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T19:29:55.834830] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:29:55.839110] [INFO ] [REMOTE ] HTGC: Full fetch complete (68456 records). [2025-10-09T19:29:55.839235] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-09T19:29:56.001027] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-09T19:29:56.247057] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-09T19:29:56.247136] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-09T19:29:56.248113] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-09T19:29:56.248179] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-09T19:29:56.249505] [DEBUG] [LOCAL ] HTGC: Trimmed 68456 records to 47851 (keeping 200 days of data) [2025-10-09T19:29:56.550369] [DEBUG] [LOCAL ] HTGC: Primary data saved (47851 records). [2025-10-09T19:29:56.550500] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-09T19:29:56.551587] [INFO ] [MAIN ] Update Progress: 1066/2373 symbols completed. HTGC took 45.7s. Estimated remaining: 3h 3m 46s. Rate: 7.1 symbols/min [2025-10-09T19:29:56.740014] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:29:56.765285] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-09T19:29:56.796668] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-09T19:29:56.816480] [DEBUG] [LOCAL ] HUYA: Loaded 43890 existing records from primary storage. [2025-10-09T19:29:56.816898] [INFO ] [MAIN ] HUYA: Loaded 43890 existing records. [2025-10-09T19:29:56.997469] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:29:56.997730] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-09T19:29:56.997785] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-09T19:29:56.998189] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-09T19:29:56.998245] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-09T19:29:57.356666] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:29:57.596693] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-09T19:29:57.836201] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T19:29:58.187425] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-09T19:29:58.396717] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-09T19:29:59.108176] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:29:59.196674] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-09T19:29:59.960132] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:29:59.996686] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-09T19:30:00.796689] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-09T19:30:01.003895] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-09T19:30:01.391543] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:30:01.596776] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-09T19:30:02.396759] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-09T19:30:02.506332] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:30:03.196770] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-09T19:30:03.312287] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:30:03.315608] [INFO ] [REMOTE ] HUBB: Full fetch complete (53859 records). [2025-10-09T19:30:03.315881] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-09T19:30:03.701808] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-09T19:30:03.701906] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-09T19:30:03.702707] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-09T19:30:03.702771] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-09T19:30:03.703923] [DEBUG] [LOCAL ] HUBB: Trimmed 53859 records to 36829 (keeping 200 days of data) [2025-10-09T19:30:03.942368] [DEBUG] [LOCAL ] HUBB: Primary data saved (36829 records). [2025-10-09T19:30:03.942518] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-09T19:30:03.942614] [INFO ] [MAIN ] Update Progress: 1067/2373 symbols completed. HUBB took 43.9s. Estimated remaining: 3h 3m 36s. Rate: 7.1 symbols/min [2025-10-09T19:30:04.005966] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-09T19:30:04.142052] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:30:04.145228] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:04.171868] [DEBUG] [LOCAL ] HVT: Loaded 15297 existing records from primary storage. [2025-10-09T19:30:04.172149] [INFO ] [MAIN ] HVT: Loaded 15297 existing records. [2025-10-09T19:30:04.358296] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:30:04.358531] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-09T19:30:04.358580] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-09T19:30:04.358828] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-09T19:30:04.358885] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-09T19:30:04.735373] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:04.776899] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T19:30:04.796664] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-09T19:30:05.596748] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-09T19:30:06.064420] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-09T19:30:06.068761] [INFO ] [REMOTE ] HUM: Full fetch complete (70940 records). [2025-10-09T19:30:06.068866] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-09T19:30:06.421600] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-09T19:30:06.475398] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-09T19:30:06.475740] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-09T19:30:06.477365] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-09T19:30:06.477532] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-09T19:30:06.490074] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T19:30:06.494290] [DEBUG] [LOCAL ] HUM: Trimmed 70940 records to 49359 (keeping 200 days of data) [2025-10-09T19:30:06.646908] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:30:06.858335] [DEBUG] [LOCAL ] HUM: Primary data saved (49359 records). [2025-10-09T19:30:06.858499] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-09T19:30:06.858591] [INFO ] [MAIN ] Update Progress: 1068/2373 symbols completed. HUM took 34.3s. Estimated remaining: 3h 3m 21s. Rate: 7.1 symbols/min [2025-10-09T19:30:07.032942] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:07.084559] [DEBUG] [LOCAL ] HWM: Loaded 52895 existing records from primary storage. [2025-10-09T19:30:07.084995] [INFO ] [MAIN ] HWM: Loaded 52895 existing records. [2025-10-09T19:30:07.201936] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-09T19:30:07.263082] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:30:07.263307] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-09T19:30:07.263356] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-09T19:30:07.263612] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-09T19:30:07.263697] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-09T19:30:07.634375] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:07.662443] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T19:30:07.996768] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-09T19:30:08.796742] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-09T19:30:08.864633] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:30:09.596692] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-09T19:30:09.786726] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T19:30:10.361972] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T19:30:10.396708] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-09T19:30:11.196763] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-09T19:30:11.332192] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T19:30:11.996699] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-09T19:30:12.056942] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:30:12.137375] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T19:30:12.796707] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-09T19:30:13.596679] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-09T19:30:13.640409] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-09T19:30:13.719702] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T19:30:14.396785] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-09T19:30:15.196710] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-09T19:30:15.342265] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:30:15.450328] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-09T19:30:15.996774] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-09T19:30:16.668974] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T19:30:16.796706] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-09T19:30:17.596694] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-09T19:30:17.906585] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T19:30:17.960781] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-09T19:30:18.396718] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-09T19:30:18.790359] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-09T19:30:19.022089] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-09T19:30:19.196766] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-09T19:30:19.996725] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-09T19:30:20.650377] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T19:30:20.796709] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-09T19:30:21.526953] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T19:30:21.596746] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-09T19:30:22.396757] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-09T19:30:22.466888] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:30:22.472151] [INFO ] [REMOTE ] HUN: Full fetch complete (76725 records). [2025-10-09T19:30:22.472301] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-09T19:30:22.867409] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-09T19:30:22.867492] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-09T19:30:22.868624] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-09T19:30:22.868713] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-09T19:30:22.870307] [DEBUG] [LOCAL ] HUN: Trimmed 76725 records to 53591 (keeping 200 days of data) [2025-10-09T19:30:23.196807] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-09T19:30:23.217055] [DEBUG] [LOCAL ] HUN: Primary data saved (53591 records). [2025-10-09T19:30:23.217933] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-09T19:30:23.218107] [INFO ] [MAIN ] Update Progress: 1069/2373 symbols completed. HUN took 34.2s. Estimated remaining: 3h 3m 22s. Rate: 7.1 symbols/min [2025-10-09T19:30:23.389078] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:23.431226] [DEBUG] [LOCAL ] HXL: Loaded 45893 existing records from primary storage. [2025-10-09T19:30:23.431575] [INFO ] [MAIN ] HXL: Loaded 45893 existing records. [2025-10-09T19:30:23.624528] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:30:23.625254] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-09T19:30:23.625319] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-09T19:30:23.625561] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-09T19:30:23.625623] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-09T19:30:23.773768] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-09T19:30:23.999479] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-09T19:30:24.006802] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T19:30:24.082489] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:24.108887] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T19:30:24.796713] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-09T19:30:25.340462] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-09T19:30:25.596679] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-09T19:30:26.011983] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-09T19:30:26.396722] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-09T19:30:26.972938] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T19:30:27.196702] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-09T19:30:27.223148] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T19:30:27.996764] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-09T19:30:28.617382] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T19:30:28.796684] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-09T19:30:29.196808] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:30:29.596711] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-09T19:30:30.358257] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:30:30.396684] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-09T19:30:31.196727] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-09T19:30:31.855331] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-09T19:30:31.996759] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-09T19:30:32.143363] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-09T19:30:32.555975] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T19:30:32.563530] [INFO ] [REMOTE ] HUYA: Full fetch complete (63911 records). [2025-10-09T19:30:32.564143] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-09T19:30:32.802003] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-09T19:30:32.948460] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:30:33.205494] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-09T19:30:33.205592] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-09T19:30:33.206613] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-09T19:30:33.206734] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-09T19:30:33.208250] [DEBUG] [LOCAL ] HUYA: Trimmed 63911 records to 44268 (keeping 200 days of data) [2025-10-09T19:30:33.477712] [DEBUG] [LOCAL ] HUYA: Primary data saved (44268 records). [2025-10-09T19:30:33.477839] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-09T19:30:33.478461] [INFO ] [MAIN ] Update Progress: 1070/2373 symbols completed. HUYA took 36.9s. Estimated remaining: 3h 3m 16s. Rate: 7.1 symbols/min [2025-10-09T19:30:33.601942] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-09T19:30:33.645988] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:33.659615] [DEBUG] [LOCAL ] HY: Loaded 9989 existing records from primary storage. [2025-10-09T19:30:33.659862] [INFO ] [MAIN ] HY: Loaded 9989 existing records. [2025-10-09T19:30:33.833243] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:30:33.833421] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-09T19:30:33.833467] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-09T19:30:33.833689] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-09T19:30:33.833746] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-09T19:30:34.183417] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:34.396667] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-09T19:30:34.558386] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T19:30:34.560584] [INFO ] [REMOTE ] HVT: Full fetch complete (23266 records). [2025-10-09T19:30:34.560735] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-09T19:30:34.955604] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-09T19:30:34.955828] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-09T19:30:34.956444] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-09T19:30:34.956525] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-09T19:30:34.982942] [DEBUG] [LOCAL ] HVT: Trimmed 23266 records to 15407 (keeping 200 days of data) [2025-10-09T19:30:34.985020] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-09T19:30:35.093890] [DEBUG] [LOCAL ] HVT: Primary data saved (15407 records). [2025-10-09T19:30:35.094020] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-09T19:30:35.094104] [INFO ] [MAIN ] Update Progress: 1071/2373 symbols completed. HVT took 31.2s. Estimated remaining: 3h 2m 60s. Rate: 7.1 symbols/min [2025-10-09T19:30:35.201179] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-09T19:30:35.253154] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T19:30:35.290311] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:35.290443] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-09T19:30:35.290499] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-09T19:30:35.290612] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-09T19:30:35.290692] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-09T19:30:35.290771] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-09T19:30:35.290828] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-09T19:30:35.658988] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:35.996774] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-09T19:30:36.693561] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T19:30:36.796694] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-09T19:30:37.546345] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-09T19:30:37.596677] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-09T19:30:37.712930] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T19:30:38.396751] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-09T19:30:39.004422] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-09T19:30:39.165522] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T19:30:39.196701] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-09T19:30:39.996699] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-09T19:30:40.024824] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T19:30:40.796767] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-09T19:30:41.121827] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-09T19:30:41.571878] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T19:30:41.596716] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-09T19:30:42.396729] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-09T19:30:42.631765] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-09T19:30:43.196721] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-09T19:30:43.247202] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T19:30:43.996799] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-09T19:30:44.796690] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-09T19:30:45.084073] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T19:30:45.269221] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T19:30:45.596705] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-09T19:30:45.643969] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-09T19:30:46.396725] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-09T19:30:47.199429] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-09T19:30:47.210192] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T19:30:47.214606] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:30:47.534603] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-09T19:30:47.996743] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-09T19:30:48.728052] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T19:30:48.796707] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-09T19:30:49.593628] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T19:30:49.596719] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-09T19:30:50.396725] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-09T19:30:50.451252] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T19:30:51.196777] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-09T19:30:51.996749] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-09T19:30:52.181593] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T19:30:52.208870] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T19:30:52.212724] [INFO ] [REMOTE ] HXL: Full fetch complete (66222 records). [2025-10-09T19:30:52.212821] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-09T19:30:52.295519] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-09T19:30:52.621202] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-09T19:30:52.621346] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-09T19:30:52.622345] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-09T19:30:52.622410] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-09T19:30:52.623794] [DEBUG] [LOCAL ] HXL: Trimmed 66222 records to 46202 (keeping 200 days of data) [2025-10-09T19:30:52.799464] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-09T19:30:52.905382] [DEBUG] [LOCAL ] HXL: Primary data saved (46202 records). [2025-10-09T19:30:52.905517] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-09T19:30:52.905615] [INFO ] [MAIN ] Update Progress: 1072/2373 symbols completed. HXL took 29.7s. Estimated remaining: 3h 3m 2s. Rate: 7.1 symbols/min [2025-10-09T19:30:53.072722] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:53.072883] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-09T19:30:53.072938] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-09T19:30:53.073069] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-09T19:30:53.073117] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-09T19:30:53.073168] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-09T19:30:53.073206] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-09T19:30:53.425940] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:53.596735] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-09T19:30:53.644118] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-09T19:30:54.396725] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-09T19:30:55.059158] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T19:30:55.060552] [INFO ] [REMOTE ] HY: Full fetch complete (15047 records). [2025-10-09T19:30:55.060624] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-09T19:30:55.211599] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-09T19:30:55.482059] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-09T19:30:55.491681] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-09T19:30:55.491766] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-09T19:30:55.496204] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-09T19:30:55.496400] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-09T19:30:55.496969] [INFO ] [REMOTE ] HWM: Full fetch complete (76539 records). [2025-10-09T19:30:55.497267] [DEBUG] [LOCAL ] HY: Trimmed 15047 records to 10036 (keeping 200 days of data) [2025-10-09T19:30:55.497386] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-09T19:30:56.000627] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T19:30:56.000191] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-09T19:30:56.006445] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-09T19:30:56.008777] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-09T19:30:56.009092] [DEBUG] [LOCAL ] HY: Primary data saved (10036 records). [2025-10-09T19:30:56.011238] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-09T19:30:56.011582] [INFO ] [MAIN ] HY: Full history saved. [2025-10-09T19:30:56.011494] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-09T19:30:56.011820] [INFO ] [MAIN ] Update Progress: 1073/2373 symbols completed. HY took 22.5s. Estimated remaining: 3h 2m 48s. Rate: 7.1 symbols/min [2025-10-09T19:30:56.104040] [DEBUG] [LOCAL ] HWM: Trimmed 76539 records to 53247 (keeping 200 days of data) [2025-10-09T19:30:56.279619] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:56.294111] [DEBUG] [LOCAL ] HYI: Loaded 9914 existing records from primary storage. [2025-10-09T19:30:56.295346] [INFO ] [MAIN ] HYI: Loaded 9914 existing records. [2025-10-09T19:30:56.362710] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-09T19:30:56.489011] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:30:56.489993] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-09T19:30:56.490297] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-09T19:30:56.491138] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-09T19:30:56.491464] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-09T19:30:56.801767] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-09T19:30:56.894676] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:57.113600] [DEBUG] [LOCAL ] HWM: Primary data saved (53247 records). [2025-10-09T19:30:57.113763] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-09T19:30:57.113857] [INFO ] [MAIN ] Update Progress: 1074/2373 symbols completed. HWM took 50.3s. Estimated remaining: 3h 2m 30s. Rate: 7.1 symbols/min [2025-10-09T19:30:57.191808] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T19:30:57.289277] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:30:57.289464] [DEBUG] [LOCAL ] HYT: No existing data file found in primary storage. [2025-10-09T19:30:57.289502] [WARN ] [MAIN ] HYT: No existing data found, performing full refresh instead. [2025-10-09T19:30:57.289618] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-09T19:30:57.289693] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-09T19:30:57.289752] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-09T19:30:57.289786] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-09T19:30:57.615546] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-09T19:30:57.657393] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:30:58.195054] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-09T19:30:58.396751] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-09T19:30:59.196747] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-09T19:30:59.743010] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T19:30:59.755912] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T19:30:59.996795] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-09T19:31:00.796750] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-09T19:31:00.807384] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-09T19:31:01.596784] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-09T19:31:01.935328] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-09T19:31:02.077181] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T19:31:02.396761] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-09T19:31:03.196751] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-09T19:31:03.454450] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-09T19:31:03.518096] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T19:31:03.996792] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-09T19:31:04.796699] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-09T19:31:05.012303] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-09T19:31:05.360889] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T19:31:05.596718] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-09T19:31:05.857969] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-09T19:31:06.396726] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-09T19:31:07.134576] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T19:31:07.196691] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-09T19:31:07.589787] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-09T19:31:07.996720] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-09T19:31:08.796731] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-09T19:31:09.282877] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-09T19:31:09.457566] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T19:31:09.596724] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-09T19:31:10.396685] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-09T19:31:10.423733] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-09T19:31:10.708087] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-09T19:31:11.196768] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-09T19:31:11.610187] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-09T19:31:11.996746] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-09T19:31:12.282935] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-09T19:31:12.796763] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-09T19:31:13.596741] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-09T19:31:14.160910] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-09T19:31:14.183331] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T19:31:14.396737] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-09T19:31:14.727071] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-09T19:31:15.196730] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-09T19:31:15.460357] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-09T19:31:15.996754] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-09T19:31:16.796722] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-09T19:31:16.829572] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-09T19:31:17.596724] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-09T19:31:17.841609] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-09T19:31:18.209122] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T19:31:18.396732] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-09T19:31:19.196731] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-09T19:31:19.595179] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-09T19:31:19.595869] [INFO ] [REMOTE ] HYBX: Full fetch complete (728 records). [2025-10-09T19:31:19.595936] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-09T19:31:19.776309] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-09T19:31:19.776512] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:31:19.776770] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:31:19.776847] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-09T19:31:19.776933] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-09T19:31:19.777121] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-09T19:31:19.777210] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-09T19:31:19.777295] [INFO ] [MAIN ] Update Progress: 1075/2373 symbols completed. HYBX took 26.9s. Estimated remaining: 3h 2m 39s. Rate: 7.1 symbols/min [2025-10-09T19:31:19.951055] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T19:31:19.976559] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:19.990331] [DEBUG] [LOCAL ] HYTR: Loaded 3113 existing records from primary storage. [2025-10-09T19:31:19.990511] [INFO ] [MAIN ] HYTR: Loaded 3113 existing records. [2025-10-09T19:31:20.001770] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-09T19:31:20.170275] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:20.170483] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-09T19:31:20.170563] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-09T19:31:20.170891] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-09T19:31:20.170950] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-09T19:31:20.538043] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:20.542183] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-09T19:31:20.542793] [INFO ] [REMOTE ] HYAC: Full fetch complete (869 records). [2025-10-09T19:31:20.542861] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-09T19:31:20.719027] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-09T19:31:20.719229] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:31:20.719301] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:31:20.719350] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-09T19:31:20.719406] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-09T19:31:20.719440] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-09T19:31:20.719479] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-09T19:31:20.719535] [INFO ] [MAIN ] Update Progress: 1076/2373 symbols completed. HYAC took 45.6s. Estimated remaining: 3h 2m 22s. Rate: 7.1 symbols/min [2025-10-09T19:31:20.801977] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-09T19:31:20.888792] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:20.918388] [DEBUG] [LOCAL ] HZO: Loaded 29050 existing records from primary storage. [2025-10-09T19:31:20.918696] [INFO ] [MAIN ] HZO: Loaded 29050 existing records. [2025-10-09T19:31:21.097604] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:21.097860] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-09T19:31:21.097907] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-09T19:31:21.098161] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-09T19:31:21.098218] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-09T19:31:21.465843] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:21.527590] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T19:31:21.596735] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-09T19:31:22.396684] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-09T19:31:22.773069] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T19:31:23.194395] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-09T19:31:23.196688] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-09T19:31:23.728129] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T19:31:23.996721] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-09T19:31:24.796722] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-09T19:31:25.543542] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T19:31:25.596673] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-09T19:31:25.956278] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T19:31:26.396763] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-09T19:31:26.667862] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-09T19:31:27.013260] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-09T19:31:27.016513] [INFO ] [REMOTE ] HYT: Full fetch complete (47723 records). [2025-10-09T19:31:27.016597] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-09T19:31:27.203184] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-09T19:31:27.399532] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-09T19:31:27.399611] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-09T19:31:27.400355] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-09T19:31:27.400415] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-09T19:31:27.401450] [DEBUG] [LOCAL ] HYT: Trimmed 47723 records to 33742 (keeping 200 days of data) [2025-10-09T19:31:27.607054] [DEBUG] [LOCAL ] HYT: Primary data saved (33742 records). [2025-10-09T19:31:27.607212] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-09T19:31:27.607289] [INFO ] [MAIN ] Update Progress: 1077/2373 symbols completed. HYT took 30.5s. Estimated remaining: 3h 2m 11s. Rate: 7.1 symbols/min [2025-10-09T19:31:27.996693] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-09T19:31:28.068515] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-09T19:31:28.452444] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-09T19:31:28.796711] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-09T19:31:29.338233] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T19:31:29.596775] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-09T19:31:30.396697] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-09T19:31:30.788302] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T19:31:30.929510] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-09T19:31:31.196728] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-09T19:31:31.626832] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-09T19:31:31.996696] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-09T19:31:32.572406] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T19:31:32.796739] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-09T19:31:33.267041] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-09T19:31:33.596716] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-09T19:31:34.339836] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T19:31:34.396753] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-09T19:31:35.196732] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-09T19:31:35.209027] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T19:31:35.210942] [INFO ] [REMOTE ] HYI: Full fetch complete (13948 records). [2025-10-09T19:31:35.211014] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-09T19:31:35.648534] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-09T19:31:35.648719] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-09T19:31:35.650259] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-09T19:31:35.650582] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-09T19:31:35.650623] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-09T19:31:35.651157] [DEBUG] [LOCAL ] HYI: Trimmed 13948 records to 9984 (keeping 200 days of data) [2025-10-09T19:31:35.714965] [DEBUG] [LOCAL ] HYI: Primary data saved (9984 records). [2025-10-09T19:31:35.715106] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-09T19:31:35.715193] [INFO ] [MAIN ] Update Progress: 1078/2373 symbols completed. HYI took 39.7s. Estimated remaining: 3h 2m 2s. Rate: 7.1 symbols/min [2025-10-09T19:31:35.996727] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-09T19:31:36.796722] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-09T19:31:37.240284] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-09T19:31:37.254963] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T19:31:37.596792] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-09T19:31:38.396759] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-09T19:31:38.850801] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T19:31:38.888397] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T19:31:39.196772] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-09T19:31:39.996758] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-09T19:31:40.369345] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-09T19:31:40.627466] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T19:31:40.628850] [INFO ] [REMOTE ] HYTR: Full fetch complete (4611 records). [2025-10-09T19:31:40.628943] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-09T19:31:40.801997] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-09T19:31:41.177933] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-09T19:31:41.178032] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-09T19:31:41.178252] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-09T19:31:41.178298] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-09T19:31:41.178985] [DEBUG] [LOCAL ] HYTR: Trimmed 4611 records to 3138 (keeping 200 days of data) [2025-10-09T19:31:41.211822] [DEBUG] [LOCAL ] HYTR: Primary data saved (3138 records). [2025-10-09T19:31:41.212025] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-09T19:31:41.212183] [INFO ] [MAIN ] Update Progress: 1079/2373 symbols completed. HYTR took 21.4s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-09T19:31:42.047881] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:31:42.053928] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-09T19:31:43.359128] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-09T19:31:43.365920] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-09T19:31:44.543004] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:31:44.549242] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-09T19:31:45.738316] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T19:31:45.745555] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-09T19:31:46.862526] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T19:31:46.865334] [INFO ] [REMOTE ] HZO: Full fetch complete (41067 records). [2025-10-09T19:31:46.865433] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-09T19:31:47.258510] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-09T19:31:47.258593] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-09T19:31:47.259323] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-09T19:31:47.259389] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-09T19:31:47.260301] [DEBUG] [LOCAL ] HZO: Trimmed 41067 records to 29215 (keeping 200 days of data) [2025-10-09T19:31:47.431881] [DEBUG] [LOCAL ] HZO: Primary data saved (29215 records). [2025-10-09T19:31:47.432028] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-09T19:31:47.432115] [INFO ] [MAIN ] Update Progress: 1080/2373 symbols completed. HZO took 26.7s. Estimated remaining: 3h 1m 39s. Rate: 7.1 symbols/min [2025-10-09T19:31:48.103134] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:48.103945] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:48.150502] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:48.183184] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:31:48.190362] [DEBUG] [LOCAL ] IAE: Loaded 6125 existing records from primary storage. [2025-10-09T19:31:48.190795] [INFO ] [MAIN ] IAE: Loaded 6125 existing records. [2025-10-09T19:31:48.409294] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:48.437145] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-09T19:31:48.452197] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-09T19:31:48.453429] [DEBUG] [LOCAL ] IAG: Loaded 53473 existing records from primary storage. [2025-10-09T19:31:48.453692] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-09T19:31:48.454047] [INFO ] [MAIN ] IAG: Loaded 53473 existing records. [2025-10-09T19:31:48.453903] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-09T19:31:48.693703] [DEBUG] [LOCAL ] IBM: Loaded 53631 existing records from primary storage. [2025-10-09T19:31:48.692982] [DEBUG] [LOCAL ] IBN: Loaded 52860 existing records from primary storage. [2025-10-09T19:31:48.709928] [INFO ] [MAIN ] IBM: Loaded 53631 existing records. [2025-10-09T19:31:48.720565] [INFO ] [MAIN ] IBN: Loaded 52860 existing records. [2025-10-09T19:31:48.998344] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:49.058927] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-09T19:31:49.129600] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-09T19:31:49.183273] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-09T19:31:49.326064] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:49.334602] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-09T19:31:49.280238] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-09T19:31:49.355747] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-09T19:31:49.329218] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:31:49.399192] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-09T19:31:49.409321] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-09T19:31:49.429621] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-09T19:31:49.409404] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-09T19:31:49.435771] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:49.436164] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-09T19:31:49.499517] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-09T19:31:49.517840] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-09T19:31:50.319859] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T19:31:50.346807] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-09T19:31:50.465490] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:50.503383] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:50.544617] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-09T19:31:50.536936] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-09T19:31:50.565361] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:31:50.567014] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-09T19:31:51.074190] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T19:31:51.076524] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-09T19:31:51.695778] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-09T19:31:51.698096] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-09T19:31:51.945040] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:31:51.956001] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-09T19:31:52.226189] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T19:31:52.237055] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-09T19:31:52.256489] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-09T19:31:52.258847] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-09T19:31:52.341950] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-09T19:31:52.796721] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-09T19:31:52.867892] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T19:31:53.349001] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T19:31:53.596708] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-09T19:31:53.690927] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T19:31:53.990017] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-09T19:31:54.396686] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-09T19:31:54.604229] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T19:31:55.024395] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T19:31:55.196670] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-09T19:31:55.852758] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-09T19:31:55.996711] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-09T19:31:56.796734] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-09T19:31:57.596748] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-09T19:31:57.804190] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T19:31:58.103094] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-09T19:31:58.396746] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-09T19:31:58.604173] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-09T19:31:59.190403] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T19:31:59.196669] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-09T19:31:59.802123] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T19:31:59.803372] [INFO ] [REMOTE ] IAE: Full fetch complete (8815 records). [2025-10-09T19:31:59.803471] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-09T19:32:00.001937] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-09T19:32:00.158612] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-09T19:32:00.158730] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-09T19:32:00.158984] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-09T19:32:00.159025] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-09T19:32:00.159446] [DEBUG] [LOCAL ] IAE: Trimmed 8815 records to 6203 (keeping 200 days of data) [2025-10-09T19:32:00.196459] [DEBUG] [LOCAL ] IAE: Primary data saved (6203 records). [2025-10-09T19:32:00.196576] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-09T19:32:00.196678] [INFO ] [MAIN ] Update Progress: 1081/2373 symbols completed. IAE took 12.8s. Estimated remaining: 3h 1m 36s. Rate: 7.1 symbols/min [2025-10-09T19:32:00.366078] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:00.397296] [DEBUG] [LOCAL ] IBP: Loaded 28771 existing records from primary storage. [2025-10-09T19:32:00.397570] [INFO ] [MAIN ] IBP: Loaded 28771 existing records. [2025-10-09T19:32:00.568202] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:00.568476] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-09T19:32:00.568540] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-09T19:32:00.569008] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-09T19:32:00.569069] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-09T19:32:00.801936] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-09T19:32:00.914058] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:01.596768] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-09T19:32:02.265549] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-09T19:32:02.396744] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-09T19:32:02.543031] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:32:02.907632] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:32:03.196733] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-09T19:32:03.996730] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-09T19:32:04.459945] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-09T19:32:04.796710] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-09T19:32:05.116969] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-09T19:32:05.596765] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-09T19:32:05.750568] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-09T19:32:06.396692] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-09T19:32:06.601930] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:32:06.886671] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-09T19:32:07.196790] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-09T19:32:07.996701] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-09T19:32:08.207155] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-09T19:32:08.311926] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T19:32:08.796714] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-09T19:32:09.596785] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-09T19:32:09.877820] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T19:32:09.930040] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T19:32:10.396779] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-09T19:32:11.196747] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-09T19:32:11.381194] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T19:32:11.970991] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-09T19:32:11.996700] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-09T19:32:12.673818] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T19:32:12.796710] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-09T19:32:13.596731] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-09T19:32:14.396698] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-09T19:32:14.499693] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-09T19:32:14.556076] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T19:32:15.196683] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-09T19:32:15.429488] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T19:32:15.609292] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T19:32:15.996814] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-09T19:32:16.796715] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-09T19:32:17.144786] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-09T19:32:17.344532] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-09T19:32:17.596720] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-09T19:32:18.396831] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-09T19:32:19.204561] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-09T19:32:19.225303] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-09T19:32:19.283219] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-09T19:32:19.324478] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T19:32:19.996795] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-09T19:32:20.796690] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-09T19:32:21.083391] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-09T19:32:21.596733] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-09T19:32:22.396751] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-09T19:32:22.448069] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-09T19:32:22.981841] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-09T19:32:22.986614] [INFO ] [REMOTE ] IAG: Full fetch complete (77278 records). [2025-10-09T19:32:22.986816] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-09T19:32:23.197684] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-09T19:32:23.426900] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-09T19:32:23.427112] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-09T19:32:23.428343] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-09T19:32:23.428446] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-09T19:32:23.460678] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-09T19:32:23.471339] [DEBUG] [LOCAL ] IAG: Trimmed 77278 records to 53863 (keeping 200 days of data) [2025-10-09T19:32:23.589102] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T19:32:23.847621] [DEBUG] [LOCAL ] IAG: Primary data saved (53863 records). [2025-10-09T19:32:23.847818] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-09T19:32:23.848403] [INFO ] [MAIN ] Update Progress: 1082/2373 symbols completed. IAG took 36.4s. Estimated remaining: 3h 1m 46s. Rate: 7.1 symbols/min [2025-10-09T19:32:24.011828] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-09T19:32:24.014757] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:24.052107] [DEBUG] [LOCAL ] IBTA: Loaded 37145 existing records from primary storage. [2025-10-09T19:32:24.052428] [INFO ] [MAIN ] IBTA: Loaded 37145 existing records. [2025-10-09T19:32:24.227767] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:24.227992] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-09T19:32:24.228041] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-09T19:32:24.228313] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-09T19:32:24.228370] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-09T19:32:24.612797] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:24.796702] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-09T19:32:25.141996] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:32:25.596683] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-09T19:32:25.758314] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-09T19:32:25.762988] [INFO ] [REMOTE ] IBM: Full fetch complete (77623 records). [2025-10-09T19:32:25.763108] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-09T19:32:26.156630] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-09T19:32:26.156746] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-09T19:32:26.157841] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-09T19:32:26.157905] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-09T19:32:26.159525] [DEBUG] [LOCAL ] IBM: Trimmed 77623 records to 54021 (keeping 200 days of data) [2025-10-09T19:32:26.396827] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-09T19:32:26.522285] [DEBUG] [LOCAL ] IBM: Primary data saved (54021 records). [2025-10-09T19:32:26.522509] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-09T19:32:26.522767] [INFO ] [MAIN ] Update Progress: 1083/2373 symbols completed. IBM took 39.1s. Estimated remaining: 3h 1m 31s. Rate: 7.1 symbols/min [2025-10-09T19:32:26.676556] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T19:32:26.752680] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:26.805053] [DEBUG] [LOCAL ] ICE: Loaded 53012 existing records from primary storage. [2025-10-09T19:32:26.805402] [INFO ] [MAIN ] ICE: Loaded 53012 existing records. [2025-10-09T19:32:26.918013] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T19:32:26.966789] [INFO ] [REMOTE ] IBP: Full fetch complete (41167 records). [2025-10-09T19:32:26.992196] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-09T19:32:26.997264] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:26.997571] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-09T19:32:27.029224] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-09T19:32:27.066129] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-09T19:32:27.072237] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-09T19:32:27.207553] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-09T19:32:27.733086] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-09T19:32:27.738692] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-09T19:32:27.776678] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:27.770900] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-09T19:32:27.777101] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-09T19:32:27.778809] [DEBUG] [LOCAL ] IBP: Trimmed 41167 records to 29034 (keeping 200 days of data) [2025-10-09T19:32:27.795971] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T19:32:27.988432] [DEBUG] [LOCAL ] IBP: Primary data saved (29034 records). [2025-10-09T19:32:27.988598] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-09T19:32:27.988707] [INFO ] [MAIN ] Update Progress: 1084/2373 symbols completed. IBP took 27.8s. Estimated remaining: 3h 1m 14s. Rate: 7.1 symbols/min [2025-10-09T19:32:28.001836] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-09T19:32:28.157084] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:28.192974] [DEBUG] [LOCAL ] ICL: Loaded 38375 existing records from primary storage. [2025-10-09T19:32:28.193276] [INFO ] [MAIN ] ICL: Loaded 38375 existing records. [2025-10-09T19:32:28.363005] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:28.363208] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-09T19:32:28.363261] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-09T19:32:28.363516] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-09T19:32:28.363574] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-09T19:32:28.707621] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:28.796665] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-09T19:32:28.972958] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T19:32:29.596743] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-09T19:32:29.891524] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T19:32:30.227808] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:32:30.396738] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-09T19:32:31.101122] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T19:32:31.196680] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-09T19:32:31.213119] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T19:32:31.996738] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-09T19:32:32.796791] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-09T19:32:32.940142] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T19:32:33.596785] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-09T19:32:33.679865] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T19:32:33.686798] [INFO ] [REMOTE ] IBN: Full fetch complete (76330 records). [2025-10-09T19:32:33.687006] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-09T19:32:34.168012] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-09T19:32:34.168217] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-09T19:32:34.169241] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-09T19:32:34.169325] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-09T19:32:34.170889] [DEBUG] [LOCAL ] IBN: Trimmed 76330 records to 53246 (keeping 200 days of data) [2025-10-09T19:32:34.284886] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T19:32:34.418466] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-09T19:32:34.531208] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T19:32:34.555232] [DEBUG] [LOCAL ] IBN: Primary data saved (53246 records). [2025-10-09T19:32:34.555366] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-09T19:32:34.556295] [INFO ] [MAIN ] Update Progress: 1085/2373 symbols completed. IBN took 47.1s. Estimated remaining: 3h 1m 3s. Rate: 7.1 symbols/min [2025-10-09T19:32:34.727095] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:34.765099] [DEBUG] [LOCAL ] IDA: Loaded 32579 existing records from primary storage. [2025-10-09T19:32:34.765398] [INFO ] [MAIN ] IDA: Loaded 32579 existing records. [2025-10-09T19:32:34.948249] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:34.948461] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-09T19:32:34.948509] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-09T19:32:34.948763] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-09T19:32:34.948855] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-09T19:32:35.201869] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-09T19:32:35.308476] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:35.964759] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T19:32:35.996702] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-09T19:32:36.796735] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-09T19:32:36.980133] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T19:32:37.596694] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-09T19:32:37.793662] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T19:32:38.218495] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T19:32:38.396752] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-09T19:32:38.835907] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T19:32:39.196769] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-09T19:32:39.996753] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-09T19:32:40.305627] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T19:32:40.378721] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T19:32:40.796729] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-09T19:32:41.138770] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-09T19:32:41.596717] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-09T19:32:42.052730] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T19:32:42.396746] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-09T19:32:43.205875] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-09T19:32:43.224319] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:32:43.283399] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T19:32:43.996755] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-09T19:32:44.347476] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T19:32:44.796813] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-09T19:32:45.058591] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-09T19:32:45.596742] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-09T19:32:46.396704] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-09T19:32:46.709069] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T19:32:46.740561] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T19:32:47.196719] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-09T19:32:47.887808] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:32:47.996692] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-09T19:32:48.302873] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T19:32:48.796733] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-09T19:32:49.402138] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T19:32:49.596684] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-09T19:32:50.041714] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T19:32:50.396713] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-09T19:32:50.801331] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-09T19:32:51.196743] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-09T19:32:51.996685] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-09T19:32:52.195552] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-09T19:32:52.619996] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T19:32:52.796715] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-09T19:32:53.323049] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-09T19:32:53.596713] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-09T19:32:54.213314] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T19:32:54.396737] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-09T19:32:54.984070] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:32:55.196760] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-09T19:32:55.680060] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T19:32:55.684096] [INFO ] [REMOTE ] IBTA: Full fetch complete (50908 records). [2025-10-09T19:32:55.684478] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-09T19:32:56.001849] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-09T19:32:56.075226] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-09T19:32:56.075321] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-09T19:32:56.076267] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-09T19:32:56.076335] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-09T19:32:56.077493] [DEBUG] [LOCAL ] IBTA: Trimmed 50908 records to 37355 (keeping 200 days of data) [2025-10-09T19:32:56.292392] [DEBUG] [LOCAL ] IBTA: Primary data saved (37355 records). [2025-10-09T19:32:56.292543] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-09T19:32:56.293400] [INFO ] [MAIN ] Update Progress: 1086/2373 symbols completed. IBTA took 32.4s. Estimated remaining: 3h 1m 10s. Rate: 7.1 symbols/min [2025-10-09T19:32:56.403244] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-09T19:32:56.452036] [INFO ] [REMOTE ] ICL: Full fetch complete (55883 records). [2025-10-09T19:32:56.473768] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-09T19:32:56.476997] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:56.582285] [DEBUG] [LOCAL ] IDE: Loaded 8882 existing records from primary storage. [2025-10-09T19:32:56.605838] [INFO ] [MAIN ] IDE: Loaded 8882 existing records. [2025-10-09T19:32:56.797496] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-09T19:32:57.003998] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:57.055118] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-09T19:32:57.055801] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-09T19:32:57.066741] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-09T19:32:57.082436] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-09T19:32:57.250390] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-09T19:32:57.258404] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-09T19:32:57.262314] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-09T19:32:57.262813] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-09T19:32:57.324367] [DEBUG] [LOCAL ] ICL: Trimmed 55883 records to 38682 (keeping 200 days of data) [2025-10-09T19:32:57.611218] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:57.612368] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-09T19:32:57.761428] [DEBUG] [LOCAL ] ICL: Primary data saved (38682 records). [2025-10-09T19:32:57.761692] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-09T19:32:57.761844] [INFO ] [MAIN ] Update Progress: 1087/2373 symbols completed. ICL took 29.8s. Estimated remaining: 3h 0m 54s. Rate: 7.1 symbols/min [2025-10-09T19:32:57.954505] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:32:57.989548] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-09T19:32:58.015808] [DEBUG] [LOCAL ] IDT: Loaded 18163 existing records from primary storage. [2025-10-09T19:32:58.016077] [INFO ] [MAIN ] IDT: Loaded 18163 existing records. [2025-10-09T19:32:58.218102] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:32:58.218827] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-09T19:32:58.218936] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-09T19:32:58.219210] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-09T19:32:58.219273] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-09T19:32:58.441178] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-09T19:32:58.472405] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-09T19:32:58.589393] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T19:32:58.682999] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:32:59.196753] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-09T19:32:59.996708] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-09T19:33:00.050682] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T19:33:00.284829] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T19:33:00.796711] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-09T19:33:01.037614] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T19:33:01.578038] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T19:33:01.596686] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-09T19:33:02.366891] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T19:33:02.396703] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-09T19:33:03.016100] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-09T19:33:03.196732] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-09T19:33:03.996754] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-09T19:33:04.708674] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-09T19:33:04.796694] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-09T19:33:04.996637] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-09T19:33:05.584543] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T19:33:05.596689] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-09T19:33:06.396718] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-09T19:33:07.196749] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-09T19:33:07.227065] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-09T19:33:07.314430] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:33:07.319065] [INFO ] [REMOTE ] ICE: Full fetch complete (76764 records). [2025-10-09T19:33:07.319188] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-09T19:33:07.717972] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-09T19:33:07.718063] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-09T19:33:07.719150] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-09T19:33:07.719227] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-09T19:33:07.720790] [DEBUG] [LOCAL ] ICE: Trimmed 76764 records to 53402 (keeping 200 days of data) [2025-10-09T19:33:08.009225] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-09T19:33:08.062492] [DEBUG] [LOCAL ] ICE: Primary data saved (53402 records). [2025-10-09T19:33:08.062709] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-09T19:33:08.063917] [INFO ] [MAIN ] Update Progress: 1088/2373 symbols completed. ICE took 41.5s. Estimated remaining: 3h 0m 48s. Rate: 7.1 symbols/min [2025-10-09T19:33:08.234459] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:08.275258] [DEBUG] [LOCAL ] IEX: Loaded 38329 existing records from primary storage. [2025-10-09T19:33:08.275569] [INFO ] [MAIN ] IEX: Loaded 38329 existing records. [2025-10-09T19:33:08.454112] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:08.454344] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-09T19:33:08.454390] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-09T19:33:08.454600] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-09T19:33:08.454686] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-09T19:33:08.743693] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T19:33:08.803250] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-09T19:33:08.836215] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:08.860545] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T19:33:09.596776] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-09T19:33:09.649121] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-09T19:33:10.396755] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-09T19:33:10.826043] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T19:33:11.129150] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T19:33:11.196699] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-09T19:33:11.996693] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-09T19:33:12.447459] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:33:12.796796] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-09T19:33:12.824711] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-09T19:33:13.596771] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-09T19:33:13.894895] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T19:33:14.396725] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-09T19:33:14.903819] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T19:33:14.906757] [INFO ] [REMOTE ] IDA: Full fetch complete (45012 records). [2025-10-09T19:33:14.906841] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-09T19:33:15.197166] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-09T19:33:15.289465] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-09T19:33:15.289544] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-09T19:33:15.290295] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-09T19:33:15.290357] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-09T19:33:15.291686] [DEBUG] [LOCAL ] IDA: Trimmed 45012 records to 32825 (keeping 200 days of data) [2025-10-09T19:33:15.391427] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-09T19:33:15.509378] [DEBUG] [LOCAL ] IDA: Primary data saved (32825 records). [2025-10-09T19:33:15.509572] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-09T19:33:15.510298] [INFO ] [MAIN ] Update Progress: 1089/2373 symbols completed. IDA took 41.0s. Estimated remaining: 3h 0m 38s. Rate: 7.1 symbols/min [2025-10-09T19:33:15.674312] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:15.726769] [DEBUG] [LOCAL ] IFF: Loaded 51052 existing records from primary storage. [2025-10-09T19:33:15.727071] [INFO ] [MAIN ] IFF: Loaded 51052 existing records. [2025-10-09T19:33:15.899525] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:15.899783] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-09T19:33:15.899831] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-09T19:33:15.900149] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-09T19:33:15.900205] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-09T19:33:16.004129] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-09T19:33:16.322150] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:16.342981] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-09T19:33:16.796710] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-09T19:33:16.810598] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T19:33:17.596763] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-09T19:33:17.849544] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T19:33:18.341489] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T19:33:18.342913] [INFO ] [REMOTE ] IDE: Full fetch complete (12612 records). [2025-10-09T19:33:18.342989] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-09T19:33:18.401976] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-09T19:33:18.711851] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-09T19:33:18.711931] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-09T19:33:18.712214] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-09T19:33:18.712252] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-09T19:33:18.712729] [DEBUG] [LOCAL ] IDE: Trimmed 12612 records to 8984 (keeping 200 days of data) [2025-10-09T19:33:18.768796] [DEBUG] [LOCAL ] IDE: Primary data saved (8984 records). [2025-10-09T19:33:18.768930] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-09T19:33:18.769015] [INFO ] [MAIN ] Update Progress: 1090/2373 symbols completed. IDE took 22.5s. Estimated remaining: 3h 0m 23s. Rate: 7.1 symbols/min [2025-10-09T19:33:18.932152] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:18.952083] [DEBUG] [LOCAL ] IFN: Loaded 18362 existing records from primary storage. [2025-10-09T19:33:18.952328] [INFO ] [MAIN ] IFN: Loaded 18362 existing records. [2025-10-09T19:33:19.130305] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:19.130538] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-09T19:33:19.130584] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-09T19:33:19.130941] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-09T19:33:19.130999] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-09T19:33:19.202605] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-09T19:33:19.491164] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:19.579723] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-09T19:33:19.996686] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-09T19:33:20.243287] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T19:33:20.796721] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-09T19:33:21.084639] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T19:33:21.596767] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-09T19:33:21.927104] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:33:22.396755] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-09T19:33:22.674617] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T19:33:23.196738] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-09T19:33:23.698587] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-09T19:33:23.996807] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-09T19:33:24.632834] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-09T19:33:24.676230] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:33:24.796772] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-09T19:33:25.596712] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-09T19:33:25.730063] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T19:33:26.396810] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-09T19:33:27.083048] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T19:33:27.196775] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-09T19:33:27.525318] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:33:27.996735] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-09T19:33:28.679805] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-09T19:33:28.793209] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T19:33:28.801655] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-09T19:33:29.596724] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-09T19:33:30.396708] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-09T19:33:30.490138] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T19:33:30.646081] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-09T19:33:31.196718] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-09T19:33:31.578944] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-09T19:33:31.996765] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-09T19:33:32.554215] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T19:33:32.796700] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-09T19:33:33.077364] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-09T19:33:33.596691] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-09T19:33:33.821204] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:33:34.396724] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-09T19:33:34.885113] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-09T19:33:34.887587] [INFO ] [REMOTE ] IDT: Full fetch complete (23433 records). [2025-10-09T19:33:34.887713] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-09T19:33:35.204455] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-09T19:33:35.249903] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-09T19:33:35.249979] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-09T19:33:35.250478] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-09T19:33:35.250517] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-09T19:33:35.251194] [DEBUG] [LOCAL ] IDT: Trimmed 23433 records to 18343 (keeping 200 days of data) [2025-10-09T19:33:35.370457] [DEBUG] [LOCAL ] IDT: Primary data saved (18343 records). [2025-10-09T19:33:35.370594] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-09T19:33:35.370708] [INFO ] [MAIN ] Update Progress: 1091/2373 symbols completed. IDT took 37.6s. Estimated remaining: 3h 0m 25s. Rate: 7.1 symbols/min [2025-10-09T19:33:35.537896] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:35.559777] [DEBUG] [LOCAL ] IFS: Loaded 22937 existing records from primary storage. [2025-10-09T19:33:35.560028] [INFO ] [MAIN ] IFS: Loaded 22937 existing records. [2025-10-09T19:33:35.739451] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:35.739798] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-09T19:33:35.739951] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-09T19:33:35.740206] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-09T19:33:35.740284] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-09T19:33:36.001722] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-09T19:33:36.106439] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:36.134809] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T19:33:36.211139] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-09T19:33:36.796725] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-09T19:33:37.460800] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T19:33:37.596750] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-09T19:33:37.945235] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T19:33:38.167210] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-09T19:33:38.396778] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-09T19:33:39.196759] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-09T19:33:39.849586] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-09T19:33:39.869877] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-09T19:33:39.996668] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-09T19:33:40.796737] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-09T19:33:41.601905] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-09T19:33:41.618166] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T19:33:41.941335] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:33:42.396769] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-09T19:33:42.492040] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T19:33:43.196726] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-09T19:33:43.949530] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T19:33:43.972331] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T19:33:43.996673] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-09T19:33:44.796724] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-09T19:33:45.596771] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-09T19:33:45.720770] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-09T19:33:46.072411] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-09T19:33:46.396749] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-09T19:33:46.863293] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:33:47.196735] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-09T19:33:47.923411] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T19:33:47.928345] [INFO ] [REMOTE ] IEX: Full fetch complete (53428 records). [2025-10-09T19:33:47.928556] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-09T19:33:48.001849] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-09T19:33:48.346702] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-09T19:33:48.364266] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-09T19:33:48.367366] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-09T19:33:48.366255] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-09T19:33:48.374057] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-09T19:33:48.376464] [DEBUG] [LOCAL ] IEX: Trimmed 53428 records to 38578 (keeping 200 days of data) [2025-10-09T19:33:48.620821] [DEBUG] [LOCAL ] IEX: Primary data saved (38578 records). [2025-10-09T19:33:48.620967] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-09T19:33:48.621049] [INFO ] [MAIN ] Update Progress: 1092/2373 symbols completed. IEX took 40.6s. Estimated remaining: 3h 0m 22s. Rate: 7.1 symbols/min [2025-10-09T19:33:48.787865] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:48.800238] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-09T19:33:48.800762] [DEBUG] [LOCAL ] IGA: Loaded 10005 existing records from primary storage. [2025-10-09T19:33:48.801362] [INFO ] [MAIN ] IGA: Loaded 10005 existing records. [2025-10-09T19:33:48.976228] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:48.976459] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-09T19:33:48.976508] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-09T19:33:48.976721] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-09T19:33:48.976779] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-09T19:33:49.085278] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T19:33:49.108810] [INFO ] [REMOTE ] IFN: Full fetch complete (28776 records). [2025-10-09T19:33:49.132786] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-09T19:33:49.616490] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-09T19:33:49.635190] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:49.764279] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-09T19:33:49.764390] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-09T19:33:49.765237] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-09T19:33:49.765307] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-09T19:33:49.766497] [DEBUG] [LOCAL ] IFN: Trimmed 28776 records to 18452 (keeping 200 days of data) [2025-10-09T19:33:49.884810] [DEBUG] [LOCAL ] IFN: Primary data saved (18452 records). [2025-10-09T19:33:49.884974] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-09T19:33:49.885064] [INFO ] [MAIN ] Update Progress: 1093/2373 symbols completed. IFN took 31.1s. Estimated remaining: 3h 0m 5s. Rate: 7.1 symbols/min [2025-10-09T19:33:50.067952] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:33:50.085700] [DEBUG] [LOCAL ] IGD: Loaded 19218 existing records from primary storage. [2025-10-09T19:33:50.085936] [INFO ] [MAIN ] IGD: Loaded 19218 existing records. [2025-10-09T19:33:50.267406] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:33:50.267753] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-09T19:33:50.267813] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-09T19:33:50.268026] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-09T19:33:50.268088] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-09T19:33:50.409887] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-09T19:33:50.668339] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:33:50.725445] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T19:33:50.723698] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-09T19:33:51.073250] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-09T19:33:51.196731] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-09T19:33:51.996739] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-09T19:33:52.727126] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T19:33:52.762944] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T19:33:52.796675] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-09T19:33:53.226233] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T19:33:53.596726] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-09T19:33:54.396737] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-09T19:33:54.491106] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-09T19:33:55.128830] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-09T19:33:55.196694] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-09T19:33:55.996689] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-09T19:33:56.159101] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-09T19:33:56.796756] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-09T19:33:56.834088] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-09T19:33:57.596717] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-09T19:33:58.298724] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-09T19:33:58.396689] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-09T19:33:58.628791] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:33:59.070274] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T19:33:59.196724] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-09T19:33:59.996688] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-09T19:34:00.289351] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-09T19:34:00.796732] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-09T19:34:01.235281] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-09T19:34:01.596689] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-09T19:34:01.619120] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-09T19:34:02.396706] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-09T19:34:02.613992] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-09T19:34:03.102749] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:34:03.196695] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-09T19:34:03.996711] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-09T19:34:04.042997] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T19:34:04.796782] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-09T19:34:05.332715] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:34:05.337581] [INFO ] [REMOTE ] IFF: Full fetch complete (73199 records). [2025-10-09T19:34:05.337774] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-09T19:34:05.603879] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-09T19:34:05.740998] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-09T19:34:05.741088] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-09T19:34:05.742107] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-09T19:34:05.742173] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-09T19:34:05.743727] [DEBUG] [LOCAL ] IFF: Trimmed 73199 records to 51422 (keeping 200 days of data) [2025-10-09T19:34:05.984045] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:34:05.987902] [INFO ] [REMOTE ] IFS: Full fetch complete (31718 records). [2025-10-09T19:34:05.989120] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-09T19:34:06.396745] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-09T19:34:06.397427] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-09T19:34:06.398422] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-09T19:34:06.398521] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-09T19:34:06.398816] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-09T19:34:06.402452] [DEBUG] [LOCAL ] IFS: Trimmed 31718 records to 23061 (keeping 200 days of data) [2025-10-09T19:34:06.647535] [DEBUG] [LOCAL ] IFF: Primary data saved (51422 records). [2025-10-09T19:34:06.648563] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-09T19:34:06.649704] [INFO ] [MAIN ] Update Progress: 1094/2373 symbols completed. IFF took 51.1s. Estimated remaining: 3h 0m 6s. Rate: 7.1 symbols/min [2025-10-09T19:34:06.715731] [DEBUG] [LOCAL ] IFS: Primary data saved (23061 records). [2025-10-09T19:34:06.745438] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-09T19:34:06.753868] [INFO ] [MAIN ] Update Progress: 1095/2373 symbols completed. IFS took 31.4s. Estimated remaining: 2h 59m 48s. Rate: 7.1 symbols/min [2025-10-09T19:34:06.946231] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:07.024550] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:07.029731] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T19:34:07.038909] [DEBUG] [LOCAL ] IGI: Loaded 3787 existing records from primary storage. [2025-10-09T19:34:07.039189] [INFO ] [MAIN ] IGI: Loaded 3787 existing records. [2025-10-09T19:34:07.205446] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-09T19:34:07.253121] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-09T19:34:07.252707] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:07.257061] [DEBUG] [LOCAL ] IGR: Loaded 30399 existing records from primary storage. [2025-10-09T19:34:07.257531] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-09T19:34:07.258216] [INFO ] [MAIN ] IGR: Loaded 30399 existing records. [2025-10-09T19:34:07.258272] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-09T19:34:07.320688] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-09T19:34:07.331936] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-09T19:34:07.574287] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:07.592666] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-09T19:34:07.608484] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-09T19:34:07.679967] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-09T19:34:07.700925] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-09T19:34:07.913201] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:08.007783] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-09T19:34:08.156696] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:08.151621] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T19:34:08.796731] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-09T19:34:08.903953] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-09T19:34:09.596769] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-09T19:34:10.048637] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-09T19:34:10.357482] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T19:34:10.396669] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-09T19:34:11.196815] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-09T19:34:11.729675] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T19:34:11.980115] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:34:11.996666] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-09T19:34:12.796735] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-09T19:34:12.857085] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-09T19:34:12.858576] [INFO ] [REMOTE ] IGA: Full fetch complete (13904 records). [2025-10-09T19:34:12.858677] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-09T19:34:13.211736] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-09T19:34:13.211893] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-09T19:34:13.212222] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-09T19:34:13.212283] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-09T19:34:13.212822] [DEBUG] [LOCAL ] IGA: Trimmed 13904 records to 10089 (keeping 200 days of data) [2025-10-09T19:34:13.274848] [DEBUG] [LOCAL ] IGA: Primary data saved (10089 records). [2025-10-09T19:34:13.274980] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-09T19:34:13.275105] [INFO ] [MAIN ] Update Progress: 1096/2373 symbols completed. IGA took 24.7s. Estimated remaining: 2h 59m 37s. Rate: 7.1 symbols/min [2025-10-09T19:34:13.439028] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:13.444338] [DEBUG] [LOCAL ] IH: Loaded 2853 existing records from primary storage. [2025-10-09T19:34:13.444498] [INFO ] [MAIN ] IH: Loaded 2853 existing records. [2025-10-09T19:34:13.613534] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-09T19:34:13.618861] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:13.619071] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-09T19:34:13.619167] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-09T19:34:13.619350] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-09T19:34:13.619408] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-09T19:34:13.971406] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:14.026280] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-09T19:34:14.151164] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T19:34:14.396723] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-09T19:34:15.196754] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-09T19:34:15.623946] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T19:34:15.807945] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-09T19:34:15.996747] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-09T19:34:16.717615] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-09T19:34:16.796734] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-09T19:34:17.398073] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-09T19:34:17.596729] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-09T19:34:18.396732] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-09T19:34:19.002990] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T19:34:19.196762] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-09T19:34:19.524334] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T19:34:19.720135] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T19:34:19.996761] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-09T19:34:20.472539] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-09T19:34:20.796778] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-09T19:34:21.317839] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-09T19:34:21.596746] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-09T19:34:22.396688] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-09T19:34:22.619224] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-09T19:34:23.196717] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-09T19:34:23.627494] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-09T19:34:23.947254] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T19:34:23.996705] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-09T19:34:24.461258] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-09T19:34:24.796751] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-09T19:34:25.596711] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-09T19:34:25.929428] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T19:34:26.396729] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-09T19:34:26.435816] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T19:34:26.846296] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-09T19:34:27.196710] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-09T19:34:27.996773] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-09T19:34:28.550877] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-09T19:34:28.796691] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-09T19:34:28.897586] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T19:34:29.399975] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T19:34:29.596720] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-09T19:34:30.396713] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-09T19:34:30.850278] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-09T19:34:30.955838] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-09T19:34:31.196719] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-09T19:34:31.996762] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-09T19:34:32.417380] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-09T19:34:32.796724] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-09T19:34:33.309403] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T19:34:33.438910] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T19:34:33.596779] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-09T19:34:34.396716] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-09T19:34:34.680589] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T19:34:35.196681] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-09T19:34:35.242146] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-09T19:34:35.244628] [INFO ] [REMOTE ] IGR: Full fetch complete (45155 records). [2025-10-09T19:34:35.244745] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-09T19:34:35.625399] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-09T19:34:35.625484] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-09T19:34:35.626248] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-09T19:34:35.626318] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-09T19:34:35.627379] [DEBUG] [LOCAL ] IGR: Trimmed 45155 records to 30591 (keeping 200 days of data) [2025-10-09T19:34:35.809410] [DEBUG] [LOCAL ] IGR: Primary data saved (30591 records). [2025-10-09T19:34:35.809549] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-09T19:34:35.809632] [INFO ] [MAIN ] Update Progress: 1097/2373 symbols completed. IGR took 29.1s. Estimated remaining: 2h 59m 45s. Rate: 7.1 symbols/min [2025-10-09T19:34:35.992304] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:35.998412] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-09T19:34:36.003983] [DEBUG] [LOCAL ] IHD: Loaded 7064 existing records from primary storage. [2025-10-09T19:34:36.004214] [INFO ] [MAIN ] IHD: Loaded 7064 existing records. [2025-10-09T19:34:36.191935] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:36.197495] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-09T19:34:36.199827] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-09T19:34:36.199961] [INFO ] [REMOTE ] IGD: Full fetch complete (29767 records). [2025-10-09T19:34:36.199895] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-09T19:34:36.200155] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-09T19:34:36.200284] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-09T19:34:36.200389] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-09T19:34:36.808776] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-09T19:34:36.834393] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T19:34:36.940827] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-09T19:34:36.948496] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-09T19:34:36.957866] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-09T19:34:36.967310] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-09T19:34:36.971052] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:36.971917] [DEBUG] [LOCAL ] IGD: Trimmed 29767 records to 19396 (keeping 200 days of data) [2025-10-09T19:34:37.086465] [DEBUG] [LOCAL ] IGD: Primary data saved (19396 records). [2025-10-09T19:34:37.086615] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-09T19:34:37.086734] [INFO ] [MAIN ] Update Progress: 1098/2373 symbols completed. IGD took 47.2s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-09T19:34:37.264169] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:37.295487] [DEBUG] [LOCAL ] IHG: Loaded 24221 existing records from primary storage. [2025-10-09T19:34:37.296117] [INFO ] [MAIN ] IHG: Loaded 24221 existing records. [2025-10-09T19:34:37.481821] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-09T19:34:37.487481] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:37.490278] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-09T19:34:37.490343] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-09T19:34:37.490602] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-09T19:34:37.490691] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-09T19:34:37.601832] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-09T19:34:37.868284] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:38.216700] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-09T19:34:38.217832] [INFO ] [REMOTE ] IGI: Full fetch complete (5387 records). [2025-10-09T19:34:38.217900] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-09T19:34:38.401912] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-09T19:34:38.584825] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-09T19:34:38.584959] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-09T19:34:38.585132] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-09T19:34:38.585173] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-09T19:34:38.585546] [DEBUG] [LOCAL ] IGI: Trimmed 5387 records to 3844 (keeping 200 days of data) [2025-10-09T19:34:38.609441] [DEBUG] [LOCAL ] IGI: Primary data saved (3844 records). [2025-10-09T19:34:38.609539] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-09T19:34:38.609660] [INFO ] [MAIN ] Update Progress: 1099/2373 symbols completed. IGI took 32.0s. Estimated remaining: 2h 59m 12s. Rate: 7.1 symbols/min [2025-10-09T19:34:38.772593] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:38.811032] [DEBUG] [LOCAL ] IHS: Loaded 38329 existing records from primary storage. [2025-10-09T19:34:38.811314] [INFO ] [MAIN ] IHS: Loaded 38329 existing records. [2025-10-09T19:34:38.983008] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:38.983249] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-09T19:34:38.983296] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-09T19:34:38.983547] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-09T19:34:38.983604] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-09T19:34:39.210467] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-09T19:34:39.337704] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:39.431769] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:34:39.834493] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-09T19:34:39.996769] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-09T19:34:40.796739] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-09T19:34:41.033998] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-09T19:34:41.568634] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T19:34:41.596686] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-09T19:34:42.396693] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-09T19:34:42.678758] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T19:34:43.052413] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-09T19:34:43.196741] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-09T19:34:43.996692] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-09T19:34:44.200078] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T19:34:44.421015] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-09T19:34:44.796728] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-09T19:34:45.408879] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-09T19:34:45.596706] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-09T19:34:46.396730] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-09T19:34:46.996551] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-09T19:34:47.196750] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-09T19:34:47.293722] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-09T19:34:47.968430] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-09T19:34:47.996669] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-09T19:34:48.674394] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-09T19:34:48.796744] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-09T19:34:49.596716] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-09T19:34:50.197225] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T19:34:50.396734] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-09T19:34:50.787366] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T19:34:51.196714] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-09T19:34:51.655245] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-09T19:34:51.718269] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-09T19:34:51.996790] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-09T19:34:52.693479] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T19:34:52.796772] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-09T19:34:53.539185] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T19:34:53.596773] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-09T19:34:54.396732] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-09T19:34:54.717354] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T19:34:54.867250] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-09T19:34:55.196760] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-09T19:34:55.709226] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T19:34:55.710070] [INFO ] [REMOTE ] IH: Full fetch complete (4969 records). [2025-10-09T19:34:55.710138] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-09T19:34:56.002184] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-09T19:34:56.084779] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-09T19:34:56.084855] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-09T19:34:56.085017] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-09T19:34:56.085057] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-09T19:34:56.085425] [DEBUG] [LOCAL ] IH: Trimmed 4969 records to 2870 (keeping 200 days of data) [2025-10-09T19:34:56.101933] [DEBUG] [LOCAL ] IH: Primary data saved (2870 records). [2025-10-09T19:34:56.101999] [INFO ] [MAIN ] IH: Full history saved. [2025-10-09T19:34:56.102069] [INFO ] [MAIN ] Update Progress: 1100/2373 symbols completed. IH took 42.8s. Estimated remaining: 2h 59m 14s. Rate: 7.1 symbols/min [2025-10-09T19:34:56.278087] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:56.286790] [DEBUG] [LOCAL ] IIF: Loaded 5659 existing records from primary storage. [2025-10-09T19:34:56.287008] [INFO ] [MAIN ] IIF: Loaded 5659 existing records. [2025-10-09T19:34:56.468350] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:56.468607] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-09T19:34:56.468697] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-09T19:34:56.468895] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-09T19:34:56.468954] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-09T19:34:56.804545] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-09T19:34:56.835631] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:34:57.252053] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T19:34:57.596703] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-09T19:34:57.932078] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:34:58.371112] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T19:34:58.396698] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-09T19:34:59.142671] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-09T19:34:59.144052] [INFO ] [REMOTE ] IHD: Full fetch complete (11910 records). [2025-10-09T19:34:59.144122] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-09T19:34:59.205725] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-09T19:34:59.508497] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-09T19:34:59.508578] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-09T19:34:59.508922] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-09T19:34:59.508999] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-09T19:34:59.509464] [DEBUG] [LOCAL ] IHD: Trimmed 11910 records to 7145 (keeping 200 days of data) [2025-10-09T19:34:59.550967] [DEBUG] [LOCAL ] IHD: Primary data saved (7145 records). [2025-10-09T19:34:59.551062] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-09T19:34:59.551144] [INFO ] [MAIN ] Update Progress: 1101/2373 symbols completed. IHD took 23.7s. Estimated remaining: 2h 58m 60s. Rate: 7.1 symbols/min [2025-10-09T19:34:59.718706] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:34:59.735815] [DEBUG] [LOCAL ] IIIN: Loaded 16149 existing records from primary storage. [2025-10-09T19:34:59.736065] [INFO ] [MAIN ] IIIN: Loaded 16149 existing records. [2025-10-09T19:34:59.911318] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:34:59.911518] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-09T19:34:59.911567] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-09T19:34:59.911803] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-09T19:34:59.911861] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-09T19:35:00.001819] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-09T19:35:00.053989] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-09T19:35:00.310905] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:00.796772] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-09T19:35:01.517151] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:35:01.596747] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-09T19:35:02.060706] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:35:02.355328] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T19:35:02.396685] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-09T19:35:03.196759] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-09T19:35:03.642427] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T19:35:03.996776] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-09T19:35:04.343397] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T19:35:04.652150] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T19:35:04.796715] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-09T19:35:05.596741] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-09T19:35:05.884734] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T19:35:06.377136] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T19:35:06.396759] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-09T19:35:07.196772] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-09T19:35:07.942792] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T19:35:07.996674] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-09T19:35:08.302739] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T19:35:08.304958] [INFO ] [REMOTE ] IHG: Full fetch complete (33743 records). [2025-10-09T19:35:08.305047] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-09T19:35:08.671004] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-09T19:35:08.671080] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-09T19:35:08.671716] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-09T19:35:08.671777] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-09T19:35:08.672490] [DEBUG] [LOCAL ] IHG: Trimmed 33743 records to 24344 (keeping 200 days of data) [2025-10-09T19:35:08.797421] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-09T19:35:08.843529] [DEBUG] [LOCAL ] IHG: Primary data saved (24344 records). [2025-10-09T19:35:08.843701] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-09T19:35:08.843805] [INFO ] [MAIN ] Update Progress: 1102/2373 symbols completed. IHG took 31.8s. Estimated remaining: 2h 58m 52s. Rate: 7.1 symbols/min [2025-10-09T19:35:09.011494] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:09.028094] [DEBUG] [LOCAL ] IIM: Loaded 15846 existing records from primary storage. [2025-10-09T19:35:09.028336] [INFO ] [MAIN ] IIM: Loaded 15846 existing records. [2025-10-09T19:35:09.211758] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:09.212228] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-09T19:35:09.212322] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-09T19:35:09.212569] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-09T19:35:09.212628] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-09T19:35:09.425187] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:35:09.499960] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T19:35:09.596820] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-09T19:35:09.617798] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:10.396801] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-09T19:35:10.708504] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T19:35:10.910933] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-09T19:35:11.196777] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-09T19:35:11.996696] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-09T19:35:12.052928] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:35:12.644870] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T19:35:12.796718] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-09T19:35:13.596768] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-09T19:35:14.350878] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T19:35:14.375735] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T19:35:14.396666] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-09T19:35:15.196796] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-09T19:35:15.902974] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-09T19:35:15.996766] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-09T19:35:16.586496] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:35:16.640969] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T19:35:16.796690] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-09T19:35:17.252368] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-09T19:35:17.253221] [INFO ] [REMOTE ] IIF: Full fetch complete (9169 records). [2025-10-09T19:35:17.253289] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-09T19:35:17.606869] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-09T19:35:17.615293] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-09T19:35:17.615350] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-09T19:35:17.615569] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-09T19:35:17.615608] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-09T19:35:17.616095] [DEBUG] [LOCAL ] IIF: Trimmed 9169 records to 5676 (keeping 200 days of data) [2025-10-09T19:35:17.650866] [DEBUG] [LOCAL ] IIF: Primary data saved (5676 records). [2025-10-09T19:35:17.650979] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-09T19:35:17.651059] [INFO ] [MAIN ] Update Progress: 1103/2373 symbols completed. IIF took 21.5s. Estimated remaining: 2h 58m 44s. Rate: 7.1 symbols/min [2025-10-09T19:35:17.816898] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:17.851159] [DEBUG] [LOCAL ] IIPR: Loaded 29456 existing records from primary storage. [2025-10-09T19:35:17.851423] [INFO ] [MAIN ] IIPR: Loaded 29456 existing records. [2025-10-09T19:35:18.024762] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:18.025018] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-09T19:35:18.025066] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-09T19:35:18.025285] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-09T19:35:18.025345] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-09T19:35:18.385885] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:18.396685] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-09T19:35:18.970525] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:35:19.196759] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-09T19:35:19.455102] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T19:35:19.996825] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-09T19:35:20.552452] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T19:35:20.555482] [INFO ] [REMOTE ] IHS: Full fetch complete (51443 records). [2025-10-09T19:35:20.555598] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-09T19:35:20.805914] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-09T19:35:20.933350] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T19:35:20.963209] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-09T19:35:20.963354] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-09T19:35:20.965694] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-09T19:35:20.965775] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-09T19:35:20.966844] [DEBUG] [LOCAL ] IHS: Trimmed 51443 records to 38498 (keeping 200 days of data) [2025-10-09T19:35:21.185536] [DEBUG] [LOCAL ] IHS: Primary data saved (38498 records). [2025-10-09T19:35:21.185711] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-09T19:35:21.186927] [INFO ] [MAIN ] Update Progress: 1104/2373 symbols completed. IHS took 42.6s. Estimated remaining: 2h 58m 30s. Rate: 7.1 symbols/min [2025-10-09T19:35:21.352688] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:21.402296] [DEBUG] [LOCAL ] IMAX: Loaded 42877 existing records from primary storage. [2025-10-09T19:35:21.402632] [INFO ] [MAIN ] IMAX: Loaded 42877 existing records. [2025-10-09T19:35:21.578685] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:21.578936] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-09T19:35:21.578986] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-09T19:35:21.579276] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-09T19:35:21.579335] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-09T19:35:21.608999] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-09T19:35:21.902176] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:35:21.963913] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:22.358120] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-09T19:35:22.396686] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-09T19:35:23.196761] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-09T19:35:23.416817] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:35:23.996693] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-09T19:35:24.177923] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-09T19:35:24.796683] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-09T19:35:25.172513] [DEBUG] [REMOTE ] IIIN: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-09T19:35:25.172878] [WARN ] [REMOTE ] IIIN: No data returned for month 2025-06 [2025-10-09T19:35:25.172980] [FATAL] [REMOTE ] IIIN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:35:25.173063] [FATAL] [MAIN ] IIIN: Failed to fetch primary data. [2025-10-09T19:35:25.173125] [WARN ] [MAIN ] IIIN: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:35:25.173197] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-09T19:35:25.173275] [DEBUG] [LOCAL ] IIIN: No primary data file found to delete. [2025-10-09T19:35:25.173331] [INFO ] [LOCAL ] IIIN: Starting deletion of derivative data. [2025-10-09T19:35:25.173945] [DEBUG] [LOCAL ] IIIN: Deleted derivative data file. [2025-10-09T19:35:25.174060] [INFO ] [MAIN ] Update Progress: 1105/2373 symbols completed. IIIN took 25.6s. Estimated remaining: 2h 58m 17s. Rate: 7.1 symbols/min [2025-10-09T19:35:25.365418] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:25.366849] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T19:35:25.422929] [DEBUG] [LOCAL ] INFA: Loaded 49319 existing records from primary storage. [2025-10-09T19:35:25.423300] [INFO ] [MAIN ] INFA: Loaded 49319 existing records. [2025-10-09T19:35:25.600045] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-09T19:35:25.599897] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:25.600533] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-09T19:35:25.601514] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-09T19:35:25.601819] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-09T19:35:25.601878] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-09T19:35:25.948639] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:26.396787] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-09T19:35:26.977969] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T19:35:27.196781] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-09T19:35:27.682574] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T19:35:27.996785] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-09T19:35:28.796742] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-09T19:35:28.876609] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T19:35:29.384312] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-09T19:35:29.587419] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T19:35:29.596671] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-09T19:35:30.396758] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-09T19:35:30.719376] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-09T19:35:31.196726] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-09T19:35:31.938813] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:35:31.996715] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-09T19:35:32.436193] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T19:35:32.796725] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-09T19:35:33.543801] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-09T19:35:33.596671] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-09T19:35:33.962772] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T19:35:34.396727] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-09T19:35:35.196756] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-09T19:35:35.333093] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:35:35.397116] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T19:35:35.996742] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-09T19:35:36.545741] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T19:35:36.796719] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-09T19:35:36.981450] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T19:35:37.596724] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-09T19:35:38.303137] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:35:38.377620] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T19:35:38.396676] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-09T19:35:39.196724] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-09T19:35:39.889096] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-09T19:35:39.996684] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-09T19:35:40.796686] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-09T19:35:40.986276] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T19:35:41.592264] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T19:35:41.601910] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-09T19:35:41.703741] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-09T19:35:42.396747] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-09T19:35:43.138338] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T19:35:43.159009] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T19:35:43.196675] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-09T19:35:43.892529] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T19:35:43.996672] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-09T19:35:44.796758] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-09T19:35:45.596735] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-09T19:35:45.874417] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-09T19:35:45.923228] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T19:35:46.396709] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-09T19:35:46.688523] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-09T19:35:47.060909] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T19:35:47.062862] [INFO ] [REMOTE ] IIM: Full fetch complete (25373 records). [2025-10-09T19:35:47.062936] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-09T19:35:47.203826] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-09T19:35:47.442794] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-09T19:35:47.442876] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-09T19:35:47.443394] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-09T19:35:47.443433] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-09T19:35:47.444160] [DEBUG] [LOCAL ] IIM: Trimmed 25373 records to 15957 (keeping 200 days of data) [2025-10-09T19:35:47.542887] [DEBUG] [LOCAL ] IIM: Primary data saved (15957 records). [2025-10-09T19:35:47.543031] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-09T19:35:47.543119] [INFO ] [MAIN ] Update Progress: 1106/2373 symbols completed. IIM took 38.7s. Estimated remaining: 2h 58m 24s. Rate: 7.1 symbols/min [2025-10-09T19:35:47.719544] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:47.772500] [DEBUG] [LOCAL ] INFY: Loaded 53594 existing records from primary storage. [2025-10-09T19:35:47.772850] [INFO ] [MAIN ] INFY: Loaded 53594 existing records. [2025-10-09T19:35:47.961613] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:47.961838] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-09T19:35:47.961885] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-09T19:35:47.962111] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-09T19:35:47.962195] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-09T19:35:48.003470] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-09T19:35:48.318747] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:48.671634] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T19:35:48.674660] [INFO ] [REMOTE ] IIPR: Full fetch complete (44746 records). [2025-10-09T19:35:48.674762] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-09T19:35:48.801824] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-09T19:35:49.082062] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-09T19:35:49.082134] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-09T19:35:49.082868] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-09T19:35:49.082931] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-09T19:35:49.083999] [DEBUG] [LOCAL ] IIPR: Trimmed 44746 records to 29611 (keeping 200 days of data) [2025-10-09T19:35:49.278373] [DEBUG] [LOCAL ] IIPR: Primary data saved (29611 records). [2025-10-09T19:35:49.278523] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-09T19:35:49.278611] [INFO ] [MAIN ] Update Progress: 1107/2373 symbols completed. IIPR took 31.6s. Estimated remaining: 2h 58m 8s. Rate: 7.1 symbols/min [2025-10-09T19:35:49.456127] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:35:49.514751] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T19:35:49.540968] [DEBUG] [LOCAL ] ING: Loaded 50706 existing records from primary storage. [2025-10-09T19:35:49.541348] [INFO ] [MAIN ] ING: Loaded 50706 existing records. [2025-10-09T19:35:49.605750] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-09T19:35:49.724878] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:35:49.725102] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-09T19:35:49.725156] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-09T19:35:49.725334] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-09T19:35:49.725374] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-09T19:35:50.102081] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:35:50.396767] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-09T19:35:50.895699] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-09T19:35:50.975146] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T19:35:51.196716] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-09T19:35:51.996684] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-09T19:35:52.099100] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T19:35:52.541733] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-09T19:35:52.796717] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-09T19:35:53.346106] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-09T19:35:53.596771] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-09T19:35:54.345277] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:35:54.396760] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-09T19:35:54.985888] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-09T19:35:55.196789] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-09T19:35:55.996701] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-09T19:35:56.030537] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:35:56.562711] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T19:35:56.796721] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-09T19:35:57.279122] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T19:35:57.596757] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-09T19:35:58.396715] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-09T19:35:58.651796] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T19:35:59.066831] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T19:35:59.196772] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-09T19:35:59.705048] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T19:35:59.996743] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-09T19:36:00.796756] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-09T19:36:00.879397] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T19:36:01.334302] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:36:01.338125] [INFO ] [REMOTE ] IMAX: Full fetch complete (60112 records). [2025-10-09T19:36:01.338229] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-09T19:36:01.601934] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-09T19:36:01.758567] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-09T19:36:01.758693] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-09T19:36:01.759618] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-09T19:36:01.759694] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-09T19:36:01.760928] [DEBUG] [LOCAL ] IMAX: Trimmed 60112 records to 43236 (keeping 200 days of data) [2025-10-09T19:36:02.048733] [DEBUG] [LOCAL ] IMAX: Primary data saved (43236 records). [2025-10-09T19:36:02.048915] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-09T19:36:02.049039] [INFO ] [MAIN ] Update Progress: 1108/2373 symbols completed. IMAX took 40.9s. Estimated remaining: 2h 58m 5s. Rate: 7.1 symbols/min [2025-10-09T19:36:02.229423] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:02.261671] [DEBUG] [LOCAL ] INGM: Loaded 28664 existing records from primary storage. [2025-10-09T19:36:02.261958] [INFO ] [MAIN ] INGM: Loaded 28664 existing records. [2025-10-09T19:36:02.412468] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-09T19:36:02.442975] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:02.444372] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-09T19:36:02.444458] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-09T19:36:02.444804] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-09T19:36:02.444916] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-09T19:36:02.651791] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-09T19:36:02.845541] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:03.145413] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T19:36:03.196749] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-09T19:36:03.966928] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T19:36:03.996668] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-09T19:36:04.607014] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:36:04.796707] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-09T19:36:05.504039] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T19:36:05.596695] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-09T19:36:06.051368] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:36:06.396782] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-09T19:36:07.196728] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-09T19:36:07.533668] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-09T19:36:07.560945] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T19:36:07.996759] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-09T19:36:08.796741] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-09T19:36:08.998534] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-09T19:36:09.093578] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-09T19:36:09.596723] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-09T19:36:09.818687] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-09T19:36:09.822324] [INFO ] [REMOTE ] INFA: Full fetch complete (70865 records). [2025-10-09T19:36:09.822453] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-09T19:36:10.230683] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-09T19:36:10.230774] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-09T19:36:10.232371] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-09T19:36:10.232446] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-09T19:36:10.233919] [DEBUG] [LOCAL ] INFA: Trimmed 70865 records to 49552 (keeping 200 days of data) [2025-10-09T19:36:10.406367] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-09T19:36:10.534587] [DEBUG] [LOCAL ] INFA: Primary data saved (49552 records). [2025-10-09T19:36:10.534758] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-09T19:36:10.534866] [INFO ] [MAIN ] Update Progress: 1109/2373 symbols completed. INFA took 45.4s. Estimated remaining: 2h 57m 56s. Rate: 7.1 symbols/min [2025-10-09T19:36:10.706635] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:10.740026] [DEBUG] [LOCAL ] INGR: Loaded 33594 existing records from primary storage. [2025-10-09T19:36:10.740309] [INFO ] [MAIN ] INGR: Loaded 33594 existing records. [2025-10-09T19:36:10.915513] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:10.915834] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-09T19:36:10.915897] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-09T19:36:10.916103] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-09T19:36:10.916160] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-09T19:36:11.212181] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-09T19:36:11.266706] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:11.490588] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-09T19:36:11.820786] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T19:36:11.996748] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-09T19:36:12.684773] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T19:36:12.796747] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-09T19:36:13.338488] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T19:36:13.596746] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-09T19:36:14.396675] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-09T19:36:14.439965] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T19:36:14.795755] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T19:36:15.196782] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-09T19:36:15.873876] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T19:36:15.996669] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-09T19:36:16.299461] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-09T19:36:16.796802] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-09T19:36:17.153287] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-09T19:36:17.596742] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-09T19:36:18.396690] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-09T19:36:18.450126] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-09T19:36:18.680964] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T19:36:19.196739] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-09T19:36:19.927837] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T19:36:19.996809] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-09T19:36:20.796712] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-09T19:36:20.839956] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T19:36:21.191376] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T19:36:21.596718] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-09T19:36:21.796735] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-09T19:36:22.396749] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-09T19:36:23.196706] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-09T19:36:23.324307] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-09T19:36:23.325458] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-09T19:36:23.996718] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-09T19:36:24.796708] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-09T19:36:25.063922] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-09T19:36:25.075488] [INFO ] [REMOTE ] INFY: Full fetch complete (77545 records). [2025-10-09T19:36:25.076269] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T19:36:25.077354] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-09T19:36:25.079575] [INFO ] [REMOTE ] INGM: Full fetch complete (42142 records). [2025-10-09T19:36:25.079694] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-09T19:36:25.612797] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-09T19:36:25.924366] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-09T19:36:25.924232] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-09T19:36:25.924477] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-09T19:36:25.925008] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-09T19:36:25.925155] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-09T19:36:25.925092] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-09T19:36:25.926492] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-09T19:36:25.926894] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-09T19:36:25.927812] [DEBUG] [LOCAL ] INGM: Trimmed 42142 records to 28891 (keeping 200 days of data) [2025-10-09T19:36:25.929065] [DEBUG] [LOCAL ] INFY: Trimmed 77545 records to 53984 (keeping 200 days of data) [2025-10-09T19:36:26.336995] [DEBUG] [LOCAL ] INGM: Primary data saved (28891 records). [2025-10-09T19:36:26.337984] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-09T19:36:26.338449] [INFO ] [MAIN ] Update Progress: 1110/2373 symbols completed. INGM took 24.3s. Estimated remaining: 2h 57m 56s. Rate: 7.1 symbols/min [2025-10-09T19:36:26.528268] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:26.565702] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T19:36:26.580066] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-09T19:36:26.680795] [DEBUG] [LOCAL ] INN: Loaded 41765 existing records from primary storage. [2025-10-09T19:36:26.681998] [INFO ] [MAIN ] INN: Loaded 41765 existing records. [2025-10-09T19:36:26.873677] [DEBUG] [LOCAL ] INFY: Primary data saved (53984 records). [2025-10-09T19:36:26.895508] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:26.895896] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-09T19:36:26.895779] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-09T19:36:26.896705] [INFO ] [MAIN ] Update Progress: 1111/2373 symbols completed. INFY took 39.4s. Estimated remaining: 2h 57m 39s. Rate: 7.1 symbols/min [2025-10-09T19:36:26.908791] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-09T19:36:26.953723] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-09T19:36:26.967884] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-09T19:36:27.259491] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:27.302037] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-09T19:36:27.325716] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-09T19:36:27.373783] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-09T19:36:27.385965] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-09T19:36:27.388250] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-09T19:36:27.406095] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-09T19:36:27.422876] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-09T19:36:27.422991] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-09T19:36:27.488090] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:27.862524] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:27.996693] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-09T19:36:28.248509] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T19:36:28.343071] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:36:28.796730] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-09T19:36:29.372876] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-09T19:36:29.596733] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-09T19:36:29.790841] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:36:29.791161] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-09T19:36:29.791273] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:36:29.791334] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-09T19:36:29.791371] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:36:29.791410] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-09T19:36:29.791466] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-09T19:36:29.791502] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-09T19:36:29.791543] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-09T19:36:29.791590] [INFO ] [MAIN ] Update Progress: 1112/2373 symbols completed. INR took 2.9s. Estimated remaining: 2h 57m 24s. Rate: 7.1 symbols/min [2025-10-09T19:36:29.980470] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:30.019445] [DEBUG] [LOCAL ] INSP: Loaded 37638 existing records from primary storage. [2025-10-09T19:36:30.019811] [INFO ] [MAIN ] INSP: Loaded 37638 existing records. [2025-10-09T19:36:30.204723] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:30.205087] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-09T19:36:30.205197] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-09T19:36:30.215684] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-09T19:36:30.215804] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-09T19:36:30.247891] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:36:30.311143] [INFO ] [REMOTE ] ING: Full fetch complete (73611 records). [2025-10-09T19:36:30.321305] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-09T19:36:30.401838] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-09T19:36:30.914444] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:31.012358] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-09T19:36:31.012451] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-09T19:36:31.013467] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-09T19:36:31.013538] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-09T19:36:31.015174] [DEBUG] [LOCAL ] ING: Trimmed 73611 records to 51085 (keeping 200 days of data) [2025-10-09T19:36:31.198457] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-09T19:36:31.334419] [DEBUG] [LOCAL ] ING: Primary data saved (51085 records). [2025-10-09T19:36:31.334566] [INFO ] [MAIN ] ING: Full history saved. [2025-10-09T19:36:31.334672] [INFO ] [MAIN ] Update Progress: 1113/2373 symbols completed. ING took 42.1s. Estimated remaining: 2h 57m 8s. Rate: 7.1 symbols/min [2025-10-09T19:36:31.507513] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:31.543989] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:36:31.594565] [DEBUG] [LOCAL ] INSW: Loaded 39755 existing records from primary storage. [2025-10-09T19:36:31.595546] [INFO ] [MAIN ] INSW: Loaded 39755 existing records. [2025-10-09T19:36:31.787907] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:31.788248] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-09T19:36:31.788314] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-09T19:36:31.788603] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-09T19:36:31.788701] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-09T19:36:32.005634] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-09T19:36:32.194694] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:32.474685] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T19:36:32.796726] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-09T19:36:33.349533] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-09T19:36:33.596728] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-09T19:36:34.396751] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-09T19:36:34.455340] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T19:36:35.047829] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-09T19:36:35.196697] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-09T19:36:35.653889] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T19:36:35.996725] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-09T19:36:36.786835] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T19:36:36.796671] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-09T19:36:37.287432] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T19:36:37.596760] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-09T19:36:37.949587] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-09T19:36:38.396746] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-09T19:36:38.623224] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T19:36:39.196735] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-09T19:36:39.920185] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T19:36:39.996671] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-09T19:36:40.307013] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:36:40.796722] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-09T19:36:41.221009] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T19:36:41.596717] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-09T19:36:42.275273] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-09T19:36:42.396720] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-09T19:36:43.155033] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T19:36:43.196668] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-09T19:36:43.407762] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T19:36:43.411488] [INFO ] [REMOTE ] INGR: Full fetch complete (50433 records). [2025-10-09T19:36:43.411617] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-09T19:36:43.783262] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-09T19:36:43.783352] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-09T19:36:43.784152] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-09T19:36:43.784215] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-09T19:36:43.785229] [DEBUG] [LOCAL ] INGR: Trimmed 50433 records to 33896 (keeping 200 days of data) [2025-10-09T19:36:43.996922] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-09T19:36:44.001484] [DEBUG] [LOCAL ] INGR: Primary data saved (33896 records). [2025-10-09T19:36:44.001575] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-09T19:36:44.001683] [INFO ] [MAIN ] Update Progress: 1114/2373 symbols completed. INGR took 33.5s. Estimated remaining: 2h 57m 4s. Rate: 7.1 symbols/min [2025-10-09T19:36:44.170930] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:44.222259] [DEBUG] [LOCAL ] INVH: Loaded 53162 existing records from primary storage. [2025-10-09T19:36:44.222576] [INFO ] [MAIN ] INVH: Loaded 53162 existing records. [2025-10-09T19:36:44.401586] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:44.401850] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-09T19:36:44.401906] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-09T19:36:44.402133] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-09T19:36:44.402190] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-09T19:36:44.727275] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T19:36:44.791970] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:44.796679] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-09T19:36:45.585981] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-09T19:36:45.596669] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-09T19:36:45.683571] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-09T19:36:46.396702] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-09T19:36:46.779901] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:36:47.196740] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-09T19:36:47.711699] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:36:47.996691] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-09T19:36:48.720852] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:36:48.796675] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-09T19:36:49.374065] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T19:36:49.596733] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-09T19:36:50.138683] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:36:50.396711] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-09T19:36:50.953044] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T19:36:51.196729] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-09T19:36:51.448525] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-09T19:36:51.452036] [INFO ] [REMOTE ] INN: Full fetch complete (57810 records). [2025-10-09T19:36:51.452132] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-09T19:36:51.854785] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-09T19:36:51.854868] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-09T19:36:51.855784] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-09T19:36:51.855880] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-09T19:36:51.857062] [DEBUG] [LOCAL ] INN: Trimmed 57810 records to 42044 (keeping 200 days of data) [2025-10-09T19:36:52.023745] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-09T19:36:52.110942] [DEBUG] [LOCAL ] INN: Primary data saved (42044 records). [2025-10-09T19:36:52.111066] [INFO ] [MAIN ] INN: Full history saved. [2025-10-09T19:36:52.111159] [INFO ] [MAIN ] Update Progress: 1115/2373 symbols completed. INN took 25.8s. Estimated remaining: 2h 56m 55s. Rate: 7.1 symbols/min [2025-10-09T19:36:52.277832] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:36:52.310006] [DEBUG] [LOCAL ] INVX: Loaded 29189 existing records from primary storage. [2025-10-09T19:36:52.310322] [INFO ] [MAIN ] INVX: Loaded 29189 existing records. [2025-10-09T19:36:52.499787] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:36:52.499988] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-09T19:36:52.500035] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-09T19:36:52.500252] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-09T19:36:52.500310] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-09T19:36:52.800157] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-09T19:36:52.869007] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:36:52.895790] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-09T19:36:53.513752] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T19:36:53.596683] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-09T19:36:54.354394] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T19:36:54.396726] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-09T19:36:55.196726] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-09T19:36:55.340675] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-09T19:36:55.721793] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T19:36:55.996762] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-09T19:36:56.368732] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T19:36:56.796722] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-09T19:36:57.392752] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:36:57.596727] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-09T19:36:58.396700] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-09T19:36:58.433921] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T19:36:58.955517] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:36:59.196773] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-09T19:36:59.557006] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-09T19:36:59.996778] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-09T19:37:00.796739] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-09T19:37:01.107612] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-09T19:37:01.260395] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:37:01.596772] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-09T19:37:02.254316] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T19:37:02.396696] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-09T19:37:03.096093] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T19:37:03.196672] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-09T19:37:03.295455] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-09T19:37:03.996733] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-09T19:37:04.276948] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-09T19:37:04.280238] [INFO ] [REMOTE ] INSW: Full fetch complete (60234 records). [2025-10-09T19:37:04.280354] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-09T19:37:04.678601] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-09T19:37:04.678713] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-09T19:37:04.679551] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-09T19:37:04.679597] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-09T19:37:04.680783] [DEBUG] [LOCAL ] INSW: Trimmed 60234 records to 40038 (keeping 200 days of data) [2025-10-09T19:37:04.796818] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-09T19:37:04.929240] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T19:37:04.966565] [DEBUG] [LOCAL ] INSW: Primary data saved (40038 records). [2025-10-09T19:37:04.966745] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-09T19:37:04.966844] [INFO ] [MAIN ] Update Progress: 1116/2373 symbols completed. INSW took 33.6s. Estimated remaining: 2h 56m 52s. Rate: 7.1 symbols/min [2025-10-09T19:37:05.133617] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:05.184751] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-09T19:37:05.185101] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-09T19:37:05.369386] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:05.369697] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-09T19:37:05.369758] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-09T19:37:05.370105] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-09T19:37:05.370162] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-09T19:37:05.606950] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-09T19:37:05.771244] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:06.396688] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-09T19:37:06.431379] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-09T19:37:06.816720] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-09T19:37:07.196761] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-09T19:37:07.996706] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-09T19:37:08.249462] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-09T19:37:08.449184] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T19:37:08.796740] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-09T19:37:09.527060] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-09T19:37:09.596704] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-09T19:37:09.636371] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-09T19:37:10.396722] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-09T19:37:11.167253] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:37:11.196696] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-09T19:37:11.996786] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-09T19:37:12.796776] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-09T19:37:12.933968] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:37:13.217749] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-10-09T19:37:13.266232] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-09T19:37:13.596726] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-09T19:37:14.402575] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-09T19:37:14.418090] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:37:15.196751] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-09T19:37:15.913846] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-09T19:37:15.996672] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-09T19:37:16.110714] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T19:37:16.115560] [INFO ] [REMOTE ] INVH: Full fetch complete (76740 records). [2025-10-09T19:37:16.115744] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-09T19:37:16.517241] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-09T19:37:16.517341] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-09T19:37:16.518456] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-09T19:37:16.518538] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-09T19:37:16.520107] [DEBUG] [LOCAL ] INVH: Trimmed 76740 records to 53549 (keeping 200 days of data) [2025-10-09T19:37:16.818695] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-09T19:37:16.857455] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-09T19:37:16.862808] [INFO ] [REMOTE ] INSP: Full fetch complete (53303 records). [2025-10-09T19:37:16.863462] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-09T19:37:17.268904] [DEBUG] [LOCAL ] INVH: Primary data saved (53549 records). [2025-10-09T19:37:17.278283] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-09T19:37:17.278420] [INFO ] [MAIN ] Update Progress: 1117/2373 symbols completed. INVH took 33.3s. Estimated remaining: 2h 56m 48s. Rate: 7.1 symbols/min [2025-10-09T19:37:17.312762] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-09T19:37:17.312867] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-09T19:37:17.313753] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-09T19:37:17.313881] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-09T19:37:17.315142] [DEBUG] [LOCAL ] INSP: Trimmed 53303 records to 37994 (keeping 200 days of data) [2025-10-09T19:37:17.552503] [DEBUG] [LOCAL ] INSP: Primary data saved (37994 records). [2025-10-09T19:37:17.552695] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-09T19:37:17.553509] [INFO ] [MAIN ] Update Progress: 1118/2373 symbols completed. INSP took 47.8s. Estimated remaining: 2h 56m 30s. Rate: 7.1 symbols/min [2025-10-09T19:37:18.065904] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-09T19:37:18.072518] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-09T19:37:18.210580] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-09T19:37:18.396742] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-09T19:37:19.242821] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-09T19:37:19.249008] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-09T19:37:20.368332] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T19:37:20.372024] [INFO ] [REMOTE ] INVX: Full fetch complete (43627 records). [2025-10-09T19:37:20.372274] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-09T19:37:20.792196] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-09T19:37:20.792407] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-09T19:37:20.793242] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-09T19:37:20.793316] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-09T19:37:20.794288] [DEBUG] [LOCAL ] INVX: Trimmed 43627 records to 29349 (keeping 200 days of data) [2025-10-09T19:37:20.967861] [DEBUG] [LOCAL ] INVX: Primary data saved (29349 records). [2025-10-09T19:37:20.968239] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-09T19:37:20.968335] [INFO ] [MAIN ] Update Progress: 1119/2373 symbols completed. INVX took 28.9s. Estimated remaining: 2h 56m 16s. Rate: 7.1 symbols/min [2025-10-09T19:37:21.054557] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-09T19:37:21.065810] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-09T19:37:23.782292] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-09T19:37:23.793472] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-09T19:37:26.478044] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-09T19:37:26.493260] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-09T19:37:28.950406] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-09T19:37:28.961532] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-09T19:37:31.550788] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-09T19:37:31.563251] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-09T19:37:34.151824] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-09T19:37:34.164529] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-09T19:37:36.831508] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-09T19:37:36.843128] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-09T19:37:39.467455] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-09T19:37:39.471969] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-09T19:37:39.472081] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-09T19:37:39.871229] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-09T19:37:39.871316] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-09T19:37:39.872331] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-09T19:37:39.872399] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-09T19:37:39.874018] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54178 (keeping 200 days of data) [2025-10-09T19:37:40.196115] [DEBUG] [LOCAL ] IONQ: Primary data saved (54178 records). [2025-10-09T19:37:40.196253] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-09T19:37:40.196353] [INFO ] [MAIN ] Update Progress: 1120/2373 symbols completed. IONQ took 35.2s. Estimated remaining: 2h 56m 20s. Rate: 7.1 symbols/min [2025-10-09T19:37:40.762408] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:40.868753] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:40.924359] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:40.923479] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:40.952081] [DEBUG] [LOCAL ] IPI: Loaded 21556 existing records from primary storage. [2025-10-09T19:37:40.952534] [INFO ] [MAIN ] IPI: Loaded 21556 existing records. [2025-10-09T19:37:41.179308] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:41.194626] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-09T19:37:41.194870] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-09T19:37:41.210208] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-09T19:37:41.210136] [DEBUG] [LOCAL ] IOT: Loaded 53475 existing records from primary storage. [2025-10-09T19:37:41.211096] [DEBUG] [LOCAL ] IP: Loaded 53317 existing records from primary storage. [2025-10-09T19:37:41.211799] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-09T19:37:41.211616] [INFO ] [MAIN ] IOT: Loaded 53475 existing records. [2025-10-09T19:37:41.232897] [INFO ] [MAIN ] IP: Loaded 53317 existing records. [2025-10-09T19:37:41.445956] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-09T19:37:41.540281] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-09T19:37:41.960467] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:42.025769] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-09T19:37:42.045028] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:42.045176] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-09T19:37:42.055820] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-09T19:37:42.071352] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-09T19:37:42.076817] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-09T19:37:42.076919] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-09T19:37:42.103736] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-09T19:37:42.120910] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-09T19:37:42.354278] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:42.401590] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-09T19:37:42.460178] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:42.472325] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-09T19:37:42.478811] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-09T19:37:42.494685] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-09T19:37:42.500972] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-09T19:37:43.270426] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:43.310727] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-09T19:37:43.337170] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:43.348168] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-09T19:37:43.449364] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:43.449757] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-09T19:37:43.557815] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T19:37:43.561974] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-09T19:37:44.477478] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T19:37:44.481393] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-09T19:37:44.872889] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:37:44.885004] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-09T19:37:44.957588] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-09T19:37:44.969619] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-09T19:37:45.029873] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-09T19:37:45.041374] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-09T19:37:45.432277] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-09T19:37:45.436388] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-09T19:37:46.609056] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T19:37:46.620330] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-09T19:37:46.654428] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T19:37:46.681384] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-09T19:37:46.683277] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-09T19:37:46.688805] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-09T19:37:46.842387] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T19:37:46.853527] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-09T19:37:47.821752] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:37:47.827827] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-09T19:37:48.035348] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-09T19:37:48.045685] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-09T19:37:48.107057] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T19:37:48.117625] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-09T19:37:48.598234] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T19:37:48.608832] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-09T19:37:49.079468] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-09T19:37:49.085612] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-09T19:37:49.710700] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:37:49.722935] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-09T19:37:49.754721] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:37:49.767239] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-09T19:37:50.090589] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-09T19:37:50.095369] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-09T19:37:50.550590] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-09T19:37:50.561849] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-09T19:37:51.064822] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-09T19:37:51.069383] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-09T19:37:51.363370] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T19:37:51.375509] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-09T19:37:51.480404] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T19:37:51.492052] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-09T19:37:52.070193] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-09T19:37:52.075156] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-09T19:37:52.111585] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:37:52.123086] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-09T19:37:52.857098] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-09T19:37:52.868937] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-09T19:37:52.882377] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-09T19:37:52.887371] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-09T19:37:53.263423] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:37:53.274903] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-09T19:37:53.977461] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:37:53.997803] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-09T19:37:53.998064] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T19:37:54.002826] [INFO ] [REMOTE ] IPI: Full fetch complete (29600 records). [2025-10-09T19:37:54.003108] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-09T19:37:54.395256] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-09T19:37:54.395429] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-09T19:37:54.396316] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-09T19:37:54.396401] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-09T19:37:54.397469] [DEBUG] [LOCAL ] IPI: Trimmed 29600 records to 21686 (keeping 200 days of data) [2025-10-09T19:37:54.527231] [DEBUG] [LOCAL ] IPI: Primary data saved (21686 records). [2025-10-09T19:37:54.527376] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-09T19:37:54.527465] [INFO ] [MAIN ] Update Progress: 1121/2373 symbols completed. IPI took 14.3s. Estimated remaining: 2h 56m 18s. Rate: 7.1 symbols/min [2025-10-09T19:37:54.710702] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:37:54.741840] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T19:37:54.759715] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-09T19:37:54.801066] [DEBUG] [LOCAL ] IQI: Loaded 17978 existing records from primary storage. [2025-10-09T19:37:54.801555] [INFO ] [MAIN ] IQI: Loaded 17978 existing records. [2025-10-09T19:37:54.838422] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T19:37:54.919999] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-09T19:37:55.000365] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:37:55.000616] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-09T19:37:55.000697] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-09T19:37:55.000944] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-09T19:37:55.001003] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-09T19:37:55.348783] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:37:55.349123] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-09T19:37:55.429104] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:37:55.441946] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-09T19:37:56.372812] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-09T19:37:56.377917] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-09T19:37:56.565359] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:37:56.584007] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-09T19:37:56.785975] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T19:37:56.798062] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-09T19:37:57.011688] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-09T19:37:57.015905] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-09T19:37:57.437784] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T19:37:57.596779] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-09T19:37:58.112852] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T19:37:58.140196] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T19:37:58.202068] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-09T19:37:58.396774] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-09T19:37:59.196728] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-09T19:37:59.347786] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T19:37:59.996786] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-09T19:38:00.227556] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:38:00.796747] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-09T19:38:01.074902] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T19:38:01.596694] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-09T19:38:01.786513] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-09T19:38:02.396683] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-09T19:38:02.536112] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-09T19:38:02.641279] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-09T19:38:02.645787] [INFO ] [REMOTE ] IP: Full fetch complete (77164 records). [2025-10-09T19:38:02.645893] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-09T19:38:03.069399] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-09T19:38:03.069523] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-09T19:38:03.071851] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-09T19:38:03.071928] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-09T19:38:03.073640] [DEBUG] [LOCAL ] IP: Trimmed 77164 records to 53701 (keeping 200 days of data) [2025-10-09T19:38:03.197556] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-09T19:38:03.414239] [DEBUG] [LOCAL ] IP: Primary data saved (53701 records). [2025-10-09T19:38:03.414401] [INFO ] [MAIN ] IP: Full history saved. [2025-10-09T19:38:03.415062] [INFO ] [MAIN ] Update Progress: 1122/2373 symbols completed. IP took 23.2s. Estimated remaining: 2h 56m 10s. Rate: 7.1 symbols/min [2025-10-09T19:38:03.581232] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:03.628873] [DEBUG] [LOCAL ] IQV: Loaded 50072 existing records from primary storage. [2025-10-09T19:38:03.629211] [INFO ] [MAIN ] IQV: Loaded 50072 existing records. [2025-10-09T19:38:03.809409] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:03.809675] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-09T19:38:03.809740] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-09T19:38:03.809981] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-09T19:38:03.810037] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-09T19:38:04.005349] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-09T19:38:04.167609] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:04.179858] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T19:38:04.184479] [INFO ] [REMOTE ] IOT: Full fetch complete (77391 records). [2025-10-09T19:38:04.184679] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-09T19:38:04.700765] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-09T19:38:04.700955] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-09T19:38:04.702927] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-09T19:38:04.703039] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-09T19:38:04.705214] [DEBUG] [LOCAL ] IOT: Trimmed 77391 records to 53862 (keeping 200 days of data) [2025-10-09T19:38:04.847243] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-09T19:38:05.048993] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-09T19:38:05.060122] [INFO ] [REMOTE ] IPG: Full fetch complete (77251 records). [2025-10-09T19:38:05.062089] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-09T19:38:05.386911] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-09T19:38:05.597806] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-09T19:38:05.698630] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-09T19:38:05.699268] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-09T19:38:05.700440] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-09T19:38:05.700528] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-09T19:38:05.707718] [DEBUG] [LOCAL ] IPG: Trimmed 77251 records to 53718 (keeping 200 days of data) [2025-10-09T19:38:05.810795] [DEBUG] [LOCAL ] IOT: Primary data saved (53862 records). [2025-10-09T19:38:05.812387] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-09T19:38:05.812549] [INFO ] [MAIN ] Update Progress: 1123/2373 symbols completed. IOT took 25.6s. Estimated remaining: 2h 55m 55s. Rate: 7.1 symbols/min [2025-10-09T19:38:06.037092] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:06.219415] [DEBUG] [LOCAL ] IR: Loaded 52750 existing records from primary storage. [2025-10-09T19:38:06.223784] [INFO ] [MAIN ] IR: Loaded 52750 existing records. [2025-10-09T19:38:06.502018] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:06.508418] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-09T19:38:06.513703] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-09T19:38:06.514954] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-09T19:38:06.516598] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-09T19:38:06.583423] [DEBUG] [LOCAL ] IPG: Primary data saved (53718 records). [2025-10-09T19:38:06.591684] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-09T19:38:06.592102] [INFO ] [MAIN ] Update Progress: 1124/2373 symbols completed. IPG took 26.4s. Estimated remaining: 2h 55m 38s. Rate: 7.1 symbols/min [2025-10-09T19:38:06.749609] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-09T19:38:06.780940] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-09T19:38:07.059148] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:07.108972] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-09T19:38:07.188787] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:07.205077] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-09T19:38:07.226597] [DEBUG] [LOCAL ] IRM: Loaded 49267 existing records from primary storage. [2025-10-09T19:38:07.227009] [INFO ] [MAIN ] IRM: Loaded 49267 existing records. [2025-10-09T19:38:07.407818] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:07.408132] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-09T19:38:07.408948] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-09T19:38:07.409194] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-09T19:38:07.409251] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-09T19:38:07.739792] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-09T19:38:07.831844] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:07.996695] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-09T19:38:08.796752] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-09T19:38:08.830725] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T19:38:09.596711] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-09T19:38:09.802515] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T19:38:09.825743] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:38:10.396740] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-09T19:38:10.952611] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-09T19:38:11.196757] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-09T19:38:11.996731] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-09T19:38:12.066866] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-09T19:38:12.605446] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:38:12.796826] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-09T19:38:13.464931] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T19:38:13.596719] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-09T19:38:14.396692] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-09T19:38:14.584618] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-09T19:38:15.147803] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:38:15.196686] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-09T19:38:15.506012] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T19:38:15.996770] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-09T19:38:16.590431] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T19:38:16.796728] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-09T19:38:17.596693] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-09T19:38:17.671159] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-09T19:38:17.771729] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-09T19:38:18.396725] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-09T19:38:19.026341] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-09T19:38:19.196757] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-09T19:38:19.289063] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-09T19:38:19.290976] [INFO ] [REMOTE ] IQI: Full fetch complete (26685 records). [2025-10-09T19:38:19.291060] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-09T19:38:19.673285] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-09T19:38:19.673370] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-09T19:38:19.673995] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-09T19:38:19.674060] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-09T19:38:19.674864] [DEBUG] [LOCAL ] IQI: Trimmed 26685 records to 18049 (keeping 200 days of data) [2025-10-09T19:38:19.784064] [DEBUG] [LOCAL ] IQI: Primary data saved (18049 records). [2025-10-09T19:38:19.784214] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-09T19:38:19.784326] [INFO ] [MAIN ] Update Progress: 1125/2373 symbols completed. IQI took 25.3s. Estimated remaining: 2h 55m 34s. Rate: 7.1 symbols/min [2025-10-09T19:38:19.971119] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:19.996681] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-09T19:38:19.998353] [DEBUG] [LOCAL ] IRS: Loaded 22476 existing records from primary storage. [2025-10-09T19:38:19.998634] [INFO ] [MAIN ] IRS: Loaded 22476 existing records. [2025-10-09T19:38:20.220423] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:20.220687] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-09T19:38:20.220748] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-09T19:38:20.221040] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-09T19:38:20.221099] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-09T19:38:20.579142] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:20.796743] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-09T19:38:21.042099] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T19:38:21.596694] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-09T19:38:21.771184] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T19:38:22.049981] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T19:38:22.396763] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-09T19:38:23.018992] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-09T19:38:23.196689] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-09T19:38:23.566331] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-09T19:38:23.996749] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-09T19:38:24.628246] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:38:24.796732] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-09T19:38:25.596709] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-09T19:38:25.639637] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:38:26.381708] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T19:38:26.396723] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-09T19:38:26.664709] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T19:38:27.196732] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-09T19:38:27.823925] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-09T19:38:27.860254] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-09T19:38:27.996694] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-09T19:38:28.796747] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-09T19:38:29.596763] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-09T19:38:29.777103] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T19:38:30.396710] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-09T19:38:30.479858] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T19:38:31.041088] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T19:38:31.196708] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-09T19:38:31.996691] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-09T19:38:32.143477] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-09T19:38:32.796742] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-09T19:38:32.893334] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-09T19:38:33.029639] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-09T19:38:33.596732] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-09T19:38:34.396712] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-09T19:38:34.488762] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-09T19:38:34.957726] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-09T19:38:35.196725] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-09T19:38:35.996764] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-09T19:38:36.113922] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T19:38:36.737074] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-09T19:38:36.796682] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-09T19:38:37.010967] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-09T19:38:37.596762] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-09T19:38:38.159901] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:38:38.396731] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-09T19:38:39.024172] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T19:38:39.196699] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-09T19:38:39.287070] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-09T19:38:39.295938] [INFO ] [REMOTE ] IR: Full fetch complete (76231 records). [2025-10-09T19:38:39.296204] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-09T19:38:39.699272] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-09T19:38:39.699374] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-09T19:38:39.700457] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-09T19:38:39.700526] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-09T19:38:39.702098] [DEBUG] [LOCAL ] IR: Trimmed 76231 records to 53136 (keeping 200 days of data) [2025-10-09T19:38:40.012619] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-09T19:38:40.037194] [DEBUG] [LOCAL ] IR: Primary data saved (53136 records). [2025-10-09T19:38:40.037344] [INFO ] [MAIN ] IR: Full history saved. [2025-10-09T19:38:40.037453] [INFO ] [MAIN ] Update Progress: 1126/2373 symbols completed. IR took 34.2s. Estimated remaining: 2h 55m 39s. Rate: 7.1 symbols/min [2025-10-09T19:38:40.202960] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:40.249113] [DEBUG] [LOCAL ] IRT: Loaded 50424 existing records from primary storage. [2025-10-09T19:38:40.249438] [INFO ] [MAIN ] IRT: Loaded 50424 existing records. [2025-10-09T19:38:40.439681] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:40.439909] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-09T19:38:40.439958] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-09T19:38:40.440179] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-09T19:38:40.440237] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-09T19:38:40.817152] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:40.817276] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-09T19:38:40.850581] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T19:38:41.092754] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T19:38:41.596759] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-09T19:38:42.396764] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-09T19:38:42.442024] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:38:42.446357] [INFO ] [REMOTE ] IQV: Full fetch complete (72146 records). [2025-10-09T19:38:42.446459] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-09T19:38:42.831450] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-09T19:38:42.831551] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-09T19:38:42.832592] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-09T19:38:42.832692] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-09T19:38:42.834173] [DEBUG] [LOCAL ] IQV: Trimmed 72146 records to 50443 (keeping 200 days of data) [2025-10-09T19:38:43.167935] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T19:38:43.186172] [DEBUG] [LOCAL ] IQV: Primary data saved (50443 records). [2025-10-09T19:38:43.186324] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-09T19:38:43.187132] [INFO ] [MAIN ] Update Progress: 1127/2373 symbols completed. IQV took 39.8s. Estimated remaining: 2h 55m 25s. Rate: 7.1 symbols/min [2025-10-09T19:38:43.201845] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-09T19:38:43.355223] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:43.373759] [DEBUG] [LOCAL ] ISD: Loaded 15838 existing records from primary storage. [2025-10-09T19:38:43.374010] [INFO ] [MAIN ] ISD: Loaded 15838 existing records. [2025-10-09T19:38:43.545774] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:43.545972] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-09T19:38:43.546019] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-09T19:38:43.546255] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-09T19:38:43.546323] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-09T19:38:43.899740] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:43.994192] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:38:43.998499] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-09T19:38:44.000349] [INFO ] [REMOTE ] IRM: Full fetch complete (72257 records). [2025-10-09T19:38:44.000741] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-09T19:38:44.384246] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-09T19:38:44.384340] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-09T19:38:44.385356] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-09T19:38:44.385422] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-09T19:38:44.387066] [DEBUG] [LOCAL ] IRM: Trimmed 72257 records to 49607 (keeping 200 days of data) [2025-10-09T19:38:44.700186] [DEBUG] [LOCAL ] IRM: Primary data saved (49607 records). [2025-10-09T19:38:44.700466] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-09T19:38:44.700679] [INFO ] [MAIN ] Update Progress: 1128/2373 symbols completed. IRM took 38.1s. Estimated remaining: 2h 55m 9s. Rate: 7.1 symbols/min [2025-10-09T19:38:44.798688] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-09T19:38:44.905880] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T19:38:44.910969] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:44.962486] [DEBUG] [LOCAL ] IT: Loaded 42164 existing records from primary storage. [2025-10-09T19:38:44.968165] [INFO ] [MAIN ] IT: Loaded 42164 existing records. [2025-10-09T19:38:45.046136] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T19:38:45.161002] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:45.161226] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-09T19:38:45.161278] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-09T19:38:45.161528] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-09T19:38:45.161585] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-09T19:38:45.514740] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:45.596714] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-09T19:38:45.906504] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-09T19:38:46.396713] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-09T19:38:47.190879] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:38:47.200615] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-09T19:38:47.662598] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:38:47.996679] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-09T19:38:48.078739] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T19:38:48.796745] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-09T19:38:49.596773] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-09T19:38:49.639146] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-09T19:38:49.731492] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T19:38:50.396794] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-09T19:38:51.196682] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-09T19:38:51.374573] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-09T19:38:51.389009] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T19:38:51.389135] [INFO ] [REMOTE ] IRS: Full fetch complete (32374 records). [2025-10-09T19:38:51.393114] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-09T19:38:51.755855] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-09T19:38:51.755937] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-09T19:38:51.756549] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-09T19:38:51.756589] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-09T19:38:51.757326] [DEBUG] [LOCAL ] IRS: Trimmed 32374 records to 22729 (keeping 200 days of data) [2025-10-09T19:38:51.892239] [DEBUG] [LOCAL ] IRS: Primary data saved (22729 records). [2025-10-09T19:38:51.892366] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-09T19:38:51.892445] [INFO ] [MAIN ] Update Progress: 1129/2373 symbols completed. IRS took 32.1s. Estimated remaining: 2h 54m 59s. Rate: 7.1 symbols/min [2025-10-09T19:38:51.996687] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-09T19:38:52.103784] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:38:52.137063] [DEBUG] [LOCAL ] ITGR: Loaded 31212 existing records from primary storage. [2025-10-09T19:38:52.137332] [INFO ] [MAIN ] ITGR: Loaded 31212 existing records. [2025-10-09T19:38:52.314200] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:38:52.314434] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-09T19:38:52.314661] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-09T19:38:52.320248] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-09T19:38:52.329524] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-09T19:38:52.372576] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T19:38:52.692800] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:38:52.796687] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-09T19:38:53.489088] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T19:38:53.596761] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-09T19:38:53.666413] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-09T19:38:54.396740] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-09T19:38:54.714211] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-09T19:38:55.045204] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T19:38:55.196691] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-09T19:38:55.996735] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-09T19:38:56.657773] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-09T19:38:56.796745] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-09T19:38:57.077051] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T19:38:57.596734] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-09T19:38:58.393862] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T19:38:58.404149] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-09T19:38:58.941444] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T19:38:59.196703] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-09T19:38:59.763048] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T19:38:59.996693] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-09T19:39:00.077134] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-09T19:39:00.796756] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-09T19:39:01.547058] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-09T19:39:01.596734] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-09T19:39:02.314125] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T19:39:02.396681] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-09T19:39:03.196702] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-09T19:39:03.303671] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-09T19:39:03.439109] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T19:39:03.996738] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-09T19:39:04.232397] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T19:39:04.796748] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-09T19:39:05.559336] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T19:39:05.564097] [INFO ] [REMOTE ] IRT: Full fetch complete (72763 records). [2025-10-09T19:39:05.564224] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-09T19:39:05.606496] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-09T19:39:05.967544] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-09T19:39:05.967766] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-09T19:39:05.968838] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-09T19:39:05.968904] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-09T19:39:05.970300] [DEBUG] [LOCAL ] IRT: Trimmed 72763 records to 50811 (keeping 200 days of data) [2025-10-09T19:39:06.104488] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T19:39:06.315244] [DEBUG] [LOCAL ] IRT: Primary data saved (50811 records). [2025-10-09T19:39:06.315398] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-09T19:39:06.315487] [INFO ] [MAIN ] Update Progress: 1130/2373 symbols completed. IRT took 26.3s. Estimated remaining: 2h 54m 57s. Rate: 7.1 symbols/min [2025-10-09T19:39:06.401932] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-09T19:39:06.496382] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:06.530763] [DEBUG] [LOCAL ] ITT: Loaded 32595 existing records from primary storage. [2025-10-09T19:39:06.531087] [INFO ] [MAIN ] ITT: Loaded 32595 existing records. [2025-10-09T19:39:06.706991] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:06.707233] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-09T19:39:06.707282] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-09T19:39:06.707780] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-09T19:39:06.707840] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-09T19:39:07.059716] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:07.079775] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T19:39:07.196680] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-09T19:39:07.821384] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-09T19:39:07.996755] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-09T19:39:08.150406] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T19:39:08.774099] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-09T19:39:08.796676] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-09T19:39:09.596735] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-09T19:39:10.050353] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-09T19:39:10.396728] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-09T19:39:10.933969] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-09T19:39:11.196740] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-09T19:39:11.728465] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T19:39:11.731255] [INFO ] [REMOTE ] ITGR: Full fetch complete (42262 records). [2025-10-09T19:39:11.731331] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-09T19:39:12.002063] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-09T19:39:12.111780] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-09T19:39:12.111918] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-09T19:39:12.112623] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-09T19:39:12.112698] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-09T19:39:12.113635] [DEBUG] [LOCAL ] ITGR: Trimmed 42262 records to 31372 (keeping 200 days of data) [2025-10-09T19:39:12.307548] [DEBUG] [LOCAL ] ITGR: Primary data saved (31372 records). [2025-10-09T19:39:12.307755] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-09T19:39:12.307853] [INFO ] [MAIN ] Update Progress: 1131/2373 symbols completed. ITGR took 20.4s. Estimated remaining: 2h 54m 46s. Rate: 7.1 symbols/min [2025-10-09T19:39:12.475422] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:12.525402] [DEBUG] [LOCAL ] ITUB: Loaded 53313 existing records from primary storage. [2025-10-09T19:39:12.525745] [INFO ] [MAIN ] ITUB: Loaded 53313 existing records. [2025-10-09T19:39:12.702748] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:12.702940] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-09T19:39:12.703090] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-09T19:39:12.703370] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-09T19:39:12.703429] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-09T19:39:12.797522] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-09T19:39:13.068559] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T19:39:13.121247] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:13.471393] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T19:39:13.596786] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-09T19:39:13.852701] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T19:39:14.396701] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-09T19:39:15.169166] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T19:39:15.196672] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-09T19:39:15.507638] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T19:39:15.996716] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-09T19:39:16.796780] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-09T19:39:16.981122] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T19:39:17.013192] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T19:39:17.596721] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-09T19:39:18.243212] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T19:39:18.396735] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-09T19:39:18.560444] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-09T19:39:19.196724] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-09T19:39:19.937434] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T19:39:19.996691] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-09T19:39:20.722680] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T19:39:20.796750] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-09T19:39:21.437286] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-09T19:39:21.596723] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-09T19:39:22.284816] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:39:22.396671] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-09T19:39:23.196742] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-09T19:39:23.372752] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-09T19:39:23.438313] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T19:39:23.996769] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-09T19:39:24.630439] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-09T19:39:24.682995] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-09T19:39:24.796675] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-09T19:39:25.596715] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-09T19:39:25.930873] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-09T19:39:26.396734] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-09T19:39:27.196732] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-09T19:39:27.308828] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-09T19:39:27.350747] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-09T19:39:27.996694] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-09T19:39:28.080415] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-09T19:39:28.082530] [INFO ] [REMOTE ] ISD: Full fetch complete (24104 records). [2025-10-09T19:39:28.082606] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-09T19:39:28.445254] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-09T19:39:28.445331] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-09T19:39:28.445814] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-09T19:39:28.445877] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-09T19:39:28.446443] [DEBUG] [LOCAL ] ISD: Trimmed 24104 records to 15962 (keeping 200 days of data) [2025-10-09T19:39:28.544860] [DEBUG] [LOCAL ] ISD: Primary data saved (15962 records). [2025-10-09T19:39:28.545009] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-09T19:39:28.545111] [INFO ] [MAIN ] Update Progress: 1132/2373 symbols completed. ISD took 45.4s. Estimated remaining: 2h 54m 46s. Rate: 7.1 symbols/min [2025-10-09T19:39:28.709219] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:28.755623] [DEBUG] [LOCAL ] ITW: Loaded 45750 existing records from primary storage. [2025-10-09T19:39:28.755935] [INFO ] [MAIN ] ITW: Loaded 45750 existing records. [2025-10-09T19:39:28.801960] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-09T19:39:28.945170] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:28.945617] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-09T19:39:28.945805] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-09T19:39:28.946370] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-09T19:39:28.946431] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-09T19:39:29.142042] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T19:39:29.330989] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:29.596766] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-09T19:39:30.396706] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-09T19:39:30.575353] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T19:39:31.107566] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-09T19:39:31.196694] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-09T19:39:31.347052] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:39:31.996720] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-09T19:39:32.796765] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-09T19:39:32.893678] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T19:39:33.179104] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T19:39:33.181984] [INFO ] [REMOTE ] ITT: Full fetch complete (46943 records). [2025-10-09T19:39:33.182127] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-09T19:39:33.561484] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-09T19:39:33.561564] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-09T19:39:33.562372] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-09T19:39:33.562448] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-09T19:39:33.563503] [DEBUG] [LOCAL ] ITT: Trimmed 46943 records to 32802 (keeping 200 days of data) [2025-10-09T19:39:33.623670] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-09T19:39:33.781605] [DEBUG] [LOCAL ] ITT: Primary data saved (32802 records). [2025-10-09T19:39:33.781773] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-09T19:39:33.781861] [INFO ] [MAIN ] Update Progress: 1133/2373 symbols completed. ITT took 27.5s. Estimated remaining: 2h 54m 34s. Rate: 7.1 symbols/min [2025-10-09T19:39:33.953235] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:33.995664] [DEBUG] [LOCAL ] IVR: Loaded 48111 existing records from primary storage. [2025-10-09T19:39:33.996002] [INFO ] [MAIN ] IVR: Loaded 48111 existing records. [2025-10-09T19:39:34.181588] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:34.181996] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-09T19:39:34.182058] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-09T19:39:34.182266] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-09T19:39:34.182323] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-09T19:39:34.405267] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-09T19:39:34.524225] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-09T19:39:34.589226] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:34.840550] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T19:39:35.196723] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-09T19:39:35.950542] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T19:39:35.996674] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-09T19:39:36.796732] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-09T19:39:37.095445] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-09T19:39:37.596739] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-09T19:39:37.637088] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-09T19:39:37.644904] [INFO ] [REMOTE ] IT: Full fetch complete (56762 records). [2025-10-09T19:39:37.645063] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-09T19:39:38.035184] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-09T19:39:38.035271] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-09T19:39:38.036132] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-09T19:39:38.036197] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-09T19:39:38.037369] [DEBUG] [LOCAL ] IT: Trimmed 56762 records to 42507 (keeping 200 days of data) [2025-10-09T19:39:38.301417] [DEBUG] [LOCAL ] IT: Primary data saved (42507 records). [2025-10-09T19:39:38.301569] [INFO ] [MAIN ] IT: Full history saved. [2025-10-09T19:39:38.301688] [INFO ] [MAIN ] Update Progress: 1134/2373 symbols completed. IT took 53.6s. Estimated remaining: 2h 54m 21s. Rate: 7.1 symbols/min [2025-10-09T19:39:38.401692] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-09T19:39:38.488520] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:38.558684] [DEBUG] [LOCAL ] IVT: Loaded 30981 existing records from primary storage. [2025-10-09T19:39:38.559099] [INFO ] [MAIN ] IVT: Loaded 30981 existing records. [2025-10-09T19:39:38.631686] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-09T19:39:38.761077] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:38.761338] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-09T19:39:38.761389] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-09T19:39:38.761719] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-09T19:39:38.761781] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-09T19:39:39.150625] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:39.180632] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-09T19:39:39.196676] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-09T19:39:39.996769] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-09T19:39:40.158694] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T19:39:40.796712] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-09T19:39:41.064734] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-09T19:39:41.180057] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-09T19:39:41.596799] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-09T19:39:42.346059] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-09T19:39:42.396679] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-09T19:39:43.196714] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-09T19:39:43.364246] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T19:39:43.798892] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T19:39:43.996746] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-09T19:39:44.161317] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T19:39:44.796749] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-09T19:39:45.596756] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-09T19:39:45.734125] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:39:45.980221] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-09T19:39:46.396754] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-09T19:39:47.128054] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-09T19:39:47.196671] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-09T19:39:47.327058] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-09T19:39:47.996770] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-09T19:39:48.796767] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-09T19:39:48.842033] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T19:39:49.596737] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-09T19:39:49.751482] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T19:39:50.396744] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-09T19:39:50.466638] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:39:50.472414] [INFO ] [REMOTE ] ITUB: Full fetch complete (77152 records). [2025-10-09T19:39:50.472573] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-09T19:39:50.935153] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-09T19:39:50.935314] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-09T19:39:50.936462] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-09T19:39:50.936680] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-09T19:39:50.938461] [DEBUG] [LOCAL ] ITUB: Trimmed 77152 records to 53698 (keeping 200 days of data) [2025-10-09T19:39:51.201695] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-09T19:39:51.206383] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-09T19:39:51.331117] [DEBUG] [LOCAL ] ITUB: Primary data saved (53698 records). [2025-10-09T19:39:51.331264] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-09T19:39:51.331351] [INFO ] [MAIN ] Update Progress: 1135/2373 symbols completed. ITUB took 39.0s. Estimated remaining: 2h 54m 18s. Rate: 7.1 symbols/min [2025-10-09T19:39:51.504493] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:51.556203] [DEBUG] [LOCAL ] IVZ: Loaded 53114 existing records from primary storage. [2025-10-09T19:39:51.556562] [INFO ] [MAIN ] IVZ: Loaded 53114 existing records. [2025-10-09T19:39:51.735325] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:51.735514] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-09T19:39:51.735560] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-09T19:39:51.736304] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-09T19:39:51.736362] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-09T19:39:51.996897] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-09T19:39:52.100844] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:52.137995] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T19:39:52.513319] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T19:39:52.796742] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-09T19:39:53.596731] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-09T19:39:53.737958] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-09T19:39:54.396776] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-09T19:39:54.433124] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T19:39:54.872606] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T19:39:55.196772] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-09T19:39:55.996774] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-09T19:39:56.048774] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T19:39:56.796701] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-09T19:39:56.873576] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T19:39:57.539278] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T19:39:57.543186] [INFO ] [REMOTE ] ITW: Full fetch complete (66417 records). [2025-10-09T19:39:57.543301] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-09T19:39:57.604981] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-09T19:39:57.992307] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-09T19:39:57.992410] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-09T19:39:57.993533] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-09T19:39:57.993606] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-09T19:39:57.995121] [DEBUG] [LOCAL ] ITW: Trimmed 66417 records to 46099 (keeping 200 days of data) [2025-10-09T19:39:58.260058] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T19:39:58.342230] [DEBUG] [LOCAL ] ITW: Primary data saved (46099 records). [2025-10-09T19:39:58.342382] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-09T19:39:58.343003] [INFO ] [MAIN ] Update Progress: 1136/2373 symbols completed. ITW took 29.8s. Estimated remaining: 2h 54m 8s. Rate: 7.1 symbols/min [2025-10-09T19:39:58.405564] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-09T19:39:58.512895] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:39:58.536583] [DEBUG] [LOCAL ] IX: Loaded 22302 existing records from primary storage. [2025-10-09T19:39:58.536905] [INFO ] [MAIN ] IX: Loaded 22302 existing records. [2025-10-09T19:39:58.707887] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:39:58.708117] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-09T19:39:58.708164] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-09T19:39:58.708559] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-09T19:39:58.708617] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-09T19:39:59.112140] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:39:59.196796] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-09T19:39:59.241578] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:39:59.306676] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T19:39:59.996726] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-09T19:40:00.796726] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-09T19:40:01.157146] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-09T19:40:01.596693] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-09T19:40:01.703127] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:40:01.741847] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T19:40:02.396745] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-09T19:40:02.520555] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:40:03.196784] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-09T19:40:03.996698] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-09T19:40:04.231581] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-09T19:40:04.796750] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-09T19:40:04.916765] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T19:40:04.993158] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-09T19:40:05.596733] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-09T19:40:06.253297] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:40:06.396733] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-09T19:40:06.584031] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-09T19:40:07.196717] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-09T19:40:07.963462] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T19:40:07.996739] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-09T19:40:08.730291] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-09T19:40:08.796689] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-09T19:40:08.853622] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:40:09.596775] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-09T19:40:10.398992] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-09T19:40:10.401119] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-09T19:40:10.522412] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-09T19:40:10.526682] [INFO ] [REMOTE ] IVR: Full fetch complete (69159 records). [2025-10-09T19:40:10.526786] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-09T19:40:10.918313] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-09T19:40:10.918412] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-09T19:40:10.919455] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-09T19:40:10.919522] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-09T19:40:10.920907] [DEBUG] [LOCAL ] IVR: Trimmed 69159 records to 48445 (keeping 200 days of data) [2025-10-09T19:40:11.196742] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-09T19:40:11.205092] [DEBUG] [LOCAL ] IVR: Primary data saved (48445 records). [2025-10-09T19:40:11.205185] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-09T19:40:11.205322] [INFO ] [MAIN ] Update Progress: 1137/2373 symbols completed. IVR took 37.4s. Estimated remaining: 2h 54m 4s. Rate: 7.1 symbols/min [2025-10-09T19:40:11.380221] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:11.420551] [DEBUG] [LOCAL ] J: Loaded 40192 existing records from primary storage. [2025-10-09T19:40:11.420926] [INFO ] [MAIN ] J: Loaded 40192 existing records. [2025-10-09T19:40:11.601047] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:11.601321] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-09T19:40:11.601368] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-09T19:40:11.601728] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-09T19:40:11.601796] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-09T19:40:11.975627] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:11.996684] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-09T19:40:12.293314] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T19:40:12.332159] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-09T19:40:12.796736] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-09T19:40:13.520503] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:40:13.596762] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-09T19:40:14.396759] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-09T19:40:14.695324] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-09T19:40:15.138328] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:40:15.196675] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-09T19:40:15.484923] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T19:40:15.996706] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-09T19:40:16.801791] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-09T19:40:16.816037] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-09T19:40:17.596686] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-09T19:40:17.822296] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-09T19:40:18.078637] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-09T19:40:18.396761] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-09T19:40:19.144174] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:40:19.196675] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-09T19:40:19.979678] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T19:40:19.984759] [INFO ] [REMOTE ] IVZ: Full fetch complete (76806 records). [2025-10-09T19:40:19.984942] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-09T19:40:20.002011] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-09T19:40:20.412218] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-09T19:40:20.412347] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-09T19:40:20.413700] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-09T19:40:20.413856] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-09T19:40:20.415466] [DEBUG] [LOCAL ] IVZ: Trimmed 76806 records to 53491 (keeping 200 days of data) [2025-10-09T19:40:20.661067] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T19:40:20.784988] [DEBUG] [LOCAL ] IVZ: Primary data saved (53491 records). [2025-10-09T19:40:20.785124] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-09T19:40:20.785220] [INFO ] [MAIN ] Update Progress: 1138/2373 symbols completed. IVZ took 29.5s. Estimated remaining: 2h 53m 57s. Rate: 7.1 symbols/min [2025-10-09T19:40:20.806029] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-09T19:40:20.955037] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:20.996349] [DEBUG] [LOCAL ] JBGS: Loaded 42213 existing records from primary storage. [2025-10-09T19:40:20.996680] [INFO ] [MAIN ] JBGS: Loaded 42213 existing records. [2025-10-09T19:40:21.189253] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:40:21.193812] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:21.197392] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-09T19:40:21.197452] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-09T19:40:21.197549] [INFO ] [REMOTE ] IVT: Full fetch complete (45666 records). [2025-10-09T19:40:21.197723] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-09T19:40:21.198027] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-09T19:40:21.198087] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-09T19:40:21.616886] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-09T19:40:22.001202] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:22.002005] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-09T19:40:22.002279] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-09T19:40:22.003702] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-09T19:40:22.003797] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-09T19:40:22.022018] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T19:40:22.029353] [DEBUG] [LOCAL ] IVT: Trimmed 45666 records to 31295 (keeping 200 days of data) [2025-10-09T19:40:22.239784] [DEBUG] [LOCAL ] IVT: Primary data saved (31295 records). [2025-10-09T19:40:22.239988] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-09T19:40:22.240110] [INFO ] [MAIN ] Update Progress: 1139/2373 symbols completed. IVT took 43.9s. Estimated remaining: 2h 53m 41s. Rate: 7.1 symbols/min [2025-10-09T19:40:22.411878] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-09T19:40:22.416535] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:22.466967] [DEBUG] [LOCAL ] JBI: Loaded 43319 existing records from primary storage. [2025-10-09T19:40:22.467479] [INFO ] [MAIN ] JBI: Loaded 43319 existing records. [2025-10-09T19:40:22.659594] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:22.659934] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-09T19:40:22.659997] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-09T19:40:22.660849] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-09T19:40:22.660920] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-09T19:40:23.020749] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:23.196693] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-09T19:40:23.293117] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-09T19:40:23.581122] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-09T19:40:23.996690] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-09T19:40:24.267012] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-09T19:40:24.796750] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-09T19:40:24.977205] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T19:40:25.598467] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-09T19:40:25.601106] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-09T19:40:26.396776] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-09T19:40:27.066063] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T19:40:27.196698] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-09T19:40:27.619902] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T19:40:27.996715] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-09T19:40:28.750535] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-09T19:40:28.796741] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-09T19:40:29.121041] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T19:40:29.596731] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-09T19:40:30.233522] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T19:40:30.396739] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-09T19:40:30.982317] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-09T19:40:31.196733] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-09T19:40:31.918631] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-09T19:40:31.996668] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-09T19:40:32.745980] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-09T19:40:32.796674] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-09T19:40:33.273788] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T19:40:33.596716] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-09T19:40:33.915388] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-09T19:40:34.396763] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-09T19:40:35.036411] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:40:35.040092] [INFO ] [REMOTE ] J: Full fetch complete (59161 records). [2025-10-09T19:40:35.040183] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-09T19:40:35.202534] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-09T19:40:35.432686] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-09T19:40:35.432776] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-09T19:40:35.433601] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-09T19:40:35.433662] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-09T19:40:35.434867] [DEBUG] [LOCAL ] J: Trimmed 59161 records to 40500 (keeping 200 days of data) [2025-10-09T19:40:35.686615] [DEBUG] [LOCAL ] J: Primary data saved (40500 records). [2025-10-09T19:40:35.686858] [INFO ] [MAIN ] J: Full history saved. [2025-10-09T19:40:35.687072] [INFO ] [MAIN ] Update Progress: 1140/2373 symbols completed. J took 24.5s. Estimated remaining: 2h 53m 38s. Rate: 7.1 symbols/min [2025-10-09T19:40:35.885639] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:35.888231] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-09T19:40:35.933332] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T19:40:35.954946] [DEBUG] [LOCAL ] JBL: Loaded 48364 existing records from primary storage. [2025-10-09T19:40:35.955254] [INFO ] [MAIN ] JBL: Loaded 48364 existing records. [2025-10-09T19:40:36.001839] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-09T19:40:36.132943] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:36.133166] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-09T19:40:36.133221] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-09T19:40:36.133889] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-09T19:40:36.133949] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-09T19:40:36.481110] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:36.796739] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-09T19:40:37.478051] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T19:40:37.596675] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-09T19:40:38.396777] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-09T19:40:38.531031] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-09T19:40:38.887795] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-09T19:40:39.048481] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T19:40:39.196756] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-09T19:40:39.996791] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-09T19:40:40.413858] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T19:40:40.796770] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-09T19:40:41.462002] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-09T19:40:41.596688] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-09T19:40:42.395480] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-09T19:40:42.405106] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-09T19:40:43.196687] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-09T19:40:43.296512] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T19:40:43.862313] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T19:40:43.996678] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-09T19:40:44.032938] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T19:40:44.034984] [INFO ] [REMOTE ] IX: Full fetch complete (27781 records). [2025-10-09T19:40:44.035061] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-09T19:40:44.398121] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-09T19:40:44.398203] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-09T19:40:44.398774] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-09T19:40:44.398836] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-09T19:40:44.399491] [DEBUG] [LOCAL ] IX: Trimmed 27781 records to 22441 (keeping 200 days of data) [2025-10-09T19:40:44.527816] [DEBUG] [LOCAL ] IX: Primary data saved (22441 records). [2025-10-09T19:40:44.527944] [INFO ] [MAIN ] IX: Full history saved. [2025-10-09T19:40:44.528023] [INFO ] [MAIN ] Update Progress: 1141/2373 symbols completed. IX took 46.2s. Estimated remaining: 2h 53m 30s. Rate: 7.1 symbols/min [2025-10-09T19:40:44.694086] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:44.720659] [DEBUG] [LOCAL ] JBND: Loaded 26515 existing records from primary storage. [2025-10-09T19:40:44.720915] [INFO ] [MAIN ] JBND: Loaded 26515 existing records. [2025-10-09T19:40:44.801973] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-09T19:40:44.898662] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:44.898842] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-09T19:40:44.898888] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-09T19:40:44.899186] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-09T19:40:44.899245] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-09T19:40:45.270053] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:45.393013] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T19:40:45.596723] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-09T19:40:46.364443] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-09T19:40:46.396673] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-09T19:40:46.992952] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T19:40:46.997973] [INFO ] [REMOTE ] JBI: Full fetch complete (64061 records). [2025-10-09T19:40:46.998194] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-09T19:40:47.203372] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-09T19:40:47.389635] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-09T19:40:47.389755] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-09T19:40:47.390833] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-09T19:40:47.390902] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-09T19:40:47.392361] [DEBUG] [LOCAL ] JBI: Trimmed 64061 records to 43587 (keeping 200 days of data) [2025-10-09T19:40:47.630615] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T19:40:47.675781] [DEBUG] [LOCAL ] JBI: Primary data saved (43587 records). [2025-10-09T19:40:47.675925] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-09T19:40:47.676010] [INFO ] [MAIN ] Update Progress: 1142/2373 symbols completed. JBI took 25.4s. Estimated remaining: 2h 53m 16s. Rate: 7.1 symbols/min [2025-10-09T19:40:47.840444] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:47.840612] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-09T19:40:47.840689] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-09T19:40:47.840811] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-09T19:40:47.840852] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-09T19:40:47.840892] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-09T19:40:47.840923] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-09T19:40:47.997130] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-09T19:40:48.167811] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T19:40:48.228260] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:48.796805] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-09T19:40:49.396429] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-09T19:40:49.596763] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-09T19:40:49.718743] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-09T19:40:49.792539] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:40:49.792874] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-09T19:40:49.792983] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:40:49.793056] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-09T19:40:49.793119] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:40:49.793187] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-09T19:40:49.793248] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-09T19:40:49.793284] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-09T19:40:49.793322] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-09T19:40:49.793381] [INFO ] [MAIN ] Update Progress: 1143/2373 symbols completed. JBS took 2.1s. Estimated remaining: 2h 53m 0s. Rate: 7.1 symbols/min [2025-10-09T19:40:49.962590] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:49.962817] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-09T19:40:49.962859] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-09T19:40:49.962974] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-09T19:40:49.963016] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-09T19:40:49.963056] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-09T19:40:49.963088] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-09T19:40:50.335559] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:50.396687] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-09T19:40:50.590466] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:40:50.590968] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-09T19:40:50.591072] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:40:50.591128] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-09T19:40:50.591162] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:40:50.591232] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-09T19:40:50.591305] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-09T19:40:50.591342] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-09T19:40:50.591382] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-09T19:40:50.591438] [INFO ] [MAIN ] Update Progress: 1144/2373 symbols completed. JBTM took 0.8s. Estimated remaining: 2h 52m 44s. Rate: 7.1 symbols/min [2025-10-09T19:40:50.796097] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:40:50.806309] [DEBUG] [LOCAL ] JCE: Loaded 7134 existing records from primary storage. [2025-10-09T19:40:50.806548] [INFO ] [MAIN ] JCE: Loaded 7134 existing records. [2025-10-09T19:40:51.032116] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:40:51.032347] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-09T19:40:51.032465] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-09T19:40:51.032725] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-09T19:40:51.032786] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-09T19:40:51.210727] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-09T19:40:51.395348] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:40:51.996684] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-09T19:40:52.291288] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-09T19:40:52.481735] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-09T19:40:52.796724] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-09T19:40:53.407432] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T19:40:53.596729] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-09T19:40:54.168927] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T19:40:54.396732] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-09T19:40:55.196756] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-09T19:40:55.831338] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-09T19:40:55.996723] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-09T19:40:56.796688] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-09T19:40:57.130437] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-09T19:40:57.526563] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T19:40:57.593958] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T19:40:57.599905] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-09T19:40:58.396811] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-09T19:40:58.731610] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:40:59.196772] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-09T19:40:59.648512] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-09T19:40:59.654359] [INFO ] [REMOTE ] JBGS: Full fetch complete (59337 records). [2025-10-09T19:40:59.654617] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-09T19:41:00.001879] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-09T19:41:00.091578] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-09T19:41:00.091683] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-09T19:41:00.092624] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-09T19:41:00.092702] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-09T19:41:00.093937] [DEBUG] [LOCAL ] JBGS: Trimmed 59337 records to 42466 (keeping 200 days of data) [2025-10-09T19:41:00.355974] [DEBUG] [LOCAL ] JBGS: Primary data saved (42466 records). [2025-10-09T19:41:00.356103] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-09T19:41:00.356180] [INFO ] [MAIN ] Update Progress: 1145/2373 symbols completed. JBGS took 39.6s. Estimated remaining: 2h 52m 37s. Rate: 7.1 symbols/min [2025-10-09T19:41:00.523954] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:00.574402] [DEBUG] [LOCAL ] JCI: Loaded 53539 existing records from primary storage. [2025-10-09T19:41:00.574761] [INFO ] [MAIN ] JCI: Loaded 53539 existing records. [2025-10-09T19:41:00.750236] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:00.750474] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-09T19:41:00.750524] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-09T19:41:00.750778] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-09T19:41:00.750839] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-09T19:41:00.809840] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-09T19:41:01.123984] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:01.571112] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:41:01.596684] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-09T19:41:01.622459] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T19:41:01.694961] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-09T19:41:02.396788] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-09T19:41:03.196738] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-09T19:41:03.251780] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-09T19:41:03.345737] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T19:41:03.952178] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T19:41:03.996696] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-09T19:41:04.796741] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-09T19:41:05.006895] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T19:41:05.375833] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-09T19:41:05.596770] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-09T19:41:06.396752] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-09T19:41:07.196699] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-09T19:41:07.247001] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-09T19:41:07.908782] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-09T19:41:08.001842] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-09T19:41:08.015248] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-09T19:41:08.796761] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-09T19:41:09.266379] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:41:09.596738] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-09T19:41:10.164844] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T19:41:10.396701] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-09T19:41:11.062736] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:41:11.196695] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-09T19:41:11.996749] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-09T19:41:12.272049] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-09T19:41:12.674568] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-09T19:41:12.796727] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-09T19:41:13.391576] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:41:13.596729] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-09T19:41:14.396691] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-09T19:41:14.787556] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-09T19:41:14.836238] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T19:41:14.839329] [INFO ] [REMOTE ] JBND: Full fetch complete (34905 records). [2025-10-09T19:41:14.839425] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-09T19:41:15.202183] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-09T19:41:15.205120] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-09T19:41:15.205188] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-09T19:41:15.205959] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-09T19:41:15.206035] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-09T19:41:15.207263] [DEBUG] [LOCAL ] JBND: Trimmed 34905 records to 26753 (keeping 200 days of data) [2025-10-09T19:41:15.376928] [DEBUG] [LOCAL ] JBND: Primary data saved (26753 records). [2025-10-09T19:41:15.377060] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-09T19:41:15.377141] [INFO ] [MAIN ] Update Progress: 1146/2373 symbols completed. JBND took 30.8s. Estimated remaining: 2h 52m 35s. Rate: 7.1 symbols/min [2025-10-09T19:41:15.549427] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:15.595402] [DEBUG] [LOCAL ] JEF: Loaded 50129 existing records from primary storage. [2025-10-09T19:41:15.595755] [INFO ] [MAIN ] JEF: Loaded 50129 existing records. [2025-10-09T19:41:15.772337] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:15.772679] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-09T19:41:15.772755] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-09T19:41:15.773264] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-09T19:41:15.773326] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-09T19:41:15.879417] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:41:16.002376] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-09T19:41:16.147904] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:16.174116] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:41:16.646130] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-09T19:41:16.796687] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-09T19:41:17.560254] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-09T19:41:17.596668] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-09T19:41:18.257588] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-09T19:41:18.259305] [INFO ] [REMOTE ] JCE: Full fetch complete (9648 records). [2025-10-09T19:41:18.259378] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-09T19:41:18.400119] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-09T19:41:18.620265] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-09T19:41:18.620378] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-09T19:41:18.620628] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-09T19:41:18.620703] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-09T19:41:18.621122] [DEBUG] [LOCAL ] JCE: Trimmed 9648 records to 7225 (keeping 200 days of data) [2025-10-09T19:41:18.664230] [DEBUG] [LOCAL ] JCE: Primary data saved (7225 records). [2025-10-09T19:41:18.664320] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-09T19:41:18.664394] [INFO ] [MAIN ] Update Progress: 1147/2373 symbols completed. JCE took 28.1s. Estimated remaining: 2h 52m 21s. Rate: 7.1 symbols/min [2025-10-09T19:41:18.829597] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:18.870381] [DEBUG] [LOCAL ] JELD: Loaded 46112 existing records from primary storage. [2025-10-09T19:41:18.870791] [INFO ] [MAIN ] JELD: Loaded 46112 existing records. [2025-10-09T19:41:19.043517] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:19.043749] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-09T19:41:19.043806] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-09T19:41:19.044081] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-09T19:41:19.044137] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-09T19:41:19.214831] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-09T19:41:19.397752] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:19.996374] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-09T19:41:20.000434] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-09T19:41:20.796736] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-09T19:41:21.150310] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-09T19:41:21.480316] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-09T19:41:21.596775] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-09T19:41:22.321347] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-09T19:41:22.396682] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-09T19:41:22.573935] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-09T19:41:23.196729] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-09T19:41:23.892876] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T19:41:23.996694] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-09T19:41:24.628600] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-09T19:41:24.633019] [INFO ] [REMOTE ] JBL: Full fetch complete (70369 records). [2025-10-09T19:41:24.633160] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-09T19:41:24.799248] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-09T19:41:25.032089] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-09T19:41:25.032173] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-09T19:41:25.033281] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-09T19:41:25.033348] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-09T19:41:25.034706] [DEBUG] [LOCAL ] JBL: Trimmed 70369 records to 48733 (keeping 200 days of data) [2025-10-09T19:41:25.354263] [DEBUG] [LOCAL ] JBL: Primary data saved (48733 records). [2025-10-09T19:41:25.354637] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-09T19:41:25.354775] [INFO ] [MAIN ] Update Progress: 1148/2373 symbols completed. JBL took 49.7s. Estimated remaining: 2h 52m 11s. Rate: 7.1 symbols/min [2025-10-09T19:41:25.522894] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:25.534187] [DEBUG] [LOCAL ] JEQ: Loaded 8667 existing records from primary storage. [2025-10-09T19:41:25.534391] [INFO ] [MAIN ] JEQ: Loaded 8667 existing records. [2025-10-09T19:41:25.597582] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-09T19:41:25.714868] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:25.715363] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-09T19:41:25.715443] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-09T19:41:25.716045] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-09T19:41:25.716105] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-09T19:41:26.107747] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:26.110255] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-09T19:41:26.363938] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-09T19:41:26.396666] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-09T19:41:27.029194] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T19:41:27.196717] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-09T19:41:27.571585] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-09T19:41:27.996736] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-09T19:41:28.058267] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-09T19:41:28.415414] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-09T19:41:28.796745] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-09T19:41:29.348908] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-09T19:41:29.596696] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-09T19:41:30.396708] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-09T19:41:30.777162] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-09T19:41:31.196718] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-09T19:41:31.938718] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T19:41:31.996682] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-09T19:41:32.102256] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T19:41:32.796741] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-09T19:41:33.343745] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:41:33.596777] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-09T19:41:34.141026] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-09T19:41:34.396725] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-09T19:41:35.041905] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T19:41:35.196763] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-09T19:41:35.996729] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-09T19:41:36.064390] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T19:41:36.553605] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:41:36.757441] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:41:36.796744] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-09T19:41:37.596701] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-09T19:41:38.404561] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-09T19:41:38.407409] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T19:41:39.016262] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T19:41:39.061874] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-09T19:41:39.066365] [INFO ] [REMOTE ] JCI: Full fetch complete (77411 records). [2025-10-09T19:41:39.066497] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-09T19:41:39.205722] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-09T19:41:39.460069] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-09T19:41:39.460154] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-09T19:41:39.461149] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-09T19:41:39.461214] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-09T19:41:39.462789] [DEBUG] [LOCAL ] JCI: Trimmed 77411 records to 53928 (keeping 200 days of data) [2025-10-09T19:41:39.815276] [DEBUG] [LOCAL ] JCI: Primary data saved (53928 records). [2025-10-09T19:41:39.815423] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-09T19:41:39.815536] [INFO ] [MAIN ] Update Progress: 1149/2373 symbols completed. JCI took 39.5s. Estimated remaining: 2h 52m 9s. Rate: 7.1 symbols/min [2025-10-09T19:41:39.981021] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:39.998932] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-09T19:41:40.012232] [DEBUG] [LOCAL ] JFR: Loaded 31030 existing records from primary storage. [2025-10-09T19:41:40.012780] [INFO ] [MAIN ] JFR: Loaded 31030 existing records. [2025-10-09T19:41:40.187069] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:40.187283] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-09T19:41:40.187329] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-09T19:41:40.187556] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-09T19:41:40.187612] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-09T19:41:40.539742] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:40.796702] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-09T19:41:40.888867] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T19:41:41.365896] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T19:41:41.596724] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-09T19:41:41.796922] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-09T19:41:42.014814] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T19:41:42.396699] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-09T19:41:43.196777] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-09T19:41:43.996708] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-09T19:41:44.038686] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-09T19:41:44.073963] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T19:41:44.796725] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-09T19:41:45.446358] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-09T19:41:45.542465] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-09T19:41:45.596691] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-09T19:41:46.396781] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-09T19:41:46.694281] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:41:47.196730] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-09T19:41:47.676796] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-09T19:41:47.996693] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-09T19:41:48.160032] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T19:41:48.528056] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-09T19:41:48.529636] [INFO ] [REMOTE ] JEQ: Full fetch complete (11898 records). [2025-10-09T19:41:48.529734] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-09T19:41:48.801838] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-09T19:41:48.891598] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-09T19:41:48.891698] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-09T19:41:48.891981] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-09T19:41:48.892022] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-09T19:41:48.892473] [DEBUG] [LOCAL ] JEQ: Trimmed 11898 records to 8743 (keeping 200 days of data) [2025-10-09T19:41:48.944216] [DEBUG] [LOCAL ] JEQ: Primary data saved (8743 records). [2025-10-09T19:41:48.944355] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-09T19:41:48.944439] [INFO ] [MAIN ] Update Progress: 1150/2373 symbols completed. JEQ took 23.6s. Estimated remaining: 2h 52m 1s. Rate: 7.1 symbols/min [2025-10-09T19:41:49.110813] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:49.124331] [DEBUG] [LOCAL ] JGH: Loaded 11365 existing records from primary storage. [2025-10-09T19:41:49.124572] [INFO ] [MAIN ] JGH: Loaded 11365 existing records. [2025-10-09T19:41:49.303895] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:49.304133] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-09T19:41:49.304181] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-09T19:41:49.304354] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-09T19:41:49.304411] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-09T19:41:49.601911] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-09T19:41:49.812151] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:50.231688] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-09T19:41:50.396774] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-09T19:41:51.196742] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-09T19:41:51.294525] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T19:41:51.630747] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T19:41:51.996730] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-09T19:41:52.796715] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-09T19:41:52.972988] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T19:41:53.539149] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-09T19:41:53.596674] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-09T19:41:54.156940] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:41:54.396732] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-09T19:41:55.153554] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T19:41:55.157914] [INFO ] [REMOTE ] JELD: Full fetch complete (64136 records). [2025-10-09T19:41:55.158066] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-09T19:41:55.201939] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-09T19:41:55.538326] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-09T19:41:55.538443] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-09T19:41:55.539287] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-09T19:41:55.539349] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-09T19:41:55.540610] [DEBUG] [LOCAL ] JELD: Trimmed 64136 records to 46434 (keeping 200 days of data) [2025-10-09T19:41:55.805694] [DEBUG] [LOCAL ] JELD: Primary data saved (46434 records). [2025-10-09T19:41:55.805863] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-09T19:41:55.806001] [INFO ] [MAIN ] Update Progress: 1151/2373 symbols completed. JELD took 37.1s. Estimated remaining: 2h 51m 51s. Rate: 7.1 symbols/min [2025-10-09T19:41:55.975498] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:55.998315] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-09T19:41:56.018445] [DEBUG] [LOCAL ] JHG: Loaded 47568 existing records from primary storage. [2025-10-09T19:41:56.018782] [INFO ] [MAIN ] JHG: Loaded 47568 existing records. [2025-10-09T19:41:56.131824] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-09T19:41:56.157698] [INFO ] [REMOTE ] JEF: Full fetch complete (73024 records). [2025-10-09T19:41:56.185605] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-09T19:41:56.215926] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:56.236254] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-09T19:41:56.258006] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T19:41:56.257773] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-09T19:41:56.293173] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-09T19:41:56.298834] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-09T19:41:56.798505] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-09T19:41:57.011361] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-09T19:41:57.007759] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:57.011921] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-09T19:41:57.012977] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-09T19:41:57.013086] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-09T19:41:57.014713] [DEBUG] [LOCAL ] JEF: Trimmed 73024 records to 50519 (keeping 200 days of data) [2025-10-09T19:41:57.126053] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T19:41:57.349299] [DEBUG] [LOCAL ] JEF: Primary data saved (50519 records). [2025-10-09T19:41:57.349433] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-09T19:41:57.350127] [INFO ] [MAIN ] Update Progress: 1152/2373 symbols completed. JEF took 42.0s. Estimated remaining: 2h 51m 36s. Rate: 7.1 symbols/min [2025-10-09T19:41:57.528555] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:41:57.536066] [DEBUG] [LOCAL ] JHI: Loaded 3717 existing records from primary storage. [2025-10-09T19:41:57.536294] [INFO ] [MAIN ] JHI: Loaded 3717 existing records. [2025-10-09T19:41:57.603667] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-09T19:41:57.743068] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:41:57.743346] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-09T19:41:57.743396] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-09T19:41:57.743566] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-09T19:41:57.743694] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-09T19:41:57.856843] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-09T19:41:58.110305] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:41:58.396777] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-09T19:41:58.716575] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-09T19:41:59.196746] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-09T19:41:59.809583] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-09T19:41:59.996729] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-09T19:42:00.336665] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-09T19:42:00.796753] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-09T19:42:01.411272] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-09T19:42:01.596742] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-09T19:42:01.720545] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-09T19:42:02.396729] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-09T19:42:03.137234] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:42:03.196685] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-09T19:42:03.666928] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-09T19:42:04.001877] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-09T19:42:04.004088] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T19:42:04.796719] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-09T19:42:05.448472] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T19:42:05.596721] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-09T19:42:05.642618] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:42:06.190006] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-09T19:42:06.396757] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-09T19:42:06.951996] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-09T19:42:07.196795] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-09T19:42:07.753859] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T19:42:07.996718] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-09T19:42:08.801951] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-09T19:42:08.804107] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-09T19:42:09.596700] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-09T19:42:09.978554] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-09T19:42:10.396852] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-09T19:42:11.064967] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T19:42:11.196759] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-09T19:42:11.252865] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-09T19:42:11.996711] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-09T19:42:12.505061] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T19:42:12.508293] [INFO ] [REMOTE ] JFR: Full fetch complete (48219 records). [2025-10-09T19:42:12.508378] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-09T19:42:12.692072] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T19:42:12.801863] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-09T19:42:12.929612] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-09T19:42:12.929741] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-09T19:42:12.930530] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-09T19:42:12.930573] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-09T19:42:12.931576] [DEBUG] [LOCAL ] JFR: Trimmed 48219 records to 31188 (keeping 200 days of data) [2025-10-09T19:42:13.120742] [DEBUG] [LOCAL ] JFR: Primary data saved (31188 records). [2025-10-09T19:42:13.120893] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-09T19:42:13.120979] [INFO ] [MAIN ] Update Progress: 1153/2373 symbols completed. JFR took 33.3s. Estimated remaining: 2h 51m 35s. Rate: 7.1 symbols/min [2025-10-09T19:42:13.286752] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:42:13.292184] [DEBUG] [LOCAL ] JHS: Loaded 2900 existing records from primary storage. [2025-10-09T19:42:13.292347] [INFO ] [MAIN ] JHS: Loaded 2900 existing records. [2025-10-09T19:42:13.464328] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:42:13.464567] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-09T19:42:13.464614] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-09T19:42:13.464807] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-09T19:42:13.464863] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-09T19:42:13.606796] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-09T19:42:13.832058] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:42:14.146602] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T19:42:14.396689] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-09T19:42:14.591454] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-09T19:42:14.719332] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-09T19:42:15.196737] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-09T19:42:15.996719] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-09T19:42:16.163074] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-09T19:42:16.165605] [INFO ] [REMOTE ] JGH: Full fetch complete (15392 records). [2025-10-09T19:42:16.165795] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-09T19:42:16.459753] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-09T19:42:16.549521] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-09T19:42:16.549599] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-09T19:42:16.549987] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-09T19:42:16.550053] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-09T19:42:16.550606] [DEBUG] [LOCAL ] JGH: Trimmed 15392 records to 11697 (keeping 200 days of data) [2025-10-09T19:42:16.624534] [DEBUG] [LOCAL ] JGH: Primary data saved (11697 records). [2025-10-09T19:42:16.624696] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-09T19:42:16.624857] [INFO ] [MAIN ] Update Progress: 1154/2373 symbols completed. JGH took 27.7s. Estimated remaining: 2h 51m 21s. Rate: 7.1 symbols/min [2025-10-09T19:42:16.795762] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:42:16.796691] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-09T19:42:16.848423] [DEBUG] [LOCAL ] JHX: Loaded 53151 existing records from primary storage. [2025-10-09T19:42:16.848805] [INFO ] [MAIN ] JHX: Loaded 53151 existing records. [2025-10-09T19:42:17.032970] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:42:17.033232] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-09T19:42:17.033286] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-09T19:42:17.033520] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-09T19:42:17.033577] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-09T19:42:17.376663] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-09T19:42:17.398701] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:42:17.596713] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-09T19:42:18.181578] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T19:42:18.396731] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-09T19:42:19.196732] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-09T19:42:19.727568] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T19:42:19.996688] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-09T19:42:20.281265] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T19:42:20.796727] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-09T19:42:21.558197] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T19:42:21.596679] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-09T19:42:21.611532] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T19:42:22.266327] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-09T19:42:22.396753] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-09T19:42:23.196712] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-09T19:42:23.216191] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T19:42:23.996731] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-09T19:42:24.434671] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T19:42:24.796681] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-09T19:42:24.876738] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T19:42:25.161896] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T19:42:25.596707] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-09T19:42:25.947580] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-09T19:42:26.396730] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-09T19:42:26.791361] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-09T19:42:27.196750] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-09T19:42:27.996766] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-09T19:42:28.796753] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-09T19:42:28.829633] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T19:42:28.956360] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T19:42:29.284977] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-09T19:42:29.596708] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-09T19:42:30.040412] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T19:42:30.396730] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-09T19:42:30.854707] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-09T19:42:31.196772] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-09T19:42:31.677731] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T19:42:31.996751] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-09T19:42:32.488828] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T19:42:32.796742] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-09T19:42:33.369239] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-09T19:42:33.596734] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-09T19:42:34.396730] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-09T19:42:34.913480] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T19:42:34.916685] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-09T19:42:35.196710] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-09T19:42:35.718366] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T19:42:35.719234] [INFO ] [REMOTE ] JHS: Full fetch complete (4495 records). [2025-10-09T19:42:35.719302] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-09T19:42:36.001846] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-09T19:42:36.074834] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-09T19:42:36.074909] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-09T19:42:36.075051] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-09T19:42:36.075088] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-09T19:42:36.075437] [DEBUG] [LOCAL ] JHS: Trimmed 4495 records to 2942 (keeping 200 days of data) [2025-10-09T19:42:36.093600] [DEBUG] [LOCAL ] JHS: Primary data saved (2942 records). [2025-10-09T19:42:36.093689] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-09T19:42:36.093793] [INFO ] [MAIN ] Update Progress: 1155/2373 symbols completed. JHS took 23.0s. Estimated remaining: 2h 51m 24s. Rate: 7.1 symbols/min [2025-10-09T19:42:36.263841] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:42:36.281460] [DEBUG] [LOCAL ] JILL: Loaded 16249 existing records from primary storage. [2025-10-09T19:42:36.281717] [INFO ] [MAIN ] JILL: Loaded 16249 existing records. [2025-10-09T19:42:36.457221] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:42:36.457429] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-09T19:42:36.457487] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-09T19:42:36.457711] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-09T19:42:36.457772] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-09T19:42:36.559446] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T19:42:36.809476] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-09T19:42:36.815140] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:42:37.596724] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-09T19:42:38.194861] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T19:42:38.199516] [INFO ] [REMOTE ] JHG: Full fetch complete (68261 records). [2025-10-09T19:42:38.199761] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-09T19:42:38.411308] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-09T19:42:38.667753] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-09T19:42:38.667881] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-09T19:42:38.669186] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-09T19:42:38.669259] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-09T19:42:38.671037] [DEBUG] [LOCAL ] JHG: Trimmed 68261 records to 47922 (keeping 200 days of data) [2025-10-09T19:42:38.987883] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-09T19:42:38.990321] [INFO ] [REMOTE ] JHI: Full fetch complete (5435 records). [2025-10-09T19:42:38.991058] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-09T19:42:39.231143] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:42:39.218671] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-09T19:42:39.338969] [DEBUG] [LOCAL ] JHG: Primary data saved (47922 records). [2025-10-09T19:42:39.347422] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-09T19:42:39.349889] [INFO ] [MAIN ] Update Progress: 1156/2373 symbols completed. JHG took 43.5s. Estimated remaining: 2h 51m 11s. Rate: 7.1 symbols/min [2025-10-09T19:42:39.558889] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-09T19:42:39.564568] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-09T19:42:39.569972] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-09T19:42:39.580308] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-09T19:42:39.604554] [DEBUG] [LOCAL ] JHI: Trimmed 5435 records to 3850 (keeping 200 days of data) [2025-10-09T19:42:39.641226] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:42:39.666995] [DEBUG] [LOCAL ] JHI: Primary data saved (3850 records). [2025-10-09T19:42:39.667232] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-09T19:42:39.667340] [INFO ] [MAIN ] Update Progress: 1157/2373 symbols completed. JHI took 42.3s. Estimated remaining: 2h 50m 54s. Rate: 7.1 symbols/min [2025-10-09T19:42:39.697551] [DEBUG] [LOCAL ] JKS: Loaded 39841 existing records from primary storage. [2025-10-09T19:42:39.697920] [INFO ] [MAIN ] JKS: Loaded 39841 existing records. [2025-10-09T19:42:39.875483] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:42:39.875724] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-09T19:42:39.875780] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-09T19:42:39.876058] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-09T19:42:39.876117] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-09T19:42:40.001864] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-09T19:42:40.239417] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:42:40.250721] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-09T19:42:40.796732] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-09T19:42:41.591620] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T19:42:41.596672] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-09T19:42:41.847585] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:42:42.375170] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-09T19:42:42.396668] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-09T19:42:43.196702] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-09T19:42:43.384636] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-09T19:42:43.996760] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-09T19:42:44.561397] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-09T19:42:44.796702] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-09T19:42:44.973529] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T19:42:45.596729] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-09T19:42:46.396700] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-09T19:42:46.549291] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-09T19:42:47.031081] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:42:47.196691] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-09T19:42:47.395719] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-09T19:42:47.996730] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-09T19:42:48.796743] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-09T19:42:49.159638] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-09T19:42:49.256756] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-09T19:42:49.426286] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T19:42:49.596763] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-09T19:42:50.396738] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-09T19:42:51.145857] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-09T19:42:51.196675] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-09T19:42:51.905083] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:42:51.996735] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-09T19:42:52.677293] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:42:52.796732] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-09T19:42:53.011575] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-09T19:42:53.018240] [INFO ] [REMOTE ] JHX: Full fetch complete (60093 records). [2025-10-09T19:42:53.018389] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-09T19:42:53.410055] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-09T19:42:53.410170] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-09T19:42:53.411100] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-09T19:42:53.411168] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-09T19:42:53.415506] [DEBUG] [LOCAL ] JHX: Trimmed 60093 records to 53541 (keeping 200 days of data) [2025-10-09T19:42:53.619482] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-09T19:42:53.736293] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-09T19:42:53.758782] [DEBUG] [LOCAL ] JHX: Primary data saved (53541 records). [2025-10-09T19:42:53.758940] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-09T19:42:53.759046] [INFO ] [MAIN ] Update Progress: 1158/2373 symbols completed. JHX took 37.1s. Estimated remaining: 2h 50m 51s. Rate: 7.1 symbols/min [2025-10-09T19:42:54.396757] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-09T19:42:55.206245] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:42:55.215668] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-09T19:42:55.348201] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-09T19:42:55.996840] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-09T19:42:56.836464] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-09T19:42:56.838494] [INFO ] [REMOTE ] JILL: Full fetch complete (22566 records). [2025-10-09T19:42:56.838575] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-09T19:42:57.232992] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-09T19:42:57.243569] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-09T19:42:57.249809] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-09T19:42:57.249904] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-09T19:42:57.264589] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-09T19:42:57.264790] [DEBUG] [LOCAL ] JILL: Trimmed 22566 records to 16360 (keeping 200 days of data) [2025-10-09T19:42:57.277581] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-09T19:42:57.393944] [DEBUG] [LOCAL ] JILL: Primary data saved (16360 records). [2025-10-09T19:42:57.394177] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-09T19:42:57.394289] [INFO ] [MAIN ] Update Progress: 1159/2373 symbols completed. JILL took 21.3s. Estimated remaining: 2h 50m 38s. Rate: 7.1 symbols/min [2025-10-09T19:42:58.746029] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T19:42:58.754493] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-09T19:43:00.173264] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T19:43:00.183327] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-09T19:43:01.808380] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:43:01.818081] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-09T19:43:03.041037] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T19:43:03.048743] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-09T19:43:04.670495] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:43:04.679362] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-09T19:43:06.124994] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:43:06.128672] [INFO ] [REMOTE ] JKS: Full fetch complete (58740 records). [2025-10-09T19:43:06.128771] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-09T19:43:06.511825] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-09T19:43:06.511920] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-09T19:43:06.512790] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-09T19:43:06.512856] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-09T19:43:06.514201] [DEBUG] [LOCAL ] JKS: Trimmed 58740 records to 40155 (keeping 200 days of data) [2025-10-09T19:43:06.759827] [DEBUG] [LOCAL ] JKS: Primary data saved (40155 records). [2025-10-09T19:43:06.759959] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-09T19:43:06.760041] [INFO ] [MAIN ] Update Progress: 1160/2373 symbols completed. JKS took 27.4s. Estimated remaining: 2h 50m 30s. Rate: 7.1 symbols/min [2025-10-09T19:43:07.387354] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:07.456795] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:07.491798] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:07.507781] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-09T19:43:07.535526] [DEBUG] [LOCAL ] JLS: Loaded 4144 existing records from primary storage. [2025-10-09T19:43:07.545756] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-09T19:43:07.569478] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-09T19:43:07.569151] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:07.543331] [INFO ] [MAIN ] JLS: Loaded 4144 existing records. [2025-10-09T19:43:07.575376] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-09T19:43:07.591381] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-09T19:43:07.613134] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-09T19:43:07.918400] [DEBUG] [LOCAL ] JLL: Loaded 31422 existing records from primary storage. [2025-10-09T19:43:07.960299] [INFO ] [MAIN ] JLL: Loaded 31422 existing records. [2025-10-09T19:43:08.026978] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:08.044109] [DEBUG] [LOCAL ] JMIA: Loaded 50849 existing records from primary storage. [2025-10-09T19:43:08.056925] [INFO ] [MAIN ] JMIA: Loaded 50849 existing records. [2025-10-09T19:43:08.057019] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-09T19:43:08.125874] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-09T19:43:08.278425] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-09T19:43:08.347588] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-09T19:43:08.557746] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:08.678366] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:08.666353] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-09T19:43:08.678740] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-09T19:43:08.691020] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-09T19:43:08.717058] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:08.733937] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-09T19:43:08.733867] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-09T19:43:08.751861] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-09T19:43:08.757105] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-09T19:43:08.773164] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-09T19:43:08.830095] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-09T19:43:09.477595] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T19:43:09.538680] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:09.564687] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-09T19:43:09.594821] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-09T19:43:09.738510] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:09.761219] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-09T19:43:09.760908] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:09.762340] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-09T19:43:10.066841] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-09T19:43:10.067978] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-09T19:43:10.210984] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-09T19:43:10.212470] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-09T19:43:10.502066] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-09T19:43:10.503228] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-09T19:43:10.702987] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T19:43:10.704569] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-09T19:43:10.820618] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-09T19:43:10.821539] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-09T19:43:11.046006] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T19:43:11.051615] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-09T19:43:11.272816] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T19:43:11.272707] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-09T19:43:11.274158] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-09T19:43:11.276222] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-09T19:43:11.632263] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-09T19:43:11.635732] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-09T19:43:11.650602] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-09T19:43:11.996715] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-09T19:43:12.014461] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T19:43:12.569289] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T19:43:12.796720] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-09T19:43:13.154394] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-09T19:43:13.596754] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-09T19:43:14.147280] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-09T19:43:14.396732] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-09T19:43:14.759914] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-09T19:43:15.196729] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-09T19:43:15.996694] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-09T19:43:16.608267] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T19:43:16.796704] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-09T19:43:16.888932] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T19:43:17.161291] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-09T19:43:17.596728] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-09T19:43:18.396770] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-09T19:43:18.965163] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T19:43:19.196723] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-09T19:43:19.241538] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:43:19.996777] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-09T19:43:20.432618] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T19:43:20.447064] [INFO ] [REMOTE ] JMM: Full fetch complete (2313 records). [2025-10-09T19:43:20.449359] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-09T19:43:20.450170] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-09T19:43:20.630433] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-09T19:43:20.630611] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:43:20.630691] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:43:20.630748] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-09T19:43:20.630809] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-09T19:43:20.630844] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-09T19:43:20.630902] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-09T19:43:20.630979] [INFO ] [MAIN ] Update Progress: 1161/2373 symbols completed. JMM took 13.9s. Estimated remaining: 2h 50m 27s. Rate: 7.1 symbols/min [2025-10-09T19:43:20.793619] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:20.796728] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-09T19:43:20.844782] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-09T19:43:20.845094] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-09T19:43:21.024498] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:21.024778] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-09T19:43:21.024855] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-09T19:43:21.025097] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-09T19:43:21.025152] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-09T19:43:21.368687] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:21.596711] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-09T19:43:22.396745] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-09T19:43:22.587108] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-09T19:43:23.196749] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-09T19:43:23.750614] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-09T19:43:23.796258] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-09T19:43:23.996694] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-09T19:43:24.046809] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-10-09T19:43:24.796717] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-09T19:43:25.071834] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-09T19:43:25.596756] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-09T19:43:26.396744] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-09T19:43:26.983376] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T19:43:27.037275] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-09T19:43:27.196692] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-09T19:43:27.803212] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-09T19:43:27.996738] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-09T19:43:28.796734] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-09T19:43:28.918283] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T19:43:29.285103] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T19:43:29.596747] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-09T19:43:30.396713] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-09T19:43:30.624037] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-09T19:43:30.957251] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T19:43:31.196741] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-09T19:43:31.690207] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-09T19:43:31.811814] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-09T19:43:31.996717] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-09T19:43:32.796779] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-09T19:43:33.362783] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-09T19:43:33.596715] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-09T19:43:34.126354] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-09T19:43:34.219061] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-09T19:43:34.220099] [INFO ] [REMOTE ] JLS: Full fetch complete (5823 records). [2025-10-09T19:43:34.220173] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-09T19:43:34.406243] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-09T19:43:34.610238] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-09T19:43:34.610321] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-09T19:43:34.610498] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-09T19:43:34.610537] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-09T19:43:34.610931] [DEBUG] [LOCAL ] JLS: Trimmed 5823 records to 4181 (keeping 200 days of data) [2025-10-09T19:43:34.636659] [DEBUG] [LOCAL ] JLS: Primary data saved (4181 records). [2025-10-09T19:43:34.636735] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-09T19:43:34.636885] [INFO ] [MAIN ] Update Progress: 1162/2373 symbols completed. JLS took 27.9s. Estimated remaining: 2h 50m 25s. Rate: 7.1 symbols/min [2025-10-09T19:43:34.801147] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:34.851939] [DEBUG] [LOCAL ] JOBY: Loaded 53801 existing records from primary storage. [2025-10-09T19:43:34.852250] [INFO ] [MAIN ] JOBY: Loaded 53801 existing records. [2025-10-09T19:43:35.030627] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:35.031679] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-09T19:43:35.031738] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-09T19:43:35.032400] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-09T19:43:35.032458] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-09T19:43:35.202088] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-09T19:43:35.382058] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:35.996744] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-09T19:43:36.796774] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-09T19:43:36.889503] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-09T19:43:36.955698] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-09T19:43:37.204435] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T19:43:37.596727] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-09T19:43:38.396721] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-09T19:43:39.196701] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-09T19:43:39.377595] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-10-09T19:43:39.818669] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-09T19:43:39.996693] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-09T19:43:40.138737] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-09T19:43:40.540458] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-09T19:43:40.796719] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-09T19:43:41.596727] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-09T19:43:42.396699] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-09T19:43:42.522168] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-09T19:43:42.733756] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T19:43:42.736404] [INFO ] [REMOTE ] JLL: Full fetch complete (44741 records). [2025-10-09T19:43:42.736548] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-09T19:43:43.104603] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-09T19:43:43.159477] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-09T19:43:43.159573] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-09T19:43:43.160377] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-09T19:43:43.160474] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-09T19:43:43.161939] [DEBUG] [LOCAL ] JLL: Trimmed 44741 records to 31654 (keeping 200 days of data) [2025-10-09T19:43:43.217240] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-09T19:43:43.361987] [DEBUG] [LOCAL ] JLL: Primary data saved (31654 records). [2025-10-09T19:43:43.362136] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-09T19:43:43.362221] [INFO ] [MAIN ] Update Progress: 1163/2373 symbols completed. JLL took 36.6s. Estimated remaining: 2h 50m 17s. Rate: 7.1 symbols/min [2025-10-09T19:43:43.526456] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:43.548365] [DEBUG] [LOCAL ] JOE: Loaded 23935 existing records from primary storage. [2025-10-09T19:43:43.548604] [INFO ] [MAIN ] JOE: Loaded 23935 existing records. [2025-10-09T19:43:43.723558] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:43.723838] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-09T19:43:43.723889] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-09T19:43:43.724109] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-09T19:43:43.724168] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-09T19:43:43.999270] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-09T19:43:44.080726] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:44.550639] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-09T19:43:44.796784] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-09T19:43:45.596770] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-09T19:43:45.683434] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-09T19:43:46.320289] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-09T19:43:46.396677] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-09T19:43:46.699710] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-09T19:43:46.704430] [INFO ] [REMOTE ] JMIA: Full fetch complete (73287 records). [2025-10-09T19:43:46.704570] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-09T19:43:47.051554] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-09T19:43:47.155843] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-09T19:43:47.155940] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-09T19:43:47.156937] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-09T19:43:47.157011] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-09T19:43:47.158747] [DEBUG] [LOCAL ] JMIA: Trimmed 73287 records to 51233 (keeping 200 days of data) [2025-10-09T19:43:47.207478] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-09T19:43:47.460337] [DEBUG] [LOCAL ] JMIA: Primary data saved (51233 records). [2025-10-09T19:43:47.460474] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-09T19:43:47.462115] [INFO ] [MAIN ] Update Progress: 1164/2373 symbols completed. JMIA took 40.7s. Estimated remaining: 2h 50m 4s. Rate: 7.1 symbols/min [2025-10-09T19:43:47.627733] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:47.639773] [DEBUG] [LOCAL ] JOF: Loaded 6878 existing records from primary storage. [2025-10-09T19:43:47.640028] [INFO ] [MAIN ] JOF: Loaded 6878 existing records. [2025-10-09T19:43:47.813085] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:47.813278] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-09T19:43:47.813323] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-09T19:43:47.813478] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-09T19:43:47.813536] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-09T19:43:48.016795] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-09T19:43:48.167118] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:48.336702] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-09T19:43:48.593308] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-09T19:43:48.796760] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-09T19:43:49.596731] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-09T19:43:49.902769] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:43:50.396740] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-09T19:43:50.506021] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-09T19:43:51.196792] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-09T19:43:51.509501] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T19:43:51.566913] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T19:43:51.906600] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T19:43:51.996814] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-09T19:43:52.796765] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-09T19:43:53.596725] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-09T19:43:53.854268] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T19:43:54.204265] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T19:43:54.382244] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-09T19:43:54.396669] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-09T19:43:55.196731] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-09T19:43:55.996791] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-09T19:43:56.796741] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-09T19:43:56.978619] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-09T19:43:57.097904] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-09T19:43:57.102812] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-09T19:43:57.102958] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-09T19:43:57.293934] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T19:43:57.423276] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T19:43:57.531322] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-09T19:43:57.531412] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-09T19:43:57.532492] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-09T19:43:57.532559] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-09T19:43:57.534257] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54143 (keeping 200 days of data) [2025-10-09T19:43:57.603086] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-09T19:43:57.885894] [DEBUG] [LOCAL ] JNJ: Primary data saved (54143 records). [2025-10-09T19:43:57.886051] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-09T19:43:57.886140] [INFO ] [MAIN ] Update Progress: 1165/2373 symbols completed. JNJ took 37.3s. Estimated remaining: 2h 49m 57s. Rate: 7.1 symbols/min [2025-10-09T19:43:58.052192] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:43:58.086569] [DEBUG] [LOCAL ] JPC: Loaded 37230 existing records from primary storage. [2025-10-09T19:43:58.086898] [INFO ] [MAIN ] JPC: Loaded 37230 existing records. [2025-10-09T19:43:58.267005] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:43:58.267243] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-09T19:43:58.267300] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-09T19:43:58.267514] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-09T19:43:58.267570] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-09T19:43:58.384106] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T19:43:58.401568] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-09T19:43:58.641760] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:43:59.196717] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-09T19:43:59.996685] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-09T19:44:00.021301] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-09T19:44:00.796775] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-09T19:44:00.804812] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-09T19:44:00.968309] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-09T19:44:01.596737] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-09T19:44:01.948611] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T19:44:02.396739] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-09T19:44:02.832914] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T19:44:03.196726] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-09T19:44:03.480849] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T19:44:03.996801] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-09T19:44:04.796684] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-09T19:44:05.193259] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:44:05.393983] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-09T19:44:05.596726] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-09T19:44:05.712956] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-09T19:44:05.977832] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-09T19:44:06.396723] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-09T19:44:07.085610] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-09T19:44:07.196698] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-09T19:44:07.996700] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-09T19:44:08.557458] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T19:44:08.796732] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-09T19:44:09.596744] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-09T19:44:09.946374] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-09T19:44:09.952133] [INFO ] [REMOTE ] JOE: Full fetch complete (35723 records). [2025-10-09T19:44:09.952251] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-09T19:44:10.275497] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (3.08 seconds). [2025-10-09T19:44:10.309515] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-09T19:44:10.382153] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-09T19:44:10.382226] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-09T19:44:10.382894] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-09T19:44:10.382956] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-09T19:44:10.383736] [DEBUG] [LOCAL ] JOE: Trimmed 35723 records to 24061 (keeping 200 days of data) [2025-10-09T19:44:10.438542] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-09T19:44:10.542995] [DEBUG] [LOCAL ] JOE: Primary data saved (24061 records). [2025-10-09T19:44:10.543127] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-09T19:44:10.543210] [INFO ] [MAIN ] Update Progress: 1166/2373 symbols completed. JOE took 27.2s. Estimated remaining: 2h 49m 53s. Rate: 7.1 symbols/min [2025-10-09T19:44:10.708630] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:10.761610] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-09T19:44:10.762019] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-09T19:44:10.936119] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:10.936388] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-09T19:44:10.936447] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-09T19:44:10.936721] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-09T19:44:10.936780] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-09T19:44:11.203730] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-09T19:44:11.285602] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:11.709603] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-09T19:44:11.982965] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-09T19:44:11.984075] [INFO ] [REMOTE ] JOF: Full fetch complete (9478 records). [2025-10-09T19:44:11.984144] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-09T19:44:12.004380] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-09T19:44:12.359006] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-09T19:44:12.359099] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-09T19:44:12.359338] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-09T19:44:12.359378] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-09T19:44:12.359828] [DEBUG] [LOCAL ] JOF: Trimmed 9478 records to 6915 (keeping 200 days of data) [2025-10-09T19:44:12.400731] [DEBUG] [LOCAL ] JOF: Primary data saved (6915 records). [2025-10-09T19:44:12.400832] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-09T19:44:12.400908] [INFO ] [MAIN ] Update Progress: 1167/2373 symbols completed. JOF took 24.9s. Estimated remaining: 2h 49m 38s. Rate: 7.1 symbols/min [2025-10-09T19:44:12.569451] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:12.605472] [DEBUG] [LOCAL ] JQC: Loaded 34236 existing records from primary storage. [2025-10-09T19:44:12.605788] [INFO ] [MAIN ] JQC: Loaded 34236 existing records. [2025-10-09T19:44:12.818893] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:12.814089] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-09T19:44:12.819782] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-09T19:44:12.819836] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-09T19:44:12.820078] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-09T19:44:12.820145] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-09T19:44:13.187139] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:13.596699] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-09T19:44:13.885807] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T19:44:14.403354] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-09T19:44:14.409581] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-09T19:44:15.196722] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-09T19:44:15.818016] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T19:44:15.946952] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-09T19:44:15.996676] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-09T19:44:16.796728] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-09T19:44:17.595053] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-09T19:44:17.606738] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-09T19:44:18.088761] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T19:44:18.396726] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-09T19:44:18.744222] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-09T19:44:18.749554] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-09T19:44:18.749721] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-09T19:44:19.206684] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-09T19:44:19.231267] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-09T19:44:19.231399] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-09T19:44:19.232478] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-09T19:44:19.232837] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-09T19:44:19.266552] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:44:19.266716] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54191 (keeping 200 days of data) [2025-10-09T19:44:19.610274] [DEBUG] [LOCAL ] JOBY: Primary data saved (54191 records). [2025-10-09T19:44:19.610462] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-09T19:44:19.610562] [INFO ] [MAIN ] Update Progress: 1168/2373 symbols completed. JOBY took 45.0s. Estimated remaining: 2h 49m 28s. Rate: 7.1 symbols/min [2025-10-09T19:44:19.780388] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:19.797535] [DEBUG] [LOCAL ] JRI: Loaded 15167 existing records from primary storage. [2025-10-09T19:44:19.797870] [INFO ] [MAIN ] JRI: Loaded 15167 existing records. [2025-10-09T19:44:19.993069] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:19.993358] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-09T19:44:19.993426] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-09T19:44:19.993678] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-09T19:44:19.993764] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-09T19:44:20.028791] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-09T19:44:20.384399] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:20.556712] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-09T19:44:20.625130] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T19:44:20.796716] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-09T19:44:21.492526] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-09T19:44:21.596680] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-09T19:44:21.761889] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-09T19:44:22.396775] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-09T19:44:22.683207] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-09T19:44:23.196693] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-09T19:44:23.349361] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-09T19:44:23.996714] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-09T19:44:24.696538] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T19:44:24.796718] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-09T19:44:24.904046] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-09T19:44:25.596712] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-09T19:44:25.869675] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T19:44:26.396685] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-09T19:44:27.168947] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T19:44:27.196687] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-09T19:44:27.999966] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-09T19:44:28.005978] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-09T19:44:28.639146] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:44:28.796706] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-09T19:44:28.900590] [DEBUG] [REMOTE ] JPC: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-09T19:44:28.900888] [WARN ] [REMOTE ] JPC: No data returned for month 2025-08 [2025-10-09T19:44:28.900991] [FATAL] [REMOTE ] JPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:44:28.901088] [FATAL] [MAIN ] JPC: Failed to fetch primary data. [2025-10-09T19:44:28.901151] [WARN ] [MAIN ] JPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:44:28.901222] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-09T19:44:28.901284] [DEBUG] [LOCAL ] JPC: No primary data file found to delete. [2025-10-09T19:44:28.901319] [INFO ] [LOCAL ] JPC: Starting deletion of derivative data. [2025-10-09T19:44:28.901578] [DEBUG] [LOCAL ] JPC: Deleted derivative data file. [2025-10-09T19:44:28.901710] [INFO ] [MAIN ] Update Progress: 1169/2373 symbols completed. JPC took 31.0s. Estimated remaining: 2h 49m 21s. Rate: 7.1 symbols/min [2025-10-09T19:44:29.069842] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:29.082433] [DEBUG] [LOCAL ] JRS: Loaded 11551 existing records from primary storage. [2025-10-09T19:44:29.082631] [INFO ] [MAIN ] JRS: Loaded 11551 existing records. [2025-10-09T19:44:29.261077] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:29.261255] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-09T19:44:29.261301] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-09T19:44:29.261459] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-09T19:44:29.261516] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-09T19:44:29.571357] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:44:29.600097] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-09T19:44:29.662189] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:30.396720] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-09T19:44:31.196730] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-09T19:44:31.519727] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T19:44:31.905171] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-09T19:44:31.951279] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T19:44:31.996726] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-09T19:44:32.796738] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-09T19:44:33.427307] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-09T19:44:33.596718] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-09T19:44:33.721126] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-09T19:44:34.396716] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-09T19:44:34.724009] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-09T19:44:35.200448] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-09T19:44:35.203283] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-09T19:44:35.996685] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-09T19:44:36.021378] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-09T19:44:36.766631] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T19:44:36.796679] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-09T19:44:37.340792] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T19:44:37.596727] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-09T19:44:38.396728] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-09T19:44:38.885253] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T19:44:39.196790] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-09T19:44:39.996774] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-09T19:44:40.151224] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-09T19:44:40.394368] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-09T19:44:40.587239] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-09T19:44:40.796715] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-09T19:44:41.596777] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-09T19:44:42.319951] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T19:44:42.396766] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-09T19:44:42.938714] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-09T19:44:43.183235] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-09T19:44:43.196668] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-09T19:44:43.996774] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-09T19:44:44.181277] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-09T19:44:44.752177] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:44:44.796780] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-09T19:44:45.596741] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-09T19:44:45.917209] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T19:44:45.920591] [INFO ] [REMOTE ] JQC: Full fetch complete (49423 records). [2025-10-09T19:44:45.920729] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-09T19:44:46.305104] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-09T19:44:46.305183] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-09T19:44:46.306073] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-09T19:44:46.306138] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-09T19:44:46.307131] [DEBUG] [LOCAL ] JQC: Trimmed 49423 records to 34386 (keeping 200 days of data) [2025-10-09T19:44:46.401304] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-09T19:44:46.510862] [DEBUG] [LOCAL ] JQC: Primary data saved (34386 records). [2025-10-09T19:44:46.511007] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-09T19:44:46.511093] [INFO ] [MAIN ] Update Progress: 1170/2373 symbols completed. JQC took 34.1s. Estimated remaining: 2h 49m 22s. Rate: 7.1 symbols/min [2025-10-09T19:44:46.645811] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-09T19:44:46.693059] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:46.734697] [DEBUG] [LOCAL ] JXN: Loaded 45065 existing records from primary storage. [2025-10-09T19:44:46.735021] [INFO ] [MAIN ] JXN: Loaded 45065 existing records. [2025-10-09T19:44:46.916414] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:46.916716] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-09T19:44:46.916778] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-09T19:44:46.916965] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-09T19:44:46.917022] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-09T19:44:47.197529] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-09T19:44:47.276244] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:47.996767] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-09T19:44:48.009044] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-09T19:44:48.646517] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-09T19:44:48.796702] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-09T19:44:49.074943] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-09T19:44:49.596745] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-09T19:44:50.306542] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T19:44:50.308751] [INFO ] [REMOTE ] JRI: Full fetch complete (23286 records). [2025-10-09T19:44:50.308840] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-09T19:44:50.403979] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-09T19:44:50.671404] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-09T19:44:50.671482] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-09T19:44:50.672012] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-09T19:44:50.672074] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-09T19:44:50.672699] [DEBUG] [LOCAL ] JRI: Trimmed 23286 records to 15351 (keeping 200 days of data) [2025-10-09T19:44:50.770848] [DEBUG] [LOCAL ] JRI: Primary data saved (15351 records). [2025-10-09T19:44:50.771042] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-09T19:44:50.771191] [INFO ] [MAIN ] Update Progress: 1171/2373 symbols completed. JRI took 31.2s. Estimated remaining: 2h 49m 9s. Rate: 7.1 symbols/min [2025-10-09T19:44:50.942465] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:50.988058] [DEBUG] [LOCAL ] K: Loaded 50112 existing records from primary storage. [2025-10-09T19:44:50.988406] [INFO ] [MAIN ] K: Loaded 50112 existing records. [2025-10-09T19:44:51.166453] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:51.166760] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-09T19:44:51.166819] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-09T19:44:51.167149] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-09T19:44:51.167256] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-09T19:44:51.198112] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-09T19:44:51.317894] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-09T19:44:51.625062] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:51.889837] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-09T19:44:51.996676] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-09T19:44:52.228585] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:44:52.796698] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-09T19:44:53.419027] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T19:44:53.596499] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T19:44:53.599515] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-09T19:44:54.396721] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-09T19:44:55.137956] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-09T19:44:55.196682] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-09T19:44:55.996746] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-09T19:44:56.009291] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T19:44:56.011106] [INFO ] [REMOTE ] JRS: Full fetch complete (16338 records). [2025-10-09T19:44:56.011179] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-09T19:44:56.434056] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-09T19:44:56.472469] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-09T19:44:56.472713] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-09T19:44:56.473183] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-09T19:44:56.473253] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-09T19:44:56.474560] [DEBUG] [LOCAL ] JRS: Trimmed 16338 records to 11656 (keeping 200 days of data) [2025-10-09T19:44:56.547725] [DEBUG] [LOCAL ] JRS: Primary data saved (11656 records). [2025-10-09T19:44:56.547884] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-09T19:44:56.547983] [INFO ] [MAIN ] Update Progress: 1172/2373 symbols completed. JRS took 27.6s. Estimated remaining: 2h 48m 58s. Rate: 7.1 symbols/min [2025-10-09T19:44:56.716904] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:44:56.731865] [DEBUG] [LOCAL ] KAI: Loaded 13277 existing records from primary storage. [2025-10-09T19:44:56.732108] [INFO ] [MAIN ] KAI: Loaded 13277 existing records. [2025-10-09T19:44:56.805627] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-09T19:44:56.911562] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:44:56.911866] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-09T19:44:56.911915] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-09T19:44:56.912144] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-09T19:44:56.912201] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-09T19:44:57.263921] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:44:57.596785] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-09T19:44:57.819086] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T19:44:58.240887] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-09T19:44:58.396735] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-09T19:44:59.197447] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-09T19:44:59.197056] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-09T19:44:59.203448] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-09T19:44:59.203549] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-09T19:44:59.614530] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-09T19:44:59.614669] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-09T19:44:59.615829] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-09T19:44:59.615936] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-09T19:44:59.617548] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54184 (keeping 200 days of data) [2025-10-09T19:44:59.888733] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-09T19:45:00.002513] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-09T19:45:00.006825] [DEBUG] [LOCAL ] JPM: Primary data saved (54184 records). [2025-10-09T19:45:00.007165] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-09T19:45:00.007930] [INFO ] [MAIN ] Update Progress: 1173/2373 symbols completed. JPM took 49.5s. Estimated remaining: 2h 48m 44s. Rate: 7.1 symbols/min [2025-10-09T19:45:00.176665] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:00.214748] [DEBUG] [LOCAL ] KAR: Loaded 40090 existing records from primary storage. [2025-10-09T19:45:00.215043] [INFO ] [MAIN ] KAR: Loaded 40090 existing records. [2025-10-09T19:45:00.386246] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:00.386458] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-09T19:45:00.386504] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-09T19:45:00.386797] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-09T19:45:00.386868] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-09T19:45:00.743355] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:00.770030] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-09T19:45:00.796665] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-09T19:45:01.584413] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T19:45:01.596673] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-09T19:45:02.210168] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-09T19:45:02.396747] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-09T19:45:03.051608] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-09T19:45:03.196778] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-09T19:45:03.578281] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-09T19:45:03.996692] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-09T19:45:04.773021] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-09T19:45:04.796708] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-09T19:45:04.959417] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T19:45:05.596777] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-09T19:45:05.970249] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T19:45:06.396729] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-09T19:45:06.834433] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T19:45:07.196777] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-09T19:45:07.996691] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-09T19:45:08.221334] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:45:08.256356] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T19:45:08.796735] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-09T19:45:09.523578] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T19:45:09.596698] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-09T19:45:10.054777] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-09T19:45:10.396715] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-09T19:45:11.201871] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-09T19:45:11.217241] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:45:11.562440] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T19:45:11.996721] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-09T19:45:12.796690] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-09T19:45:12.937955] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T19:45:13.444360] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-09T19:45:13.596690] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-09T19:45:13.636138] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-09T19:45:14.396743] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-09T19:45:14.786740] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:45:14.791120] [INFO ] [REMOTE ] JXN: Full fetch complete (65125 records). [2025-10-09T19:45:14.791273] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-09T19:45:15.208849] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-09T19:45:15.212210] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-09T19:45:15.213294] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-09T19:45:15.214250] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-09T19:45:15.214322] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-09T19:45:15.215961] [DEBUG] [LOCAL ] JXN: Trimmed 65125 records to 45365 (keeping 200 days of data) [2025-10-09T19:45:15.500617] [DEBUG] [LOCAL ] JXN: Primary data saved (45365 records). [2025-10-09T19:45:15.500784] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-09T19:45:15.500874] [INFO ] [MAIN ] Update Progress: 1174/2373 symbols completed. JXN took 29.0s. Estimated remaining: 2h 48m 43s. Rate: 7.1 symbols/min [2025-10-09T19:45:15.667439] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:15.691333] [DEBUG] [LOCAL ] KB: Loaded 23644 existing records from primary storage. [2025-10-09T19:45:15.691593] [INFO ] [MAIN ] KB: Loaded 23644 existing records. [2025-10-09T19:45:15.868302] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:15.868540] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-09T19:45:15.868591] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-09T19:45:15.868844] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-09T19:45:15.868903] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-09T19:45:16.011455] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-09T19:45:16.234860] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:16.265044] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-09T19:45:16.274022] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T19:45:16.796731] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-09T19:45:17.485069] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T19:45:17.596694] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-09T19:45:17.717350] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:45:18.396740] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-09T19:45:19.196700] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-09T19:45:19.461887] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T19:45:19.570321] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T19:45:19.848719] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-09T19:45:19.996702] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-09T19:45:20.796731] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-09T19:45:21.596720] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-09T19:45:21.789917] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T19:45:22.083442] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-09T19:45:22.396737] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-09T19:45:22.851516] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-09T19:45:23.096611] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-09T19:45:23.196714] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-09T19:45:23.996710] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-09T19:45:24.434544] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T19:45:24.616156] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-09T19:45:24.796719] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-09T19:45:25.323888] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-09T19:45:25.596723] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-09T19:45:26.396702] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-09T19:45:26.712577] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-09T19:45:27.196785] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-09T19:45:27.995345] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:45:27.998830] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-09T19:45:27.999902] [INFO ] [REMOTE ] KAR: Full fetch complete (56830 records). [2025-10-09T19:45:28.000040] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-09T19:45:28.386494] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-09T19:45:28.386572] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-09T19:45:28.387420] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-09T19:45:28.387481] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-09T19:45:28.388676] [DEBUG] [LOCAL ] KAR: Trimmed 56830 records to 40359 (keeping 200 days of data) [2025-10-09T19:45:28.639752] [DEBUG] [LOCAL ] KAR: Primary data saved (40359 records). [2025-10-09T19:45:28.640009] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-09T19:45:28.640682] [INFO ] [MAIN ] Update Progress: 1175/2373 symbols completed. KAR took 28.6s. Estimated remaining: 2h 48m 39s. Rate: 7.1 symbols/min [2025-10-09T19:45:28.797523] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-09T19:45:28.818213] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:28.845125] [DEBUG] [LOCAL ] KBDC: Loaded 21569 existing records from primary storage. [2025-10-09T19:45:28.845394] [INFO ] [MAIN ] KBDC: Loaded 21569 existing records. [2025-10-09T19:45:28.994417] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-09T19:45:29.018380] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-09T19:45:29.093923] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:29.094273] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-09T19:45:29.094329] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-09T19:45:29.094594] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-09T19:45:29.094695] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-09T19:45:29.445114] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:29.596689] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-09T19:45:29.931822] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:45:30.396702] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-09T19:45:30.473480] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-09T19:45:31.196769] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-09T19:45:31.682439] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-09T19:45:31.956107] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-09T19:45:31.996698] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-09T19:45:32.796741] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-09T19:45:33.596744] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-09T19:45:33.813276] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-09T19:45:33.823276] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-09T19:45:33.825632] [INFO ] [REMOTE ] K: Full fetch complete (72084 records). [2025-10-09T19:45:33.826257] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-09T19:45:33.826340] [INFO ] [REMOTE ] KAI: Full fetch complete (18812 records). [2025-10-09T19:45:33.826578] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-09T19:45:34.401806] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-09T19:45:34.604577] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-09T19:45:34.622473] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-09T19:45:34.622680] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-09T19:45:34.621770] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-09T19:45:34.623098] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-09T19:45:34.624170] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-09T19:45:34.624284] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-09T19:45:34.624387] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-09T19:45:34.625807] [DEBUG] [LOCAL ] KAI: Trimmed 18812 records to 13436 (keeping 200 days of data) [2025-10-09T19:45:34.626608] [DEBUG] [LOCAL ] K: Trimmed 72084 records to 50465 (keeping 200 days of data) [2025-10-09T19:45:34.812852] [DEBUG] [LOCAL ] KAI: Primary data saved (13436 records). [2025-10-09T19:45:34.813463] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-09T19:45:34.813869] [INFO ] [MAIN ] Update Progress: 1176/2373 symbols completed. KAI took 38.3s. Estimated remaining: 2h 48m 29s. Rate: 7.1 symbols/min [2025-10-09T19:45:34.968484] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T19:45:35.041411] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:35.170844] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-09T19:45:35.202538] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-09T19:45:35.205884] [DEBUG] [LOCAL ] KBH: Loaded 48855 existing records from primary storage. [2025-10-09T19:45:35.206941] [INFO ] [MAIN ] KBH: Loaded 48855 existing records. [2025-10-09T19:45:35.452535] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:35.453295] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-09T19:45:35.453686] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-09T19:45:35.454354] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-09T19:45:35.454427] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-09T19:45:35.567393] [DEBUG] [LOCAL ] K: Primary data saved (50465 records). [2025-10-09T19:45:35.578091] [INFO ] [MAIN ] K: Full history saved. [2025-10-09T19:45:35.583315] [INFO ] [MAIN ] Update Progress: 1177/2373 symbols completed. K took 44.8s. Estimated remaining: 2h 48m 12s. Rate: 7.1 symbols/min [2025-10-09T19:45:35.938021] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:35.999098] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-09T19:45:35.998931] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:36.040936] [DEBUG] [LOCAL ] KBR: Loaded 47850 existing records from primary storage. [2025-10-09T19:45:36.041236] [INFO ] [MAIN ] KBR: Loaded 47850 existing records. [2025-10-09T19:45:36.222504] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:36.222823] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-09T19:45:36.222880] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-09T19:45:36.223071] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-09T19:45:36.223130] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-09T19:45:36.535539] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T19:45:36.616744] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:36.796774] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-09T19:45:36.831112] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-09T19:45:37.596768] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-09T19:45:38.396693] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-09T19:45:38.572846] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T19:45:38.888520] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T19:45:39.196697] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-09T19:45:39.266709] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-09T19:45:39.996684] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-09T19:45:40.383622] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-09T19:45:40.796778] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-09T19:45:41.399235] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:45:41.596685] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-09T19:45:41.839392] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T19:45:42.396741] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-09T19:45:42.911118] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-09T19:45:43.196732] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-09T19:45:43.936779] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-09T19:45:43.996704] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-09T19:45:44.074577] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T19:45:44.624736] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-09T19:45:44.796717] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-09T19:45:45.596738] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-09T19:45:45.802497] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-09T19:45:46.396768] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-09T19:45:47.079703] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T19:45:47.196790] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-09T19:45:47.662684] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-09T19:45:47.925691] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T19:45:47.996765] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-09T19:45:48.796693] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-09T19:45:49.028467] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:45:49.596774] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-09T19:45:50.396749] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-09T19:45:50.465359] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T19:45:50.913003] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T19:45:51.196836] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-09T19:45:51.493176] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-09T19:45:51.996732] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-09T19:45:52.494945] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T19:45:52.796694] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-09T19:45:53.052753] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-09T19:45:53.596778] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-09T19:45:54.124765] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-09T19:45:54.128010] [INFO ] [REMOTE ] KBDC: Full fetch complete (29669 records). [2025-10-09T19:45:54.128093] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-09T19:45:54.405360] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-09T19:45:54.504892] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-09T19:45:54.504965] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-09T19:45:54.505577] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-09T19:45:54.505638] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-09T19:45:54.506340] [DEBUG] [LOCAL ] KBDC: Trimmed 29669 records to 21910 (keeping 200 days of data) [2025-10-09T19:45:54.638384] [DEBUG] [LOCAL ] KBDC: Primary data saved (21910 records). [2025-10-09T19:45:54.638515] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-09T19:45:54.638617] [INFO ] [MAIN ] Update Progress: 1178/2373 symbols completed. KBDC took 26.0s. Estimated remaining: 2h 48m 15s. Rate: 7.1 symbols/min [2025-10-09T19:45:54.804188] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:54.858333] [DEBUG] [LOCAL ] KD: Loaded 52320 existing records from primary storage. [2025-10-09T19:45:54.858713] [INFO ] [MAIN ] KD: Loaded 52320 existing records. [2025-10-09T19:45:55.038027] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:55.038262] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-09T19:45:55.038312] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-09T19:45:55.038556] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-09T19:45:55.038614] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-09T19:45:55.224910] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-09T19:45:55.408413] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:55.518017] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-09T19:45:55.996771] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-09T19:45:56.129363] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-09T19:45:56.236611] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-09T19:45:56.238777] [INFO ] [REMOTE ] KB: Full fetch complete (33736 records). [2025-10-09T19:45:56.238857] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-09T19:45:56.616505] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-09T19:45:56.616579] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-09T19:45:56.617236] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-09T19:45:56.617299] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-09T19:45:56.618121] [DEBUG] [LOCAL ] KB: Trimmed 33736 records to 23768 (keeping 200 days of data) [2025-10-09T19:45:56.762017] [DEBUG] [LOCAL ] KB: Primary data saved (23768 records). [2025-10-09T19:45:56.762147] [INFO ] [MAIN ] KB: Full history saved. [2025-10-09T19:45:56.762241] [INFO ] [MAIN ] Update Progress: 1179/2373 symbols completed. KB took 41.3s. Estimated remaining: 2h 47m 60s. Rate: 7.1 symbols/min [2025-10-09T19:45:56.804585] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-09T19:45:56.933840] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:45:56.941199] [DEBUG] [LOCAL ] KEN: Loaded 4677 existing records from primary storage. [2025-10-09T19:45:56.941424] [INFO ] [MAIN ] KEN: Loaded 4677 existing records. [2025-10-09T19:45:57.117611] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:45:57.117902] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-09T19:45:57.117949] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-09T19:45:57.118105] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-09T19:45:57.118164] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-09T19:45:57.496614] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:45:57.596700] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-09T19:45:57.679421] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T19:45:58.396751] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-09T19:45:58.572679] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:45:59.027130] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-09T19:45:59.196694] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-09T19:45:59.278073] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-09T19:45:59.996719] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-09T19:46:00.724746] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-09T19:46:00.796668] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-09T19:46:01.596706] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-09T19:46:01.818364] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-09T19:46:02.166250] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T19:46:02.396692] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-09T19:46:02.573269] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-09T19:46:03.196742] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-09T19:46:03.959916] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-09T19:46:03.996682] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-09T19:46:04.619500] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-09T19:46:04.796747] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-09T19:46:05.329160] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T19:46:05.596743] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-09T19:46:06.040904] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T19:46:06.094524] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-09T19:46:06.396726] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-09T19:46:07.196723] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-09T19:46:07.996718] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-09T19:46:08.098664] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T19:46:08.103041] [INFO ] [REMOTE ] KBH: Full fetch complete (70810 records). [2025-10-09T19:46:08.103159] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-09T19:46:08.519493] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-09T19:46:08.519576] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-09T19:46:08.520750] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-09T19:46:08.520815] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-09T19:46:08.522233] [DEBUG] [LOCAL ] KBH: Trimmed 70810 records to 49233 (keeping 200 days of data) [2025-10-09T19:46:08.799207] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-09T19:46:08.803740] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T19:46:08.840410] [DEBUG] [LOCAL ] KBH: Primary data saved (49233 records). [2025-10-09T19:46:08.856863] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-09T19:46:08.864189] [INFO ] [MAIN ] Update Progress: 1180/2373 symbols completed. KBH took 34.0s. Estimated remaining: 2h 47m 55s. Rate: 7.1 symbols/min [2025-10-09T19:46:08.939521] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T19:46:09.049834] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:09.080605] [DEBUG] [LOCAL ] KEP: Loaded 31433 existing records from primary storage. [2025-10-09T19:46:09.080927] [INFO ] [MAIN ] KEP: Loaded 31433 existing records. [2025-10-09T19:46:09.253932] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:09.254130] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-09T19:46:09.254176] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-09T19:46:09.254374] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-09T19:46:09.254430] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-09T19:46:09.602084] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-09T19:46:09.607618] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:10.396761] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-09T19:46:10.556709] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-09T19:46:11.003827] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-09T19:46:11.156336] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:46:11.196673] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-09T19:46:11.802442] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-09T19:46:11.996708] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-09T19:46:12.613774] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-09T19:46:12.796739] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-09T19:46:13.596772] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-09T19:46:14.077121] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T19:46:14.242504] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-09T19:46:14.396715] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-09T19:46:15.196757] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-09T19:46:15.972790] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T19:46:15.976940] [INFO ] [REMOTE ] KBR: Full fetch complete (69751 records). [2025-10-09T19:46:15.977061] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-09T19:46:16.001405] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-09T19:46:16.405150] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-09T19:46:16.405851] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-09T19:46:16.406323] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-09T19:46:16.407327] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-09T19:46:16.412472] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-09T19:46:16.414427] [DEBUG] [LOCAL ] KBR: Trimmed 69751 records to 48203 (keeping 200 days of data) [2025-10-09T19:46:16.530985] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-09T19:46:16.732716] [DEBUG] [LOCAL ] KBR: Primary data saved (48203 records). [2025-10-09T19:46:16.732855] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-09T19:46:16.732937] [INFO ] [MAIN ] Update Progress: 1181/2373 symbols completed. KBR took 41.1s. Estimated remaining: 2h 47m 46s. Rate: 7.1 symbols/min [2025-10-09T19:46:16.801880] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-09T19:46:16.917636] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:16.960219] [DEBUG] [LOCAL ] KEX: Loaded 38497 existing records from primary storage. [2025-10-09T19:46:16.960517] [INFO ] [MAIN ] KEX: Loaded 38497 existing records. [2025-10-09T19:46:17.138080] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:17.138282] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-09T19:46:17.138329] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-09T19:46:17.138545] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-09T19:46:17.138602] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-09T19:46:17.264615] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T19:46:17.516436] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:17.596674] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-09T19:46:18.396749] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-09T19:46:18.601724] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T19:46:19.045030] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-09T19:46:19.045862] [INFO ] [REMOTE ] KEN: Full fetch complete (5948 records). [2025-10-09T19:46:19.045930] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-09T19:46:19.200565] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-09T19:46:19.405927] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-09T19:46:19.406029] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-09T19:46:19.406221] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-09T19:46:19.406263] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-09T19:46:19.406770] [DEBUG] [LOCAL ] KEN: Trimmed 5948 records to 4702 (keeping 200 days of data) [2025-10-09T19:46:19.434590] [DEBUG] [LOCAL ] KEN: Primary data saved (4702 records). [2025-10-09T19:46:19.434728] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-09T19:46:19.434819] [INFO ] [MAIN ] Update Progress: 1182/2373 symbols completed. KEN took 22.7s. Estimated remaining: 2h 47m 32s. Rate: 7.1 symbols/min [2025-10-09T19:46:19.600256] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:19.600446] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-09T19:46:19.600484] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-09T19:46:19.600623] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-09T19:46:19.600698] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-09T19:46:19.600753] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-09T19:46:19.600787] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-09T19:46:19.948825] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:19.996713] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-09T19:46:20.163135] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-09T19:46:20.796720] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-09T19:46:21.601871] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-09T19:46:21.628284] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-09T19:46:22.270984] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T19:46:22.396729] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-09T19:46:22.868832] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-09T19:46:23.196721] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-09T19:46:23.996704] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-09T19:46:24.108898] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T19:46:24.538552] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-09T19:46:24.796764] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-09T19:46:25.496252] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T19:46:25.596733] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-09T19:46:26.160220] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-09T19:46:26.396699] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-09T19:46:26.913198] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-09T19:46:27.196745] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-09T19:46:27.636701] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T19:46:27.996775] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-09T19:46:28.796787] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-09T19:46:28.882940] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T19:46:29.596766] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-09T19:46:29.661375] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:46:30.319282] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T19:46:30.396672] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-09T19:46:31.049443] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T19:46:31.196786] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-09T19:46:31.611149] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-09T19:46:31.996730] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-09T19:46:32.652984] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-09T19:46:32.796717] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-09T19:46:33.184848] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T19:46:33.596755] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-09T19:46:34.098628] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-09T19:46:34.396741] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-09T19:46:34.927529] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T19:46:35.196766] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-09T19:46:35.430350] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T19:46:35.996798] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-09T19:46:36.796764] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-09T19:46:37.018546] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T19:46:37.313730] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-09T19:46:37.316886] [INFO ] [REMOTE ] KEP: Full fetch complete (41877 records). [2025-10-09T19:46:37.316976] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-09T19:46:37.601920] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-09T19:46:37.725981] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-09T19:46:37.726064] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-09T19:46:37.726805] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-09T19:46:37.726872] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-09T19:46:37.727883] [DEBUG] [LOCAL ] KEP: Trimmed 41877 records to 31601 (keeping 200 days of data) [2025-10-09T19:46:37.910939] [DEBUG] [LOCAL ] KEP: Primary data saved (31601 records). [2025-10-09T19:46:37.911080] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-09T19:46:37.911204] [INFO ] [MAIN ] Update Progress: 1183/2373 symbols completed. KEP took 29.0s. Estimated remaining: 2h 47m 33s. Rate: 7.1 symbols/min [2025-10-09T19:46:38.081342] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:38.123305] [DEBUG] [LOCAL ] KEYS: Loaded 43126 existing records from primary storage. [2025-10-09T19:46:38.123610] [INFO ] [MAIN ] KEYS: Loaded 43126 existing records. [2025-10-09T19:46:38.307476] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:38.307806] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-09T19:46:38.307936] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-09T19:46:38.308216] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-09T19:46:38.308273] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-09T19:46:38.397427] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-09T19:46:38.701094] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T19:46:38.706211] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:39.196685] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-09T19:46:39.253180] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T19:46:39.541698] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-09T19:46:39.996723] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-09T19:46:40.796680] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-09T19:46:41.136182] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-09T19:46:41.205238] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-09T19:46:41.596709] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-09T19:46:42.222368] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-09T19:46:42.396702] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-09T19:46:43.196727] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-09T19:46:43.479768] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T19:46:43.996687] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-09T19:46:44.178103] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-09T19:46:44.330553] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:46:44.796772] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-09T19:46:45.315224] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T19:46:45.596810] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-09T19:46:46.396708] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-09T19:46:46.503886] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-09T19:46:46.508448] [INFO ] [REMOTE ] KD: Full fetch complete (75713 records). [2025-10-09T19:46:46.508573] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-09T19:46:46.897110] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-09T19:46:46.897191] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-09T19:46:46.898295] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-09T19:46:46.898360] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-09T19:46:46.899780] [DEBUG] [LOCAL ] KD: Trimmed 75713 records to 52707 (keeping 200 days of data) [2025-10-09T19:46:47.197491] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-09T19:46:47.211285] [DEBUG] [LOCAL ] KD: Primary data saved (52707 records). [2025-10-09T19:46:47.211371] [INFO ] [MAIN ] KD: Full history saved. [2025-10-09T19:46:47.211961] [INFO ] [MAIN ] Update Progress: 1184/2373 symbols completed. KD took 52.6s. Estimated remaining: 2h 47m 26s. Rate: 7.1 symbols/min [2025-10-09T19:46:47.387062] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:47.413128] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-09T19:46:47.412338] [DEBUG] [LOCAL ] KF: Loaded 2375 existing records from primary storage. [2025-10-09T19:46:47.421535] [INFO ] [MAIN ] KF: Loaded 2375 existing records. [2025-10-09T19:46:47.620588] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:47.620819] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-09T19:46:47.620874] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-09T19:46:47.621066] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-09T19:46:47.621122] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-09T19:46:47.746044] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-09T19:46:47.796950] [INFO ] [REMOTE ] KEX: Full fetch complete (55775 records). [2025-10-09T19:46:47.812632] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-09T19:46:48.015765] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-09T19:46:48.128783] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:48.380845] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-09T19:46:48.380921] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-09T19:46:48.381762] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-09T19:46:48.381825] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-09T19:46:48.382953] [DEBUG] [LOCAL ] KEX: Trimmed 55775 records to 38809 (keeping 200 days of data) [2025-10-09T19:46:48.611562] [DEBUG] [LOCAL ] KEX: Primary data saved (38809 records). [2025-10-09T19:46:48.611728] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-09T19:46:48.611845] [INFO ] [MAIN ] Update Progress: 1185/2373 symbols completed. KEX took 31.9s. Estimated remaining: 2h 47m 10s. Rate: 7.1 symbols/min [2025-10-09T19:46:48.785248] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:48.796718] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-09T19:46:48.806633] [DEBUG] [LOCAL ] KFRC: Loaded 20015 existing records from primary storage. [2025-10-09T19:46:48.807003] [INFO ] [MAIN ] KFRC: Loaded 20015 existing records. [2025-10-09T19:46:49.006027] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:46:49.040838] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:49.041102] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-09T19:46:49.041150] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-09T19:46:49.041469] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-09T19:46:49.041528] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-09T19:46:49.349621] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-09T19:46:49.450887] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:49.491848] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T19:46:49.596793] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-09T19:46:50.396756] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-09T19:46:51.169951] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-09T19:46:51.196705] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-09T19:46:51.320385] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-09T19:46:51.996724] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-09T19:46:52.572212] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T19:46:52.794639] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-09T19:46:52.797072] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-09T19:46:53.354091] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T19:46:53.596731] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-09T19:46:54.396716] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-09T19:46:54.421475] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T19:46:55.196728] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-09T19:46:55.728049] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T19:46:55.998152] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-09T19:46:56.014261] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-09T19:46:56.796724] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-09T19:46:57.386254] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T19:46:57.390919] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-09T19:46:57.391036] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-09T19:46:57.609099] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-09T19:46:57.608953] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T19:46:57.611929] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-09T19:46:57.611412] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:46:57.615683] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:46:57.616438] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-09T19:46:57.616519] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-09T19:46:57.616557] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-09T19:46:57.616614] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-09T19:46:57.616738] [INFO ] [MAIN ] Update Progress: 1186/2373 symbols completed. KEY took 38.2s. Estimated remaining: 2h 47m 3s. Rate: 7.1 symbols/min [2025-10-09T19:46:57.784240] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:46:57.795230] [DEBUG] [LOCAL ] KFS: Loaded 8566 existing records from primary storage. [2025-10-09T19:46:57.795455] [INFO ] [MAIN ] KFS: Loaded 8566 existing records. [2025-10-09T19:46:57.971015] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:46:57.971361] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-09T19:46:57.971421] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-09T19:46:57.971682] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-09T19:46:57.971742] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-09T19:46:58.247668] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-09T19:46:58.325105] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:46:58.396739] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-09T19:46:58.956370] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-09T19:46:59.196769] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-09T19:46:59.774244] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-09T19:46:59.996776] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-09T19:47:00.500260] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-09T19:47:00.796791] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-09T19:47:01.596774] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-09T19:47:02.296426] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T19:47:02.376597] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-09T19:47:02.396665] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-09T19:47:03.112585] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T19:47:03.196674] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-09T19:47:03.996745] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-09T19:47:04.485527] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-09T19:47:04.796694] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-09T19:47:04.833199] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:47:05.596735] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-09T19:47:05.675982] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T19:47:06.016158] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T19:47:06.396744] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-09T19:47:06.976083] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T19:47:07.196728] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-09T19:47:07.996715] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-09T19:47:08.568597] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T19:47:08.638932] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T19:47:08.796707] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-09T19:47:09.596736] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-09T19:47:09.914247] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-09T19:47:10.059147] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-09T19:47:10.396739] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-09T19:47:10.999775] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-09T19:47:11.196723] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-09T19:47:11.925794] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-09T19:47:11.996680] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-09T19:47:12.762625] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-09T19:47:12.796676] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-09T19:47:13.596721] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-09T19:47:14.023607] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T19:47:14.094529] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-09T19:47:14.396718] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-09T19:47:15.134441] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T19:47:15.196681] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-09T19:47:15.960713] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-09T19:47:15.996676] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-09T19:47:16.759372] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-09T19:47:16.796721] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-09T19:47:17.304539] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-09T19:47:17.305530] [INFO ] [REMOTE ] KF: Full fetch complete (3544 records). [2025-10-09T19:47:17.305610] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-09T19:47:17.601883] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-09T19:47:17.699453] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-09T19:47:17.699548] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-09T19:47:17.699720] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-09T19:47:17.699783] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-09T19:47:17.700145] [DEBUG] [LOCAL ] KF: Trimmed 3544 records to 2381 (keeping 200 days of data) [2025-10-09T19:47:17.715169] [DEBUG] [LOCAL ] KF: Primary data saved (2381 records). [2025-10-09T19:47:17.715265] [INFO ] [MAIN ] KF: Full history saved. [2025-10-09T19:47:17.715362] [INFO ] [MAIN ] Update Progress: 1187/2373 symbols completed. KF took 30.5s. Estimated remaining: 2h 47m 6s. Rate: 7.1 symbols/min [2025-10-09T19:47:17.881541] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:17.912591] [DEBUG] [LOCAL ] KFY: Loaded 29870 existing records from primary storage. [2025-10-09T19:47:17.912896] [INFO ] [MAIN ] KFY: Loaded 29870 existing records. [2025-10-09T19:47:18.088491] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:18.088765] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-09T19:47:18.088818] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-09T19:47:18.089036] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-09T19:47:18.089093] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-09T19:47:18.401880] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-09T19:47:18.459664] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:47:18.878404] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T19:47:19.196697] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-09T19:47:19.589498] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-09T19:47:19.996704] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-09T19:47:20.284198] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-09T19:47:20.796700] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-09T19:47:21.111038] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-09T19:47:21.113543] [INFO ] [REMOTE ] KFRC: Full fetch complete (26139 records). [2025-10-09T19:47:21.113635] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-09T19:47:21.500201] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-09T19:47:21.531163] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-09T19:47:21.531248] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-09T19:47:21.531868] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-09T19:47:21.531930] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-09T19:47:21.532696] [DEBUG] [LOCAL ] KFRC: Trimmed 26139 records to 20191 (keeping 200 days of data) [2025-10-09T19:47:21.622010] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-09T19:47:21.668834] [DEBUG] [LOCAL ] KFRC: Primary data saved (20191 records). [2025-10-09T19:47:21.668981] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-09T19:47:21.669066] [INFO ] [MAIN ] Update Progress: 1188/2373 symbols completed. KFRC took 33.1s. Estimated remaining: 2h 46m 53s. Rate: 7.1 symbols/min [2025-10-09T19:47:21.879201] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:21.938553] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-09T19:47:21.938918] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-09T19:47:22.156043] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:22.156303] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-09T19:47:22.156358] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-09T19:47:22.156580] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-09T19:47:22.156639] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-09T19:47:22.275581] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T19:47:22.401984] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-09T19:47:22.548713] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:47:23.196730] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-09T19:47:23.624445] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-09T19:47:23.996709] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-09T19:47:24.640410] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-09T19:47:24.796731] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-09T19:47:25.133372] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-09T19:47:25.596708] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-09T19:47:26.137335] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:47:26.141603] [INFO ] [REMOTE ] KEYS: Full fetch complete (62595 records). [2025-10-09T19:47:26.141788] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-09T19:47:26.322717] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T19:47:26.400587] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-09T19:47:26.401161] [INFO ] [REMOTE ] KFS: Full fetch complete (10734 records). [2025-10-09T19:47:26.418830] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-09T19:47:26.775987] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-09T19:47:26.835726] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-09T19:47:26.847868] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-09T19:47:26.853101] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-09T19:47:26.896076] [DEBUG] [LOCAL ] KEYS: Trimmed 62595 records to 43424 (keeping 200 days of data) [2025-10-09T19:47:27.015568] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-09T19:47:27.015730] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-09T19:47:27.015896] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-09T19:47:27.015969] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-09T19:47:27.045502] [DEBUG] [LOCAL ] KFS: Trimmed 10734 records to 8608 (keeping 200 days of data) [2025-10-09T19:47:27.115594] [DEBUG] [LOCAL ] KFS: Primary data saved (8608 records). [2025-10-09T19:47:27.117509] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-09T19:47:27.118505] [INFO ] [MAIN ] Update Progress: 1189/2373 symbols completed. KFS took 29.5s. Estimated remaining: 2h 46m 41s. Rate: 7.1 symbols/min [2025-10-09T19:47:27.201096] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-09T19:47:27.304048] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:27.441942] [DEBUG] [LOCAL ] KGS: Loaded 45924 existing records from primary storage. [2025-10-09T19:47:27.443075] [INFO ] [MAIN ] KGS: Loaded 45924 existing records. [2025-10-09T19:47:27.632461] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:27.633857] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-09T19:47:27.634228] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-09T19:47:27.635709] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-09T19:47:27.638748] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-09T19:47:27.815943] [DEBUG] [LOCAL ] KEYS: Primary data saved (43424 records). [2025-10-09T19:47:27.824458] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-09T19:47:27.856732] [INFO ] [MAIN ] Update Progress: 1190/2373 symbols completed. KEYS took 49.9s. Estimated remaining: 2h 46m 25s. Rate: 7.1 symbols/min [2025-10-09T19:47:28.190131] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:47:28.219154] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-09T19:47:28.254529] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:28.288873] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-09T19:47:28.343888] [DEBUG] [LOCAL ] KIM: Loaded 53001 existing records from primary storage. [2025-10-09T19:47:28.344212] [INFO ] [MAIN ] KIM: Loaded 53001 existing records. [2025-10-09T19:47:28.524954] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:28.525448] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-09T19:47:28.525596] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-09T19:47:28.525976] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-09T19:47:28.526059] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-09T19:47:28.675220] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T19:47:28.802424] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-09T19:47:28.926324] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:47:29.482062] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-09T19:47:29.596673] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-09T19:47:30.396701] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-09T19:47:30.696914] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T19:47:31.100911] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-09T19:47:31.196716] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-09T19:47:31.441964] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T19:47:31.996726] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-09T19:47:32.796835] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-09T19:47:32.955267] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-09T19:47:33.223461] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-09T19:47:33.596791] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-09T19:47:34.396718] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-09T19:47:34.536312] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-09T19:47:35.136775] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-09T19:47:35.196706] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-09T19:47:35.526541] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-09T19:47:35.996782] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-09T19:47:36.658111] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T19:47:36.796691] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-09T19:47:37.535062] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-09T19:47:37.596682] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-09T19:47:38.396775] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-09T19:47:38.470866] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-09T19:47:38.931441] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T19:47:39.196801] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-09T19:47:39.785707] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-09T19:47:39.996736] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-09T19:47:40.796702] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-09T19:47:40.844170] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T19:47:41.596699] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-09T19:47:41.701549] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-09T19:47:41.931743] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-09T19:47:42.396753] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-09T19:47:43.196691] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-09T19:47:43.283825] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-09T19:47:43.442852] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T19:47:43.996754] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-09T19:47:44.631533] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T19:47:44.796695] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-09T19:47:45.328140] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-09T19:47:45.596713] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-09T19:47:46.396738] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-09T19:47:46.593772] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T19:47:46.935980] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-09T19:47:46.938847] [INFO ] [REMOTE ] KFY: Full fetch complete (43187 records). [2025-10-09T19:47:46.939030] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-09T19:47:47.201842] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-09T19:47:47.344742] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-09T19:47:47.344867] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-09T19:47:47.346090] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-09T19:47:47.346374] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-09T19:47:47.347970] [DEBUG] [LOCAL ] KFY: Trimmed 43187 records to 30040 (keeping 200 days of data) [2025-10-09T19:47:47.549283] [DEBUG] [LOCAL ] KFY: Primary data saved (30040 records). [2025-10-09T19:47:47.549420] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-09T19:47:47.550135] [INFO ] [MAIN ] Update Progress: 1191/2373 symbols completed. KFY took 29.8s. Estimated remaining: 2h 46m 28s. Rate: 7.1 symbols/min [2025-10-09T19:47:47.717943] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:47.740159] [DEBUG] [LOCAL ] KIO: Loaded 21461 existing records from primary storage. [2025-10-09T19:47:47.740430] [INFO ] [MAIN ] KIO: Loaded 21461 existing records. [2025-10-09T19:47:47.913239] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:47.913393] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-09T19:47:47.913439] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-09T19:47:47.913624] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-09T19:47:47.913716] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-09T19:47:48.002261] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-09T19:47:48.274249] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:47:48.409847] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-09T19:47:48.796705] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-09T19:47:48.952939] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-09T19:47:49.129777] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-09T19:47:49.596697] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-09T19:47:49.619145] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T19:47:50.396759] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-09T19:47:51.196772] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-09T19:47:51.384567] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-09T19:47:52.001818] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-09T19:47:52.016547] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T19:47:52.217723] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:47:52.796725] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-09T19:47:53.590695] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-09T19:47:53.596670] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-09T19:47:53.803700] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-09T19:47:54.396684] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-09T19:47:54.709526] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-09T19:47:55.196753] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-09T19:47:55.996688] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-09T19:47:56.180392] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-09T19:47:56.695244] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-09T19:47:56.796699] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-09T19:47:57.596741] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-09T19:47:57.716154] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-09T19:47:58.396694] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-09T19:47:58.518420] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-09T19:47:58.523185] [INFO ] [REMOTE ] KIM: Full fetch complete (76798 records). [2025-10-09T19:47:58.523319] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-09T19:47:58.914199] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-09T19:47:58.914288] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-09T19:47:58.915282] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-09T19:47:58.915349] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-09T19:47:58.916862] [DEBUG] [LOCAL ] KIM: Trimmed 76798 records to 53373 (keeping 200 days of data) [2025-10-09T19:47:59.203165] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-09T19:47:59.256903] [DEBUG] [LOCAL ] KIM: Primary data saved (53373 records). [2025-10-09T19:47:59.257069] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-09T19:47:59.257334] [INFO ] [MAIN ] Update Progress: 1192/2373 symbols completed. KIM took 31.4s. Estimated remaining: 2h 46m 23s. Rate: 7.1 symbols/min [2025-10-09T19:47:59.369881] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-09T19:47:59.472174] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:47:59.485688] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T19:47:59.537508] [DEBUG] [LOCAL ] KKR: Loaded 53502 existing records from primary storage. [2025-10-09T19:47:59.537888] [INFO ] [MAIN ] KKR: Loaded 53502 existing records. [2025-10-09T19:47:59.711850] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:47:59.712126] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-09T19:47:59.712173] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-09T19:47:59.712473] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-09T19:47:59.712529] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-09T19:48:00.001818] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-09T19:48:00.069202] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:00.796762] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-09T19:48:01.221463] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-09T19:48:01.434695] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-09T19:48:01.596685] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-09T19:48:02.396691] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-09T19:48:02.548012] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-09T19:48:02.552027] [INFO ] [REMOTE ] KGS: Full fetch complete (66361 records). [2025-10-09T19:48:02.552131] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-09T19:48:02.931783] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-09T19:48:02.931867] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-09T19:48:02.932819] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-09T19:48:02.932884] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-09T19:48:02.934308] [DEBUG] [LOCAL ] KGS: Trimmed 66361 records to 46271 (keeping 200 days of data) [2025-10-09T19:48:03.197692] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-09T19:48:03.202796] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T19:48:03.268911] [DEBUG] [LOCAL ] KGS: Primary data saved (46271 records). [2025-10-09T19:48:03.269067] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-09T19:48:03.269175] [INFO ] [MAIN ] Update Progress: 1193/2373 symbols completed. KGS took 36.2s. Estimated remaining: 2h 46m 10s. Rate: 7.1 symbols/min [2025-10-09T19:48:03.434555] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:03.443251] [DEBUG] [LOCAL ] KKRS: Loaded 5729 existing records from primary storage. [2025-10-09T19:48:03.443469] [INFO ] [MAIN ] KKRS: Loaded 5729 existing records. [2025-10-09T19:48:03.616433] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:03.616689] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-09T19:48:03.616747] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-09T19:48:03.616935] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-09T19:48:03.616991] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-09T19:48:03.972814] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:03.996670] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-09T19:48:04.182165] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-09T19:48:04.523550] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-09T19:48:04.722580] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T19:48:04.796727] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-09T19:48:05.596761] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-09T19:48:06.396717] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-09T19:48:06.481816] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-09T19:48:06.796144] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-09T19:48:07.196728] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-09T19:48:07.786574] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-09T19:48:07.996789] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-09T19:48:08.536957] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-09T19:48:08.796727] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-09T19:48:08.931325] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T19:48:09.596776] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-09T19:48:09.646698] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-09T19:48:10.396728] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-09T19:48:11.196699] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-09T19:48:11.276707] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T19:48:11.511731] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-09T19:48:11.721270] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-09T19:48:11.996708] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-09T19:48:12.796756] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-09T19:48:13.130009] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:48:13.234556] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-09T19:48:13.596719] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-09T19:48:14.396688] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-09T19:48:14.511098] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-09T19:48:14.513588] [INFO ] [REMOTE ] KIO: Full fetch complete (31505 records). [2025-10-09T19:48:14.513694] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-09T19:48:14.884586] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-09T19:48:14.884693] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-09T19:48:14.885380] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-09T19:48:14.885442] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-09T19:48:14.886206] [DEBUG] [LOCAL ] KIO: Trimmed 31505 records to 21605 (keeping 200 days of data) [2025-10-09T19:48:15.021928] [DEBUG] [LOCAL ] KIO: Primary data saved (21605 records). [2025-10-09T19:48:15.022061] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-09T19:48:15.022153] [INFO ] [MAIN ] Update Progress: 1194/2373 symbols completed. KIO took 27.5s. Estimated remaining: 2h 46m 5s. Rate: 7.1 symbols/min [2025-10-09T19:48:15.202300] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-09T19:48:15.209771] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:15.210984] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-09T19:48:15.211033] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-09T19:48:15.211148] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-09T19:48:15.211190] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-09T19:48:15.211231] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-09T19:48:15.211263] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-09T19:48:15.576580] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:15.996746] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-09T19:48:16.306108] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T19:48:16.729783] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-09T19:48:16.796713] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-09T19:48:17.176055] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-09T19:48:17.180763] [INFO ] [REMOTE ] KGC: Full fetch complete (77701 records). [2025-10-09T19:48:17.180887] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-09T19:48:17.304048] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-09T19:48:17.579669] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-09T19:48:17.579769] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-09T19:48:17.580783] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-09T19:48:17.580849] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-09T19:48:17.582319] [DEBUG] [LOCAL ] KGC: Trimmed 77701 records to 54089 (keeping 200 days of data) [2025-10-09T19:48:17.643530] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-09T19:48:17.907855] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:48:17.910139] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-09T19:48:17.910770] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:48:17.911923] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-09T19:48:17.912941] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:48:17.913249] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-09T19:48:17.913876] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-09T19:48:17.914451] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-09T19:48:17.915078] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-09T19:48:17.915182] [INFO ] [MAIN ] Update Progress: 1195/2373 symbols completed. KKRT took 2.9s. Estimated remaining: 2h 45m 51s. Rate: 7.1 symbols/min [2025-10-09T19:48:18.142286] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:18.143333] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-09T19:48:18.143427] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-09T19:48:18.145085] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-09T19:48:18.145726] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-09T19:48:18.146556] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-09T19:48:18.147159] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-09T19:48:18.281994] [DEBUG] [LOCAL ] KGC: Primary data saved (54089 records). [2025-10-09T19:48:18.288290] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-09T19:48:18.288425] [INFO ] [MAIN ] Update Progress: 1196/2373 symbols completed. KGC took 56.6s. Estimated remaining: 2h 45m 34s. Rate: 7.1 symbols/min [2025-10-09T19:48:18.406226] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-09T19:48:18.706313] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:18.779474] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:18.810029] [DEBUG] [LOCAL ] KLC: Loaded 36726 existing records from primary storage. [2025-10-09T19:48:18.810359] [INFO ] [MAIN ] KLC: Loaded 36726 existing records. [2025-10-09T19:48:18.986512] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:18.986780] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-09T19:48:18.986834] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-09T19:48:18.987099] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-09T19:48:18.987157] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-09T19:48:19.201910] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-09T19:48:19.333136] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:19.880371] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-09T19:48:19.996721] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-09T19:48:20.209396] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-09T19:48:20.343599] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-09T19:48:20.796741] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-09T19:48:21.001210] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:48:21.001536] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-09T19:48:21.001628] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:48:21.001739] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-09T19:48:21.001830] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:48:21.001911] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-09T19:48:21.001995] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-09T19:48:21.002034] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-09T19:48:21.002096] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-09T19:48:21.002170] [INFO ] [MAIN ] Update Progress: 1197/2373 symbols completed. KLAR took 3.1s. Estimated remaining: 2h 45m 20s. Rate: 7.1 symbols/min [2025-10-09T19:48:21.596803] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-09T19:48:22.396804] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-09T19:48:23.038445] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T19:48:23.196706] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-09T19:48:23.919979] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:48:23.996717] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-09T19:48:24.552857] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-09T19:48:24.803705] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-09T19:48:24.830289] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:48:25.353533] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-09T19:48:25.354617] [INFO ] [REMOTE ] KKRS: Full fetch complete (7744 records). [2025-10-09T19:48:25.354733] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-09T19:48:25.603594] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-09T19:48:25.710381] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-09T19:48:25.710447] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-09T19:48:25.710696] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-09T19:48:25.710761] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-09T19:48:25.711240] [DEBUG] [LOCAL ] KKRS: Trimmed 7744 records to 5747 (keeping 200 days of data) [2025-10-09T19:48:25.747082] [DEBUG] [LOCAL ] KKRS: Primary data saved (5747 records). [2025-10-09T19:48:25.747172] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-09T19:48:25.747250] [INFO ] [MAIN ] Update Progress: 1198/2373 symbols completed. KKRS took 22.5s. Estimated remaining: 2h 45m 8s. Rate: 7.1 symbols/min [2025-10-09T19:48:26.396769] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-09T19:48:26.589905] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-09T19:48:27.196691] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-09T19:48:28.011772] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T19:48:28.017293] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-09T19:48:28.089140] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T19:48:28.796745] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-09T19:48:29.394783] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T19:48:29.596731] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-09T19:48:30.469109] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-09T19:48:30.488451] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-09T19:48:30.702368] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-09T19:48:31.196769] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-09T19:48:32.044621] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-09T19:48:32.049235] [INFO ] [REMOTE ] KKR: Full fetch complete (77452 records). [2025-10-09T19:48:32.049345] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-09T19:48:32.438939] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-09T19:48:32.439022] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-09T19:48:32.440018] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-09T19:48:32.440082] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-09T19:48:32.441729] [DEBUG] [LOCAL ] KKR: Trimmed 77452 records to 53892 (keeping 200 days of data) [2025-10-09T19:48:32.693980] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T19:48:32.704755] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-09T19:48:32.821409] [DEBUG] [LOCAL ] KKR: Primary data saved (53892 records). [2025-10-09T19:48:32.821549] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-09T19:48:32.821632] [INFO ] [MAIN ] Update Progress: 1199/2373 symbols completed. KKR took 33.6s. Estimated remaining: 2h 44m 58s. Rate: 7.1 symbols/min [2025-10-09T19:48:34.080638] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-09T19:48:34.088115] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-09T19:48:35.134459] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-09T19:48:35.142257] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-09T19:48:36.557037] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T19:48:36.565569] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-09T19:48:37.987099] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-09T19:48:37.995775] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-09T19:48:39.271198] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-09T19:48:39.274838] [INFO ] [REMOTE ] KLC: Full fetch complete (50552 records). [2025-10-09T19:48:39.274951] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-09T19:48:39.648848] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-09T19:48:39.648924] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-09T19:48:39.649688] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-09T19:48:39.649750] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-09T19:48:39.650766] [DEBUG] [LOCAL ] KLC: Trimmed 50552 records to 37008 (keeping 200 days of data) [2025-10-09T19:48:39.860919] [DEBUG] [LOCAL ] KLC: Primary data saved (37008 records). [2025-10-09T19:48:39.861052] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-09T19:48:39.861135] [INFO ] [MAIN ] Update Progress: 1200/2373 symbols completed. KLC took 21.6s. Estimated remaining: 2h 44m 49s. Rate: 7.1 symbols/min [2025-10-09T19:48:40.520353] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:40.512121] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:40.570977] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:40.592496] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:48:40.599842] [DEBUG] [LOCAL ] KMPB: Loaded 3832 existing records from primary storage. [2025-10-09T19:48:40.600250] [INFO ] [MAIN ] KMPB: Loaded 3832 existing records. [2025-10-09T19:48:40.831781] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:40.832255] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-09T19:48:40.832315] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-09T19:48:40.832482] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-09T19:48:40.832538] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-09T19:48:40.924158] [DEBUG] [LOCAL ] KMPR: Loaded 39350 existing records from primary storage. [2025-10-09T19:48:40.982184] [DEBUG] [LOCAL ] KMT: Loaded 42969 existing records from primary storage. [2025-10-09T19:48:40.976044] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-09T19:48:40.975201] [INFO ] [MAIN ] KMPR: Loaded 39350 existing records. [2025-10-09T19:48:40.987771] [INFO ] [MAIN ] KMT: Loaded 42969 existing records. [2025-10-09T19:48:41.009373] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-09T19:48:41.604992] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:41.677582] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-09T19:48:41.724078] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:41.741208] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-09T19:48:41.760910] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-09T19:48:41.771106] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-09T19:48:41.773879] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-09T19:48:41.760806] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:48:41.796241] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-09T19:48:41.797385] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-09T19:48:41.798219] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-09T19:48:41.798148] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-09T19:48:41.821994] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:41.830671] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-09T19:48:41.831002] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-09T19:48:41.880048] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-09T19:48:41.880240] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-09T19:48:42.605746] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-09T19:48:42.628062] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-09T19:48:42.749368] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:42.804836] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-09T19:48:42.913463] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:42.907756] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:48:42.913813] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-09T19:48:42.914108] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-09T19:48:43.187526] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-09T19:48:43.188764] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-09T19:48:43.644064] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T19:48:43.645310] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-09T19:48:43.960947] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-09T19:48:43.966753] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-09T19:48:43.992576] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-09T19:48:43.994235] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-09T19:48:44.382795] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T19:48:44.395917] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-09T19:48:44.610340] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-09T19:48:44.612376] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-09T19:48:44.614030] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T19:48:44.796672] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-09T19:48:44.855136] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-09T19:48:44.951198] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-09T19:48:45.596728] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-09T19:48:45.840052] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-09T19:48:46.396688] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-09T19:48:46.453037] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:48:46.543822] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-09T19:48:46.968491] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-09T19:48:47.196744] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-09T19:48:47.996716] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-09T19:48:48.315801] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-09T19:48:48.732230] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-09T19:48:48.796754] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-09T19:48:49.596714] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-09T19:48:50.179306] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-09T19:48:50.396725] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-09T19:48:51.125812] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T19:48:51.196675] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-09T19:48:51.795560] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-09T19:48:51.996718] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-09T19:48:52.570390] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-09T19:48:52.796787] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-09T19:48:53.349844] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-09T19:48:53.596744] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-09T19:48:54.396109] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T19:48:54.405216] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-09T19:48:54.639027] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T19:48:55.196767] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-09T19:48:55.764824] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T19:48:55.990381] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:48:56.003533] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-09T19:48:56.796748] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-09T19:48:57.441444] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-09T19:48:57.441210] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:48:57.596682] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-09T19:48:58.396756] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-09T19:48:59.196703] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-09T19:48:59.310004] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-09T19:48:59.625475] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-09T19:48:59.996747] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-09T19:49:00.796706] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-09T19:49:01.318015] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-09T19:49:01.420376] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-09T19:49:01.596731] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-09T19:49:02.113524] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T19:49:02.114462] [INFO ] [REMOTE ] KMPB: Full fetch complete (5074 records). [2025-10-09T19:49:02.114532] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-09T19:49:02.399209] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-09T19:49:02.494772] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-09T19:49:02.495097] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-09T19:49:02.495415] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-09T19:49:02.495505] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-09T19:49:02.511169] [DEBUG] [LOCAL ] KMPB: Trimmed 5074 records to 3842 (keeping 200 days of data) [2025-10-09T19:49:02.534790] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-09T19:49:02.561049] [DEBUG] [LOCAL ] KMPB: Primary data saved (3842 records). [2025-10-09T19:49:02.561208] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-09T19:49:02.561364] [INFO ] [MAIN ] Update Progress: 1201/2373 symbols completed. KMPB took 22.7s. Estimated remaining: 2h 44m 54s. Rate: 7.1 symbols/min [2025-10-09T19:49:02.729665] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:02.779320] [DEBUG] [LOCAL ] KMX: Loaded 53215 existing records from primary storage. [2025-10-09T19:49:02.779676] [INFO ] [MAIN ] KMX: Loaded 53215 existing records. [2025-10-09T19:49:02.961347] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:02.961679] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-09T19:49:02.961740] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-09T19:49:02.962019] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-09T19:49:02.962077] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-09T19:49:03.203006] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-09T19:49:03.320835] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:03.996750] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-09T19:49:04.381969] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T19:49:04.386073] [INFO ] [REMOTE ] KMPR: Full fetch complete (52099 records). [2025-10-09T19:49:04.386183] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-09T19:49:04.770853] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-09T19:49:04.816347] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-09T19:49:04.823817] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-09T19:49:04.824290] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-09T19:49:04.825532] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-09T19:49:04.826285] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-09T19:49:04.827853] [DEBUG] [LOCAL ] KMPR: Trimmed 52099 records to 39672 (keeping 200 days of data) [2025-10-09T19:49:05.078964] [DEBUG] [LOCAL ] KMPR: Primary data saved (39672 records). [2025-10-09T19:49:05.079200] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-09T19:49:05.079325] [INFO ] [MAIN ] Update Progress: 1202/2373 symbols completed. KMPR took 25.2s. Estimated remaining: 2h 44m 40s. Rate: 7.1 symbols/min [2025-10-09T19:49:05.246314] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:05.284071] [DEBUG] [LOCAL ] KN: Loaded 38528 existing records from primary storage. [2025-10-09T19:49:05.284380] [INFO ] [MAIN ] KN: Loaded 38528 existing records. [2025-10-09T19:49:05.473425] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:05.473748] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-09T19:49:05.473823] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-09T19:49:05.474186] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-09T19:49:05.474263] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-09T19:49:05.600744] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-09T19:49:05.781764] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-09T19:49:05.910238] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:06.186447] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-09T19:49:06.396707] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-09T19:49:07.196697] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-09T19:49:07.359799] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-09T19:49:07.646077] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:49:07.996752] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-09T19:49:08.589780] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-09T19:49:08.796736] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-09T19:49:09.602301] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-09T19:49:09.607879] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T19:49:10.396684] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-09T19:49:10.555782] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-09T19:49:11.196765] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-09T19:49:11.234970] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-09T19:49:11.403213] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:49:11.996768] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-09T19:49:12.656455] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-09T19:49:12.660457] [INFO ] [REMOTE ] KMT: Full fetch complete (61918 records). [2025-10-09T19:49:12.660600] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-09T19:49:12.811541] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-09T19:49:13.076208] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-09T19:49:13.076371] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-09T19:49:13.077708] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-09T19:49:13.077777] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-09T19:49:13.079571] [DEBUG] [LOCAL ] KMT: Trimmed 61918 records to 43222 (keeping 200 days of data) [2025-10-09T19:49:13.366369] [DEBUG] [LOCAL ] KMT: Primary data saved (43222 records). [2025-10-09T19:49:13.366572] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-09T19:49:13.366693] [INFO ] [MAIN ] Update Progress: 1203/2373 symbols completed. KMT took 33.5s. Estimated remaining: 2h 44m 31s. Rate: 7.1 symbols/min [2025-10-09T19:49:13.539807] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:13.574530] [DEBUG] [LOCAL ] KNF: Loaded 36214 existing records from primary storage. [2025-10-09T19:49:13.575046] [INFO ] [MAIN ] KNF: Loaded 36214 existing records. [2025-10-09T19:49:13.606948] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-09T19:49:13.760384] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:13.760775] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-09T19:49:13.760940] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-09T19:49:13.761228] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-09T19:49:13.761287] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-09T19:49:14.107573] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-09T19:49:14.180433] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:14.396740] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-09T19:49:14.683794] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T19:49:14.731200] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-09T19:49:15.196717] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-09T19:49:15.996694] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-09T19:49:16.375728] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-09T19:49:16.428584] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-09T19:49:16.796722] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-09T19:49:16.955030] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T19:49:17.596773] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-09T19:49:18.396778] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-09T19:49:18.566235] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:49:18.876195] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-09T19:49:19.196764] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-09T19:49:19.996706] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-09T19:49:20.224066] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T19:49:20.421754] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-09T19:49:20.796740] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-09T19:49:21.340457] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-09T19:49:21.596691] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-09T19:49:22.376814] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-09T19:49:22.396679] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-09T19:49:23.198695] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-09T19:49:23.223585] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-09T19:49:23.487807] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-09T19:49:23.996731] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-09T19:49:24.796783] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-09T19:49:25.112024] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T19:49:25.596710] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-09T19:49:25.824526] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-09T19:49:26.197483] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-09T19:49:26.396756] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-09T19:49:27.077461] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-09T19:49:27.196731] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-09T19:49:27.996686] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-09T19:49:28.032286] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-09T19:49:28.796689] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-09T19:49:28.825339] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:49:28.829884] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-09T19:49:28.830002] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-09T19:49:29.226308] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-09T19:49:29.226435] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-09T19:49:29.227521] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-09T19:49:29.227694] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-09T19:49:29.229273] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 54083 (keeping 200 days of data) [2025-10-09T19:49:29.468347] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-09T19:49:29.591175] [DEBUG] [LOCAL ] KMI: Primary data saved (54083 records). [2025-10-09T19:49:29.591306] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-09T19:49:29.592012] [INFO ] [MAIN ] Update Progress: 1204/2373 symbols completed. KMI took 49.7s. Estimated remaining: 2h 44m 31s. Rate: 7.1 symbols/min [2025-10-09T19:49:29.603043] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-09T19:49:29.767709] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:29.780274] [DEBUG] [LOCAL ] KNOP: Loaded 10498 existing records from primary storage. [2025-10-09T19:49:29.780499] [INFO ] [MAIN ] KNOP: Loaded 10498 existing records. [2025-10-09T19:49:29.981177] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:29.981384] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-09T19:49:29.981430] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-09T19:49:29.981708] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-09T19:49:29.981767] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-09T19:49:30.329340] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:30.396705] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-09T19:49:31.011371] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-09T19:49:31.028326] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-09T19:49:31.196740] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-09T19:49:31.961876] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-09T19:49:31.996701] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-09T19:49:32.694213] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-09T19:49:32.796734] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-09T19:49:33.453227] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (4.66 seconds). [2025-10-09T19:49:33.458717] [INFO ] [REMOTE ] KMX: Full fetch complete (75709 records). [2025-10-09T19:49:33.458953] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-09T19:49:33.460173] [FATAL] [VALIDATOR ] KMX: Data is stale - most recent date (2025-10-08) is before last completed trading day (2025-10-09). Symbol may be delisted or halted. [2025-10-09T19:49:33.460289] [FATAL] [MAIN ] KMX: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:49:33.460334] [WARN ] [MAIN ] KMX: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:49:33.460406] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-09T19:49:33.460730] [DEBUG] [LOCAL ] KMX: No primary data file found to delete. [2025-10-09T19:49:33.460972] [INFO ] [LOCAL ] KMX: Starting deletion of derivative data. [2025-10-09T19:49:33.461487] [DEBUG] [LOCAL ] KMX: Deleted derivative data file. [2025-10-09T19:49:33.461665] [INFO ] [MAIN ] Update Progress: 1205/2373 symbols completed. KMX took 30.9s. Estimated remaining: 2h 44m 18s. Rate: 7.1 symbols/min [2025-10-09T19:49:33.606542] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-09T19:49:33.642960] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:33.650964] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-09T19:49:33.672880] [DEBUG] [LOCAL ] KNSL: Loaded 18414 existing records from primary storage. [2025-10-09T19:49:33.673198] [INFO ] [MAIN ] KNSL: Loaded 18414 existing records. [2025-10-09T19:49:33.861293] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:33.861525] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-09T19:49:33.861580] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-09T19:49:33.861972] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-09T19:49:33.862030] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-09T19:49:34.222460] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:34.396723] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-09T19:49:34.724584] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T19:49:35.197351] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-09T19:49:35.198343] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-09T19:49:35.996720] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-09T19:49:36.185039] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T19:49:36.796696] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-09T19:49:36.907856] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-09T19:49:37.596724] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-09T19:49:37.945273] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T19:49:38.396807] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-09T19:49:38.750429] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-09T19:49:39.196836] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-09T19:49:39.592168] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:49:39.996726] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-09T19:49:40.344529] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-09T19:49:40.505155] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-09T19:49:40.796764] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-09T19:49:41.596706] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-09T19:49:41.633822] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-09T19:49:42.396787] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-09T19:49:42.835621] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-09T19:49:43.032006] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-09T19:49:43.038123] [INFO ] [REMOTE ] KNF: Full fetch complete (51035 records). [2025-10-09T19:49:43.038282] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-09T19:49:43.200265] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-09T19:49:43.433800] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-09T19:49:43.433877] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-09T19:49:43.434630] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-09T19:49:43.434708] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-09T19:49:43.435738] [DEBUG] [LOCAL ] KNF: Trimmed 51035 records to 36539 (keeping 200 days of data) [2025-10-09T19:49:43.652227] [DEBUG] [LOCAL ] KNF: Primary data saved (36539 records). [2025-10-09T19:49:43.652369] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-09T19:49:43.652451] [INFO ] [MAIN ] Update Progress: 1206/2373 symbols completed. KNF took 30.3s. Estimated remaining: 2h 44m 11s. Rate: 7.1 symbols/min [2025-10-09T19:49:43.820163] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:43.862477] [DEBUG] [LOCAL ] KNTK: Loaded 46585 existing records from primary storage. [2025-10-09T19:49:43.862861] [INFO ] [MAIN ] KNTK: Loaded 46585 existing records. [2025-10-09T19:49:44.002205] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-09T19:49:44.045548] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:44.045937] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-09T19:49:44.045987] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-09T19:49:44.046306] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-09T19:49:44.046365] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-09T19:49:44.396515] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:44.784588] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-09T19:49:44.807585] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-09T19:49:44.809990] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T19:49:45.528495] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-09T19:49:45.596725] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-09T19:49:46.396726] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-09T19:49:46.981724] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-09T19:49:46.985224] [INFO ] [REMOTE ] KN: Full fetch complete (56451 records). [2025-10-09T19:49:46.985315] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-09T19:49:47.201922] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-09T19:49:47.376716] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-09T19:49:47.376806] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-09T19:49:47.377726] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-09T19:49:47.377791] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-09T19:49:47.378986] [DEBUG] [LOCAL ] KN: Trimmed 56451 records to 38814 (keeping 200 days of data) [2025-10-09T19:49:47.608309] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-09T19:49:47.639760] [DEBUG] [LOCAL ] KN: Primary data saved (38814 records). [2025-10-09T19:49:47.639893] [INFO ] [MAIN ] KN: Full history saved. [2025-10-09T19:49:47.639977] [INFO ] [MAIN ] Update Progress: 1207/2373 symbols completed. KN took 42.6s. Estimated remaining: 2h 43m 58s. Rate: 7.1 symbols/min [2025-10-09T19:49:47.804101] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:47.854496] [DEBUG] [LOCAL ] KNX: Loaded 52596 existing records from primary storage. [2025-10-09T19:49:47.854836] [INFO ] [MAIN ] KNX: Loaded 52596 existing records. [2025-10-09T19:49:48.006353] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-09T19:49:48.036732] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:49:48.037895] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-09T19:49:48.038013] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-09T19:49:48.038552] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-09T19:49:48.038892] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-09T19:49:48.213694] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-09T19:49:48.421417] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:48.796682] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-09T19:49:48.894939] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-09T19:49:49.596784] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-09T19:49:49.806703] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-09T19:49:50.229596] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-09T19:49:50.231036] [INFO ] [REMOTE ] KNOP: Full fetch complete (14606 records). [2025-10-09T19:49:50.231107] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-09T19:49:50.407705] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-09T19:49:50.602910] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-09T19:49:50.603009] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-09T19:49:50.603544] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-09T19:49:50.603587] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-09T19:49:50.604252] [DEBUG] [LOCAL ] KNOP: Trimmed 14606 records to 10559 (keeping 200 days of data) [2025-10-09T19:49:50.669394] [DEBUG] [LOCAL ] KNOP: Primary data saved (10559 records). [2025-10-09T19:49:50.669538] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-09T19:49:50.669667] [INFO ] [MAIN ] Update Progress: 1208/2373 symbols completed. KNOP took 21.1s. Estimated remaining: 2h 43m 44s. Rate: 7.1 symbols/min [2025-10-09T19:49:50.838917] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:49:50.839193] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-09T19:49:50.839244] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-09T19:49:50.839360] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-09T19:49:50.839402] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-09T19:49:50.839443] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-09T19:49:50.839476] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-09T19:49:51.193524] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:49:51.196672] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-09T19:49:51.785869] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-09T19:49:51.996782] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-09T19:49:52.796778] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-09T19:49:52.986436] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-09T19:49:53.327086] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-09T19:49:53.596733] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-09T19:49:53.657962] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T19:49:54.396719] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-09T19:49:54.894732] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-09T19:49:55.196734] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-09T19:49:55.764398] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T19:49:55.996754] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-09T19:49:56.483965] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:49:56.796719] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-09T19:49:57.596766] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-09T19:49:58.182682] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T19:49:58.259424] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-09T19:49:58.291832] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-09T19:49:58.396682] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-09T19:49:59.196696] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-09T19:49:59.321490] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:49:59.996724] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-09T19:50:00.796697] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-09T19:50:01.079329] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T19:50:01.162785] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-09T19:50:01.596744] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-09T19:50:02.396777] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-09T19:50:02.966423] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-09T19:50:03.121502] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-09T19:50:03.196669] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-09T19:50:03.474667] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-09T19:50:03.996705] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-09T19:50:04.796791] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-09T19:50:05.409673] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-09T19:50:05.596734] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-09T19:50:05.792360] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-09T19:50:06.401862] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-09T19:50:06.416830] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-09T19:50:07.180538] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:50:07.196665] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-09T19:50:07.418237] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-09T19:50:07.996749] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-09T19:50:08.184333] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-09T19:50:08.186925] [INFO ] [REMOTE ] KNSL: Full fetch complete (26835 records). [2025-10-09T19:50:08.187048] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-09T19:50:08.554776] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-09T19:50:08.554880] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-09T19:50:08.555478] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-09T19:50:08.555520] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-09T19:50:08.556190] [DEBUG] [LOCAL ] KNSL: Trimmed 26835 records to 18524 (keeping 200 days of data) [2025-10-09T19:50:08.674812] [DEBUG] [LOCAL ] KNSL: Primary data saved (18524 records). [2025-10-09T19:50:08.674969] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-09T19:50:08.675106] [INFO ] [MAIN ] Update Progress: 1209/2373 symbols completed. KNSL took 35.2s. Estimated remaining: 2h 43m 45s. Rate: 7.1 symbols/min [2025-10-09T19:50:08.801869] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-09T19:50:08.855808] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:08.897577] [DEBUG] [LOCAL ] KODK: Loaded 43452 existing records from primary storage. [2025-10-09T19:50:08.897976] [INFO ] [MAIN ] KODK: Loaded 43452 existing records. [2025-10-09T19:50:09.078725] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:09.078945] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-09T19:50:09.078994] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-09T19:50:09.079221] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-09T19:50:09.079279] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-09T19:50:09.452203] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:09.596726] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-09T19:50:09.660681] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T19:50:10.396755] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-09T19:50:11.196714] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-09T19:50:11.306979] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-09T19:50:11.529298] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-09T19:50:11.940811] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-09T19:50:11.996679] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-09T19:50:12.796718] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-09T19:50:12.964349] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-09T19:50:13.596702] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-09T19:50:13.659093] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T19:50:14.265008] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:50:14.396721] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-09T19:50:14.854510] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T19:50:15.196799] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-09T19:50:15.954471] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-09T19:50:15.996685] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-09T19:50:16.758043] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:50:16.796750] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-09T19:50:17.591285] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:50:17.599881] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-09T19:50:18.201413] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-09T19:50:18.205854] [INFO ] [REMOTE ] KNTK: Full fetch complete (64963 records). [2025-10-09T19:50:18.205964] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-09T19:50:18.402001] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-09T19:50:18.594172] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-09T19:50:18.594255] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-09T19:50:18.595157] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-09T19:50:18.595222] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-09T19:50:18.596527] [DEBUG] [LOCAL ] KNTK: Trimmed 64963 records to 46944 (keeping 200 days of data) [2025-10-09T19:50:18.888851] [DEBUG] [LOCAL ] KNTK: Primary data saved (46944 records). [2025-10-09T19:50:18.889006] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-09T19:50:18.889120] [INFO ] [MAIN ] Update Progress: 1210/2373 symbols completed. KNTK took 35.2s. Estimated remaining: 2h 43m 39s. Rate: 7.1 symbols/min [2025-10-09T19:50:19.061264] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:19.087519] [DEBUG] [LOCAL ] KOF: Loaded 26540 existing records from primary storage. [2025-10-09T19:50:19.087827] [INFO ] [MAIN ] KOF: Loaded 26540 existing records. [2025-10-09T19:50:19.201283] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-09T19:50:19.272916] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:19.273436] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-09T19:50:19.273556] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-09T19:50:19.273927] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-09T19:50:19.274080] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-09T19:50:19.607448] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-09T19:50:19.676172] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:19.996805] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-09T19:50:20.451342] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-09T19:50:20.796695] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-09T19:50:20.895529] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-09T19:50:21.275573] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-09T19:50:21.596729] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-09T19:50:22.039117] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-09T19:50:22.396694] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-09T19:50:23.196822] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-09T19:50:23.425527] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-09T19:50:23.996757] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-09T19:50:24.059352] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-09T19:50:24.260859] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T19:50:24.796693] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-09T19:50:25.596707] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-09T19:50:25.867218] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-09T19:50:26.396706] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-09T19:50:26.694052] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-09T19:50:26.698714] [INFO ] [REMOTE ] KNX: Full fetch complete (75914 records). [2025-10-09T19:50:26.698833] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-09T19:50:27.093382] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-09T19:50:27.093555] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-09T19:50:27.094779] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-09T19:50:27.094853] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-09T19:50:27.096505] [DEBUG] [LOCAL ] KNX: Trimmed 75914 records to 52986 (keeping 200 days of data) [2025-10-09T19:50:27.196895] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-09T19:50:27.428176] [DEBUG] [LOCAL ] KNX: Primary data saved (52986 records). [2025-10-09T19:50:27.428364] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-09T19:50:27.428483] [INFO ] [MAIN ] Update Progress: 1211/2373 symbols completed. KNX took 39.8s. Estimated remaining: 2h 43m 30s. Rate: 7.1 symbols/min [2025-10-09T19:50:27.597210] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:27.615421] [DEBUG] [LOCAL ] KOP: Loaded 17423 existing records from primary storage. [2025-10-09T19:50:27.615697] [INFO ] [MAIN ] KOP: Loaded 17423 existing records. [2025-10-09T19:50:27.815584] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:27.816126] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-09T19:50:27.816201] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-09T19:50:27.816617] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-09T19:50:27.816718] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-09T19:50:28.045676] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-09T19:50:28.123608] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-09T19:50:28.272169] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:28.275577] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-09T19:50:28.354034] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-09T19:50:28.796724] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-09T19:50:29.596699] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-09T19:50:29.736800] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-09T19:50:29.869150] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-09T19:50:30.272948] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T19:50:30.396690] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-09T19:50:31.196763] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-09T19:50:31.437234] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-09T19:50:31.996810] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-09T19:50:32.728357] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T19:50:32.732284] [INFO ] [REMOTE ] KODK: Full fetch complete (63331 records). [2025-10-09T19:50:32.732388] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-09T19:50:32.805735] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-09T19:50:33.113223] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-09T19:50:33.113309] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-09T19:50:33.114226] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-09T19:50:33.114293] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-09T19:50:33.115707] [DEBUG] [LOCAL ] KODK: Trimmed 63331 records to 43771 (keeping 200 days of data) [2025-10-09T19:50:33.366928] [DEBUG] [LOCAL ] KODK: Primary data saved (43771 records). [2025-10-09T19:50:33.367315] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-09T19:50:33.367418] [INFO ] [MAIN ] Update Progress: 1212/2373 symbols completed. KODK took 24.7s. Estimated remaining: 2h 43m 19s. Rate: 7.1 symbols/min [2025-10-09T19:50:33.535465] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:33.544101] [DEBUG] [LOCAL ] KORE: Loaded 2116 existing records from primary storage. [2025-10-09T19:50:33.544266] [INFO ] [MAIN ] KORE: Loaded 2116 existing records. [2025-10-09T19:50:33.607080] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-09T19:50:33.721370] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:33.721608] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-09T19:50:33.721683] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-09T19:50:33.722142] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-09T19:50:33.722200] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-09T19:50:33.998257] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-09T19:50:34.142393] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:34.396730] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-09T19:50:34.538222] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-09T19:50:34.825275] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T19:50:35.196735] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-09T19:50:35.288485] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-09T19:50:35.996702] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-09T19:50:36.326373] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-09T19:50:36.551673] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-09T19:50:36.796718] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-09T19:50:37.596740] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-09T19:50:37.926153] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-09T19:50:38.396685] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-09T19:50:38.658461] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-09T19:50:39.196746] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-09T19:50:39.393140] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-09T19:50:39.662974] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-09T19:50:39.996754] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-09T19:50:40.274341] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-09T19:50:40.796719] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-09T19:50:41.241801] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-09T19:50:41.596712] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-09T19:50:42.396678] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-09T19:50:42.493110] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-09T19:50:43.196724] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-09T19:50:43.922377] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T19:50:43.996690] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-09T19:50:44.684559] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-09T19:50:44.796694] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-09T19:50:44.989760] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T19:50:45.114323] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-09T19:50:45.596730] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-09T19:50:46.396707] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-09T19:50:46.773985] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-09T19:50:47.196794] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-09T19:50:47.724324] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-09T19:50:47.799499] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-09T19:50:47.804192] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-09T19:50:47.804326] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-09T19:50:48.000144] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-09T19:50:47.999964] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-09T19:50:48.002953] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:50:48.004126] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:50:48.004212] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-09T19:50:48.004284] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-09T19:50:48.004321] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-09T19:50:48.004376] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-09T19:50:48.004470] [INFO ] [MAIN ] Update Progress: 1213/2373 symbols completed. KO took 57.3s. Estimated remaining: 2h 43m 17s. Rate: 7.1 symbols/min [2025-10-09T19:50:48.209439] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:48.262772] [DEBUG] [LOCAL ] KOS: Loaded 53075 existing records from primary storage. [2025-10-09T19:50:48.263136] [INFO ] [MAIN ] KOS: Loaded 53075 existing records. [2025-10-09T19:50:48.442194] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:48.442433] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-09T19:50:48.442486] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-09T19:50:48.442818] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-09T19:50:48.442878] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-09T19:50:48.553622] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T19:50:48.801364] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-09T19:50:48.801253] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:49.596774] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-09T19:50:50.080832] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-09T19:50:50.396745] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-09T19:50:51.133154] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-09T19:50:51.196688] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-09T19:50:51.862892] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T19:50:51.996730] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-09T19:50:52.796748] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-09T19:50:52.961964] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-09T19:50:53.218715] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-09T19:50:53.234072] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-09T19:50:53.596749] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-09T19:50:54.396754] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-09T19:50:55.001627] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T19:50:55.196713] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-09T19:50:55.597350] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:50:55.996730] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-09T19:50:56.566748] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T19:50:56.796761] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-09T19:50:56.971541] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-09T19:50:57.318994] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-09T19:50:57.320100] [INFO ] [REMOTE ] KORE: Full fetch complete (5646 records). [2025-10-09T19:50:57.320173] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-09T19:50:57.601866] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-09T19:50:57.676671] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-09T19:50:57.676771] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-09T19:50:57.676946] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-09T19:50:57.676988] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-09T19:50:57.677349] [DEBUG] [LOCAL ] KORE: Trimmed 5646 records to 2137 (keeping 200 days of data) [2025-10-09T19:50:57.689995] [DEBUG] [LOCAL ] KORE: Primary data saved (2137 records). [2025-10-09T19:50:57.690065] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-09T19:50:57.690142] [INFO ] [MAIN ] Update Progress: 1214/2373 symbols completed. KORE took 24.3s. Estimated remaining: 2h 43m 10s. Rate: 7.1 symbols/min [2025-10-09T19:50:57.859358] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:57.908331] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-09T19:50:57.908712] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-09T19:50:58.082568] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:58.082777] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-09T19:50:58.082823] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-09T19:50:58.083051] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-09T19:50:58.083107] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-09T19:50:58.401853] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-09T19:50:58.431166] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:50:58.875363] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T19:50:58.878311] [INFO ] [REMOTE ] KOF: Full fetch complete (37640 records). [2025-10-09T19:50:58.878401] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-09T19:50:59.204439] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-09T19:50:59.256560] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-09T19:50:59.256632] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-09T19:50:59.257429] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-09T19:50:59.257508] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-09T19:50:59.258514] [DEBUG] [LOCAL ] KOF: Trimmed 37640 records to 26683 (keeping 200 days of data) [2025-10-09T19:50:59.429611] [DEBUG] [LOCAL ] KOF: Primary data saved (26683 records). [2025-10-09T19:50:59.429787] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-09T19:50:59.429893] [INFO ] [MAIN ] Update Progress: 1215/2373 symbols completed. KOF took 40.5s. Estimated remaining: 2h 42m 55s. Rate: 7.1 symbols/min [2025-10-09T19:50:59.609112] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:50:59.654668] [DEBUG] [LOCAL ] KRC: Loaded 48354 existing records from primary storage. [2025-10-09T19:50:59.655027] [INFO ] [MAIN ] KRC: Loaded 48354 existing records. [2025-10-09T19:50:59.841817] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:50:59.842020] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-09T19:50:59.842068] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-09T19:50:59.842516] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-09T19:50:59.842576] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-09T19:51:00.001475] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-09T19:51:00.224085] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:00.253362] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-09T19:51:00.796692] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-09T19:51:01.133602] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:51:01.255997] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-09T19:51:01.596724] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-09T19:51:02.397629] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-09T19:51:02.405465] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T19:51:03.196733] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-09T19:51:03.358331] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-09T19:51:03.360254] [INFO ] [REMOTE ] KOP: Full fetch complete (25505 records). [2025-10-09T19:51:03.360322] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-09T19:51:03.699169] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-09T19:51:03.766420] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-09T19:51:03.766512] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-09T19:51:03.767055] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-09T19:51:03.767116] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-09T19:51:03.767770] [DEBUG] [LOCAL ] KOP: Trimmed 25505 records to 17572 (keeping 200 days of data) [2025-10-09T19:51:03.879685] [DEBUG] [LOCAL ] KOP: Primary data saved (17572 records). [2025-10-09T19:51:03.879835] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-09T19:51:03.879921] [INFO ] [MAIN ] Update Progress: 1216/2373 symbols completed. KOP took 36.5s. Estimated remaining: 2h 42m 42s. Rate: 7.1 symbols/min [2025-10-09T19:51:04.001779] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-09T19:51:04.052749] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:04.094437] [DEBUG] [LOCAL ] KREF: Loaded 37756 existing records from primary storage. [2025-10-09T19:51:04.094750] [INFO ] [MAIN ] KREF: Loaded 37756 existing records. [2025-10-09T19:51:04.268322] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:04.268549] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-09T19:51:04.268605] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-09T19:51:04.269132] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-09T19:51:04.269190] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-09T19:51:04.635620] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:04.796668] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-09T19:51:05.109846] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-09T19:51:05.596767] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-09T19:51:05.694228] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-09T19:51:06.205911] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-09T19:51:06.396679] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-09T19:51:07.196830] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-09T19:51:07.238169] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-09T19:51:07.702494] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-09T19:51:07.996709] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-09T19:51:08.762676] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:51:08.796671] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-09T19:51:08.851999] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:51:09.596741] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-09T19:51:10.239907] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-09T19:51:10.396736] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-09T19:51:11.196688] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-09T19:51:11.278490] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-09T19:51:11.899413] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-09T19:51:11.996722] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-09T19:51:12.418266] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-09T19:51:12.796721] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-09T19:51:13.596699] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-09T19:51:13.733869] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-09T19:51:14.363538] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T19:51:14.396665] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-09T19:51:15.196750] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-09T19:51:15.260667] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-09T19:51:15.996776] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-09T19:51:16.105831] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-09T19:51:16.796694] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-09T19:51:17.044541] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:51:17.150666] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-09T19:51:17.596741] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-09T19:51:18.396691] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-09T19:51:18.483846] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-09T19:51:18.987895] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-09T19:51:19.196779] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-09T19:51:19.996770] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-09T19:51:20.300925] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T19:51:20.796796] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-09T19:51:20.879144] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-09T19:51:21.304439] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-09T19:51:21.596725] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-09T19:51:22.396730] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-09T19:51:22.572038] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-09T19:51:23.156590] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:51:23.196781] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-09T19:51:24.002027] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-09T19:51:24.031411] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-09T19:51:24.796777] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-09T19:51:25.020680] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-09T19:51:25.230154] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-09T19:51:25.596733] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-09T19:51:26.403465] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-09T19:51:26.409525] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-09T19:51:27.141000] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-09T19:51:27.145812] [INFO ] [REMOTE ] KOS: Full fetch complete (76870 records). [2025-10-09T19:51:27.145928] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-09T19:51:27.202029] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-09T19:51:27.540357] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-09T19:51:27.540457] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-09T19:51:27.541512] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-09T19:51:27.541581] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-09T19:51:27.543174] [DEBUG] [LOCAL ] KOS: Trimmed 76870 records to 53462 (keeping 200 days of data) [2025-10-09T19:51:27.859459] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-09T19:51:27.892674] [DEBUG] [LOCAL ] KOS: Primary data saved (53462 records). [2025-10-09T19:51:27.892879] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-09T19:51:27.893724] [INFO ] [MAIN ] Update Progress: 1217/2373 symbols completed. KOS took 39.9s. Estimated remaining: 2h 42m 49s. Rate: 7.1 symbols/min [2025-10-09T19:51:28.002003] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-09T19:51:28.077195] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:28.130627] [DEBUG] [LOCAL ] KRG: Loaded 49171 existing records from primary storage. [2025-10-09T19:51:28.131012] [INFO ] [MAIN ] KRG: Loaded 49171 existing records. [2025-10-09T19:51:28.332907] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:28.333192] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-09T19:51:28.333245] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-09T19:51:28.333505] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-09T19:51:28.333565] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-09T19:51:28.735143] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:28.796801] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-09T19:51:29.342430] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-09T19:51:29.490635] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-09T19:51:29.596750] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-09T19:51:30.032499] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-09T19:51:30.396796] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-09T19:51:31.046778] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-09T19:51:31.050899] [INFO ] [REMOTE ] KREF: Full fetch complete (52766 records). [2025-10-09T19:51:31.050999] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-09T19:51:31.221534] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-09T19:51:31.426509] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-09T19:51:31.426590] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-09T19:51:31.427427] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-09T19:51:31.427494] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-09T19:51:31.428723] [DEBUG] [LOCAL ] KREF: Trimmed 52766 records to 38087 (keeping 200 days of data) [2025-10-09T19:51:31.665280] [DEBUG] [LOCAL ] KREF: Primary data saved (38087 records). [2025-10-09T19:51:31.665425] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-09T19:51:31.665521] [INFO ] [MAIN ] Update Progress: 1218/2373 symbols completed. KREF took 27.8s. Estimated remaining: 2h 42m 36s. Rate: 7.1 symbols/min [2025-10-09T19:51:31.836817] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:31.837060] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-09T19:51:31.837115] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-09T19:51:31.837227] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-09T19:51:31.837268] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-09T19:51:31.837307] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-09T19:51:31.837339] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-09T19:51:32.005830] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-09T19:51:32.186936] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:32.651102] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-09T19:51:32.678958] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-09T19:51:32.683507] [INFO ] [REMOTE ] KR: Full fetch complete (77680 records). [2025-10-09T19:51:32.683619] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-09T19:51:32.801677] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-09T19:51:33.028841] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:51:33.050409] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-09T19:51:33.098617] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:51:33.120417] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-09T19:51:33.124221] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:51:33.124344] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-09T19:51:33.124415] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-09T19:51:33.124518] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-09T19:51:33.125965] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-09T19:51:33.126044] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-09T19:51:33.124617] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-09T19:51:33.126298] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-09T19:51:33.126384] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-09T19:51:33.126460] [INFO ] [MAIN ] Update Progress: 1219/2373 symbols completed. KRMN took 1.5s. Estimated remaining: 2h 42m 21s. Rate: 7.1 symbols/min [2025-10-09T19:51:33.228194] [DEBUG] [LOCAL ] KR: Trimmed 77680 records to 54071 (keeping 200 days of data) [2025-10-09T19:51:33.355293] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:33.538056] [DEBUG] [LOCAL ] KRO: Loaded 26221 existing records from primary storage. [2025-10-09T19:51:33.539351] [INFO ] [MAIN ] KRO: Loaded 26221 existing records. [2025-10-09T19:51:33.602784] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-09T19:51:33.732786] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:33.733764] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-09T19:51:33.736875] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-09T19:51:33.740044] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-09T19:51:33.740633] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-09T19:51:33.883217] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-09T19:51:34.154796] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:34.252712] [DEBUG] [LOCAL ] KR: Primary data saved (54071 records). [2025-10-09T19:51:34.252869] [INFO ] [MAIN ] KR: Full history saved. [2025-10-09T19:51:34.253772] [INFO ] [MAIN ] Update Progress: 1220/2373 symbols completed. KR took 36.6s. Estimated remaining: 2h 42m 6s. Rate: 7.1 symbols/min [2025-10-09T19:51:34.402215] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-09T19:51:34.422696] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:34.465199] [DEBUG] [LOCAL ] KRP: Loaded 36701 existing records from primary storage. [2025-10-09T19:51:34.465509] [INFO ] [MAIN ] KRP: Loaded 36701 existing records. [2025-10-09T19:51:34.640272] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:34.640507] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-09T19:51:34.640554] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-09T19:51:34.640911] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-09T19:51:34.640971] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-09T19:51:34.999913] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:35.189316] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-09T19:51:35.198274] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-09T19:51:35.602114] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T19:51:35.996779] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-09T19:51:36.791804] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-09T19:51:36.797237] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-09T19:51:36.799119] [INFO ] [REMOTE ] KRC: Full fetch complete (69895 records). [2025-10-09T19:51:36.799237] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-09T19:51:37.190202] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-09T19:51:37.190296] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-09T19:51:37.191250] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-09T19:51:37.191317] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-09T19:51:37.192794] [DEBUG] [LOCAL ] KRC: Trimmed 69895 records to 48686 (keeping 200 days of data) [2025-10-09T19:51:37.499533] [DEBUG] [LOCAL ] KRC: Primary data saved (48686 records). [2025-10-09T19:51:37.499804] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-09T19:51:37.499934] [INFO ] [MAIN ] Update Progress: 1221/2373 symbols completed. KRC took 38.1s. Estimated remaining: 2h 41m 52s. Rate: 7.1 symbols/min [2025-10-09T19:51:37.597739] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-09T19:51:37.677707] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:37.706241] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-09T19:51:37.763276] [DEBUG] [LOCAL ] KSS: Loaded 53597 existing records from primary storage. [2025-10-09T19:51:37.763636] [INFO ] [MAIN ] KSS: Loaded 53597 existing records. [2025-10-09T19:51:37.941020] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:37.941253] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-09T19:51:37.941300] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-09T19:51:37.941959] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-09T19:51:37.942018] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-09T19:51:38.294233] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:38.388124] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-09T19:51:38.396679] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-09T19:51:38.677464] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-09T19:51:39.196740] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-09T19:51:39.726284] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-09T19:51:39.996755] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-09T19:51:40.757571] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-09T19:51:40.796698] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-09T19:51:41.266277] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-09T19:51:41.596715] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-09T19:51:41.856332] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T19:51:42.396789] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-09T19:51:43.054025] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-09T19:51:43.196765] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-09T19:51:43.996777] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-09T19:51:44.057529] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-09T19:51:44.796761] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-09T19:51:45.074365] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-09T19:51:45.596758] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-09T19:51:45.658540] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-09T19:51:46.110367] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-09T19:51:46.396742] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-09T19:51:47.033744] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T19:51:47.196736] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-09T19:51:47.996806] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-09T19:51:48.048049] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-09T19:51:48.668505] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-09T19:51:48.796731] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-09T19:51:49.136467] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-09T19:51:49.596744] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-09T19:51:50.259455] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-09T19:51:50.396741] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-09T19:51:50.795086] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T19:51:51.196755] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-09T19:51:51.659201] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-09T19:51:51.996753] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-09T19:51:52.698808] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-09T19:51:52.796749] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-09T19:51:53.596761] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-09T19:51:54.050371] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-09T19:51:54.370252] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-09T19:51:54.396675] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-09T19:51:54.515948] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:51:55.196735] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-09T19:51:55.926084] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-09T19:51:55.930535] [INFO ] [REMOTE ] KRG: Full fetch complete (71089 records). [2025-10-09T19:51:55.930711] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-09T19:51:56.005386] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-09T19:51:56.325724] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-09T19:51:56.325837] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-09T19:51:56.326829] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-09T19:51:56.326903] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-09T19:51:56.328460] [DEBUG] [LOCAL ] KRG: Trimmed 71089 records to 49521 (keeping 200 days of data) [2025-10-09T19:51:56.635317] [DEBUG] [LOCAL ] KRG: Primary data saved (49521 records). [2025-10-09T19:51:56.635463] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-09T19:51:56.636061] [INFO ] [MAIN ] Update Progress: 1222/2373 symbols completed. KRG took 28.7s. Estimated remaining: 2h 41m 54s. Rate: 7.1 symbols/min [2025-10-09T19:51:56.805105] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:51:56.803541] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-09T19:51:56.851149] [DEBUG] [LOCAL ] KT: Loaded 45551 existing records from primary storage. [2025-10-09T19:51:56.851490] [INFO ] [MAIN ] KT: Loaded 45551 existing records. [2025-10-09T19:51:57.063106] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:51:57.063474] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-09T19:51:57.063629] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-09T19:51:57.064198] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-09T19:51:57.064261] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-09T19:51:57.394193] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-09T19:51:57.489688] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-09T19:51:57.518781] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:51:57.596680] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-09T19:51:57.989266] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-09T19:51:58.396744] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-09T19:51:59.152420] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-09T19:51:59.196679] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-09T19:51:59.862000] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T19:51:59.996776] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-09T19:52:00.292317] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-09T19:52:00.796759] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-09T19:52:01.374625] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T19:52:01.596764] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-09T19:52:02.091781] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-09T19:52:02.396711] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-09T19:52:02.731733] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-09T19:52:03.196749] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-09T19:52:03.544855] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-09T19:52:03.996733] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-09T19:52:04.555355] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T19:52:04.558337] [INFO ] [REMOTE ] KRO: Full fetch complete (35094 records). [2025-10-09T19:52:04.558527] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-09T19:52:04.802013] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-09T19:52:04.956826] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-09T19:52:04.956894] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-09T19:52:04.957670] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-09T19:52:04.957768] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-09T19:52:04.958737] [DEBUG] [LOCAL ] KRO: Trimmed 35094 records to 26410 (keeping 200 days of data) [2025-10-09T19:52:05.114504] [DEBUG] [LOCAL ] KRO: Primary data saved (26410 records). [2025-10-09T19:52:05.114707] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-09T19:52:05.114828] [INFO ] [MAIN ] Update Progress: 1223/2373 symbols completed. KRO took 32.0s. Estimated remaining: 2h 41m 45s. Rate: 7.1 symbols/min [2025-10-09T19:52:05.298329] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:05.294949] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T19:52:05.301825] [INFO ] [REMOTE ] KRP: Full fetch complete (54798 records). [2025-10-09T19:52:05.301907] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-09T19:52:05.601825] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-09T19:52:05.632190] [DEBUG] [LOCAL ] KTB: Loaded 40584 existing records from primary storage. [2025-10-09T19:52:05.633469] [INFO ] [MAIN ] KTB: Loaded 40584 existing records. [2025-10-09T19:52:05.828358] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-09T19:52:05.833901] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-09T19:52:05.834872] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-09T19:52:05.834957] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-09T19:52:05.889173] [DEBUG] [LOCAL ] KRP: Trimmed 54798 records to 36952 (keeping 200 days of data) [2025-10-09T19:52:05.912009] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:05.912288] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-09T19:52:05.912353] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-09T19:52:05.912743] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-09T19:52:05.912815] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-09T19:52:06.388269] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:06.396897] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-09T19:52:06.514684] [DEBUG] [LOCAL ] KRP: Primary data saved (36952 records). [2025-10-09T19:52:06.514855] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-09T19:52:06.514943] [INFO ] [MAIN ] Update Progress: 1224/2373 symbols completed. KRP took 32.3s. Estimated remaining: 2h 41m 30s. Rate: 7.1 symbols/min [2025-10-09T19:52:06.692244] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:06.705899] [DEBUG] [LOCAL ] KTF: Loaded 12064 existing records from primary storage. [2025-10-09T19:52:06.706210] [INFO ] [MAIN ] KTF: Loaded 12064 existing records. [2025-10-09T19:52:06.884810] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:06.885165] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-09T19:52:06.885431] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-09T19:52:06.885832] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-09T19:52:06.885985] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-09T19:52:07.199279] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-09T19:52:07.236269] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-09T19:52:07.309051] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:07.334732] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-09T19:52:07.452686] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-09T19:52:07.996723] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-09T19:52:08.659056] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-09T19:52:08.796718] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-09T19:52:09.596716] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-09T19:52:09.664352] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-09T19:52:09.759773] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-09T19:52:10.396730] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-09T19:52:11.196776] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-09T19:52:11.595576] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-09T19:52:11.955417] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-09T19:52:11.996665] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-09T19:52:12.069429] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T19:52:12.796693] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-09T19:52:12.807897] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-09T19:52:13.596767] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-09T19:52:14.108141] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-09T19:52:14.396726] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-09T19:52:14.537057] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-09T19:52:15.196784] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-09T19:52:15.933480] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-09T19:52:15.998369] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-09T19:52:16.006090] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-09T19:52:16.796789] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-09T19:52:17.044166] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-09T19:52:17.596733] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-09T19:52:18.269787] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-09T19:52:18.396729] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-09T19:52:18.759457] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T19:52:19.196724] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-09T19:52:19.996732] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-09T19:52:20.373402] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-09T19:52:20.456836] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-09T19:52:20.648514] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T19:52:20.796736] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-09T19:52:21.596748] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-09T19:52:21.714757] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-09T19:52:22.396730] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-09T19:52:23.127400] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-09T19:52:23.196761] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-09T19:52:23.488954] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-09T19:52:23.494316] [INFO ] [REMOTE ] KSS: Full fetch complete (77627 records). [2025-10-09T19:52:23.494540] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-09T19:52:23.934579] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-09T19:52:23.934710] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-09T19:52:23.935758] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-09T19:52:23.935824] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-09T19:52:23.937341] [DEBUG] [LOCAL ] KSS: Trimmed 77627 records to 53986 (keeping 200 days of data) [2025-10-09T19:52:23.998514] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-09T19:52:24.270242] [DEBUG] [LOCAL ] KSS: Primary data saved (53986 records). [2025-10-09T19:52:24.270396] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-09T19:52:24.270482] [INFO ] [MAIN ] Update Progress: 1225/2373 symbols completed. KSS took 46.8s. Estimated remaining: 2h 41m 31s. Rate: 7.1 symbols/min [2025-10-09T19:52:24.442713] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:24.442932] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-09T19:52:24.442979] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-09T19:52:24.443094] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-09T19:52:24.443137] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-09T19:52:24.443179] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-09T19:52:24.443212] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-09T19:52:24.752132] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-09T19:52:24.805503] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-09T19:52:24.837862] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:24.863065] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-09T19:52:25.592824] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-09T19:52:25.596683] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-09T19:52:26.396747] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-09T19:52:27.090215] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-09T19:52:27.118205] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-09T19:52:27.196746] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-09T19:52:27.996737] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-09T19:52:28.732426] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-09T19:52:28.733760] [INFO ] [REMOTE ] KTF: Full fetch complete (17490 records). [2025-10-09T19:52:28.733833] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-09T19:52:28.799088] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-09T19:52:29.038482] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-09T19:52:29.161125] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-09T19:52:29.161230] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-09T19:52:29.161675] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-09T19:52:29.161739] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-09T19:52:29.162307] [DEBUG] [LOCAL ] KTF: Trimmed 17490 records to 12113 (keeping 200 days of data) [2025-10-09T19:52:29.240236] [DEBUG] [LOCAL ] KTF: Primary data saved (12113 records). [2025-10-09T19:52:29.240393] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-09T19:52:29.240482] [INFO ] [MAIN ] Update Progress: 1226/2373 symbols completed. KTF took 22.7s. Estimated remaining: 2h 41m 19s. Rate: 7.1 symbols/min [2025-10-09T19:52:29.412413] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:29.466901] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-09T19:52:29.467248] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-09T19:52:29.607860] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-09T19:52:29.652206] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:29.652590] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-09T19:52:29.652662] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-09T19:52:29.653239] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-09T19:52:29.653299] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-09T19:52:30.009315] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:30.396696] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-09T19:52:30.569488] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:52:31.196753] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-09T19:52:31.257433] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-09T19:52:31.996776] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-09T19:52:32.198004] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-09T19:52:32.414382] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-09T19:52:32.796802] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-09T19:52:33.188342] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-09T19:52:33.192280] [INFO ] [REMOTE ] KT: Full fetch complete (66452 records). [2025-10-09T19:52:33.192384] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-09T19:52:33.591494] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-09T19:52:33.613905] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-09T19:52:33.618521] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-09T19:52:33.618858] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-09T19:52:33.620616] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-09T19:52:33.620847] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-09T19:52:33.622354] [DEBUG] [LOCAL ] KT: Trimmed 66452 records to 45849 (keeping 200 days of data) [2025-10-09T19:52:33.916330] [DEBUG] [LOCAL ] KT: Primary data saved (45849 records). [2025-10-09T19:52:33.916528] [INFO ] [MAIN ] KT: Full history saved. [2025-10-09T19:52:33.917197] [INFO ] [MAIN ] Update Progress: 1227/2373 symbols completed. KT took 37.3s. Estimated remaining: 2h 41m 7s. Rate: 7.1 symbols/min [2025-10-09T19:52:34.085937] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:34.132256] [DEBUG] [LOCAL ] KVYO: Loaded 50429 existing records from primary storage. [2025-10-09T19:52:34.132558] [INFO ] [MAIN ] KVYO: Loaded 50429 existing records. [2025-10-09T19:52:34.310699] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:34.310951] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-09T19:52:34.311002] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-09T19:52:34.311281] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-09T19:52:34.311339] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-09T19:52:34.401904] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-09T19:52:34.672103] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:34.927141] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-09T19:52:35.121296] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T19:52:35.196715] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-09T19:52:35.996752] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-09T19:52:36.796730] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-09T19:52:36.839705] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-09T19:52:36.908850] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T19:52:37.596732] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-09T19:52:38.300264] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-09T19:52:38.396696] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-09T19:52:38.458236] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-09T19:52:38.765082] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-09T19:52:39.196750] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-09T19:52:39.510921] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-09T19:52:39.996770] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-09T19:52:40.796785] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-09T19:52:41.219604] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-09T19:52:41.588637] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-09T19:52:41.598292] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-09T19:52:42.396756] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-09T19:52:42.975356] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-09T19:52:43.196781] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-09T19:52:43.611687] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T19:52:43.761434] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-09T19:52:43.996724] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-09T19:52:44.796724] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-09T19:52:45.388805] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:52:45.403349] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-09T19:52:45.596737] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-09T19:52:46.396752] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-09T19:52:46.968391] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-09T19:52:46.972120] [INFO ] [REMOTE ] KTB: Full fetch complete (57931 records). [2025-10-09T19:52:46.972294] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-09T19:52:47.206359] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-09T19:52:47.370664] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-09T19:52:47.370763] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-09T19:52:47.371662] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-09T19:52:47.371725] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-09T19:52:47.372978] [DEBUG] [LOCAL ] KTB: Trimmed 57931 records to 40852 (keeping 200 days of data) [2025-10-09T19:52:47.630944] [DEBUG] [LOCAL ] KTB: Primary data saved (40852 records). [2025-10-09T19:52:47.631081] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-09T19:52:47.631163] [INFO ] [MAIN ] Update Progress: 1228/2373 symbols completed. KTB took 42.5s. Estimated remaining: 2h 41m 4s. Rate: 7.1 symbols/min [2025-10-09T19:52:47.816727] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:47.854893] [DEBUG] [LOCAL ] KW: Loaded 40373 existing records from primary storage. [2025-10-09T19:52:47.855189] [INFO ] [MAIN ] KW: Loaded 40373 existing records. [2025-10-09T19:52:47.999359] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-09T19:52:48.038679] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:48.040249] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-09T19:52:48.040321] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-09T19:52:48.040943] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-09T19:52:48.041156] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-09T19:52:48.353178] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-09T19:52:48.444884] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:48.796769] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-09T19:52:49.007248] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-09T19:52:49.059989] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T19:52:49.061537] [INFO ] [REMOTE ] KUKE: Full fetch complete (8794 records). [2025-10-09T19:52:49.061607] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-09T19:52:49.242728] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-09T19:52:49.242954] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-09T19:52:49.243020] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-09T19:52:49.243074] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-09T19:52:49.243131] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-09T19:52:49.243193] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-09T19:52:49.243235] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-09T19:52:49.243290] [INFO ] [MAIN ] Update Progress: 1229/2373 symbols completed. KUKE took 25.0s. Estimated remaining: 2h 40m 49s. Rate: 7.1 symbols/min [2025-10-09T19:52:49.408145] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:52:49.429543] [DEBUG] [LOCAL ] KWR: Loaded 16250 existing records from primary storage. [2025-10-09T19:52:49.429829] [INFO ] [MAIN ] KWR: Loaded 16250 existing records. [2025-10-09T19:52:49.601979] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-09T19:52:49.604201] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:52:49.605348] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-09T19:52:49.605400] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-09T19:52:49.605621] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-09T19:52:49.605715] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-09T19:52:49.963640] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:52:50.396755] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-09T19:52:50.444340] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-09T19:52:51.075419] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-09T19:52:51.196766] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-09T19:52:51.754116] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-09T19:52:51.996780] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-09T19:52:52.796682] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-09T19:52:52.832736] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-09T19:52:52.953495] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-09T19:52:53.596734] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-09T19:52:53.823357] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T19:52:54.396729] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-09T19:52:55.022399] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T19:52:55.196698] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-09T19:52:55.682374] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-09T19:52:55.996777] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-09T19:52:56.796762] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-09T19:52:57.022610] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-09T19:52:57.046332] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:52:57.500819] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-09T19:52:57.596717] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-09T19:52:58.396756] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-09T19:52:58.597928] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T19:52:59.196722] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-09T19:52:59.996773] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-09T19:53:00.037917] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-09T19:53:00.289871] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-09T19:53:00.796722] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-09T19:53:00.853222] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-09T19:53:01.596725] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-09T19:53:02.379872] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-09T19:53:02.396672] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-09T19:53:03.130388] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:53:03.196715] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-09T19:53:03.955030] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-09T19:53:03.996669] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-09T19:53:04.126421] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-09T19:53:04.736339] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-09T19:53:04.796717] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-09T19:53:05.596713] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-09T19:53:06.084476] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T19:53:06.350734] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-09T19:53:06.396677] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-09T19:53:07.196772] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-09T19:53:07.382551] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-09T19:53:07.996817] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-09T19:53:08.636300] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-09T19:53:08.770213] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-09T19:53:08.796752] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-09T19:53:09.596751] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-09T19:53:09.644235] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-09T19:53:10.396813] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-09T19:53:11.196823] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-09T19:53:11.351434] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-09T19:53:11.353094] [INFO ] [REMOTE ] KWR: Full fetch complete (23799 records). [2025-10-09T19:53:11.353163] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-09T19:53:11.768993] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-09T19:53:11.769183] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-09T19:53:11.769823] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-09T19:53:11.769888] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-09T19:53:11.770746] [DEBUG] [LOCAL ] KWR: Trimmed 23799 records to 16328 (keeping 200 days of data) [2025-10-09T19:53:11.877241] [DEBUG] [LOCAL ] KWR: Primary data saved (16328 records). [2025-10-09T19:53:11.877521] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-09T19:53:11.877697] [INFO ] [MAIN ] Update Progress: 1230/2373 symbols completed. KWR took 22.6s. Estimated remaining: 2h 40m 54s. Rate: 7.1 symbols/min [2025-10-09T19:53:11.998791] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-09T19:53:12.089276] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:12.091814] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-09T19:53:12.138922] [DEBUG] [LOCAL ] KYN: Loaded 30062 existing records from primary storage. [2025-10-09T19:53:12.139345] [INFO ] [MAIN ] KYN: Loaded 30062 existing records. [2025-10-09T19:53:12.338302] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:53:12.338525] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-09T19:53:12.338574] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-09T19:53:12.338821] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-09T19:53:12.338879] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-09T19:53:12.697706] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:12.725701] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-09T19:53:12.796715] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-09T19:53:13.516186] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-09T19:53:13.596717] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-09T19:53:13.941531] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-09T19:53:14.396727] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-09T19:53:14.948829] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-09T19:53:15.196771] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-09T19:53:16.001036] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-09T19:53:16.014301] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T19:53:16.216713] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-09T19:53:16.796809] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-09T19:53:17.596733] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-09T19:53:18.202580] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-09T19:53:18.277431] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-09T19:53:18.282399] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-09T19:53:18.282573] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-09T19:53:18.401911] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-09T19:53:18.675287] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-09T19:53:18.675382] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-09T19:53:18.676569] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-09T19:53:18.676636] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-09T19:53:18.678236] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 54057 (keeping 200 days of data) [2025-10-09T19:53:18.908607] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-09T19:53:18.928570] [INFO ] [REMOTE ] KW: Full fetch complete (57106 records). [2025-10-09T19:53:18.929338] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-09T19:53:19.197892] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-09T19:53:19.440269] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-09T19:53:19.440727] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-09T19:53:19.441720] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-09T19:53:19.441799] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-09T19:53:19.447449] [DEBUG] [LOCAL ] KW: Trimmed 57106 records to 40664 (keeping 200 days of data) [2025-10-09T19:53:19.524257] [DEBUG] [LOCAL ] KVUE: Primary data saved (54057 records). [2025-10-09T19:53:19.550733] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-09T19:53:19.553741] [INFO ] [MAIN ] Update Progress: 1231/2373 symbols completed. KVUE took 50.3s. Estimated remaining: 2h 40m 44s. Rate: 7.1 symbols/min [2025-10-09T19:53:19.766301] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:19.767299] [DEBUG] [LOCAL ] L: No existing data file found in primary storage. [2025-10-09T19:53:19.767667] [WARN ] [MAIN ] L: No existing data found, performing full refresh instead. [2025-10-09T19:53:19.770899] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-09T19:53:19.784161] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-09T19:53:19.795520] [DEBUG] [LOCAL ] L: No primary data file found to delete. [2025-10-09T19:53:19.798150] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-09T19:53:19.797929] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-09T19:53:20.010096] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-09T19:53:20.334193] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:20.348826] [DEBUG] [LOCAL ] KW: Primary data saved (40664 records). [2025-10-09T19:53:20.349000] [INFO ] [MAIN ] KW: Full history saved. [2025-10-09T19:53:20.349097] [INFO ] [MAIN ] Update Progress: 1232/2373 symbols completed. KW took 32.7s. Estimated remaining: 2h 40m 29s. Rate: 7.1 symbols/min [2025-10-09T19:53:20.535960] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:20.589356] [DEBUG] [LOCAL ] LAC: Loaded 52443 existing records from primary storage. [2025-10-09T19:53:20.589835] [INFO ] [MAIN ] LAC: Loaded 52443 existing records. [2025-10-09T19:53:20.788589] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:53:20.789125] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-09T19:53:20.789214] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-09T19:53:20.789614] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-09T19:53:20.789748] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-09T19:53:20.816442] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-09T19:53:21.180917] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T19:53:21.228424] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:21.266622] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-09T19:53:21.596719] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-09T19:53:21.944370] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:53:22.396733] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-09T19:53:22.662291] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-09T19:53:23.196751] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-09T19:53:23.754123] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-09T19:53:23.758934] [INFO ] [REMOTE ] KVYO: Full fetch complete (71770 records). [2025-10-09T19:53:23.759060] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-09T19:53:24.001938] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-09T19:53:24.164857] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-09T19:53:24.164966] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-09T19:53:24.166068] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-09T19:53:24.166178] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-09T19:53:24.167626] [DEBUG] [LOCAL ] KVYO: Trimmed 71770 records to 50818 (keeping 200 days of data) [2025-10-09T19:53:24.491333] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-09T19:53:24.514927] [DEBUG] [LOCAL ] KVYO: Primary data saved (50818 records). [2025-10-09T19:53:24.515118] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-09T19:53:24.515786] [INFO ] [MAIN ] Update Progress: 1233/2373 symbols completed. KVYO took 50.6s. Estimated remaining: 2h 40m 16s. Rate: 7.1 symbols/min [2025-10-09T19:53:24.690692] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:24.715744] [DEBUG] [LOCAL ] LAD: Loaded 23558 existing records from primary storage. [2025-10-09T19:53:24.716008] [INFO ] [MAIN ] LAD: Loaded 23558 existing records. [2025-10-09T19:53:24.803470] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-09T19:53:24.893083] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:53:24.893298] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-09T19:53:24.893344] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-09T19:53:24.893562] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-09T19:53:24.893619] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-09T19:53:25.244530] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:25.328097] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-09T19:53:25.596742] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-09T19:53:26.047447] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-09T19:53:26.396762] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-09T19:53:26.430700] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T19:53:27.196734] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-09T19:53:27.911144] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-09T19:53:27.996785] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-09T19:53:28.447207] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-09T19:53:28.796734] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-09T19:53:29.529571] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T19:53:29.596709] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-09T19:53:30.396743] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-09T19:53:30.722956] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-09T19:53:30.774710] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:53:31.196729] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-09T19:53:31.703983] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:53:31.996787] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-09T19:53:32.725523] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:53:32.796732] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-09T19:53:33.596788] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-09T19:53:33.883895] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-09T19:53:34.044093] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-09T19:53:34.396693] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-09T19:53:34.420239] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-09T19:53:35.196777] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-09T19:53:35.612555] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-09T19:53:35.996716] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-09T19:53:36.519746] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-09T19:53:36.796721] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-09T19:53:36.848003] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T19:53:37.596715] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-09T19:53:38.396775] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-09T19:53:38.663925] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-09T19:53:38.800833] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:53:39.196757] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-09T19:53:39.330089] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-09T19:53:39.996732] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-09T19:53:40.796699] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-09T19:53:41.189558] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-09T19:53:41.358125] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-09T19:53:41.596701] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-09T19:53:42.112179] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-09T19:53:42.396734] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-09T19:53:43.196720] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-09T19:53:43.548454] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-09T19:53:43.776972] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-09T19:53:43.915297] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-09T19:53:43.996678] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-09T19:53:44.715532] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-09T19:53:44.796682] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-09T19:53:45.596835] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-09T19:53:45.775941] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-09T19:53:46.396741] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-09T19:53:47.196762] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-09T19:53:47.494230] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-09T19:53:47.496746] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-09T19:53:47.514873] [INFO ] [REMOTE ] KYN: Full fetch complete (44337 records). [2025-10-09T19:53:47.515560] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-09T19:53:47.900578] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-09T19:53:47.900685] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-09T19:53:47.901516] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-09T19:53:47.901579] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-09T19:53:47.902632] [DEBUG] [LOCAL ] KYN: Trimmed 44337 records to 30315 (keeping 200 days of data) [2025-10-09T19:53:47.996777] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-09T19:53:48.091843] [DEBUG] [LOCAL ] KYN: Primary data saved (30315 records). [2025-10-09T19:53:48.092014] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-09T19:53:48.092182] [INFO ] [MAIN ] Update Progress: 1234/2373 symbols completed. KYN took 36.2s. Estimated remaining: 2h 40m 22s. Rate: 7.1 symbols/min [2025-10-09T19:53:48.258632] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:48.294174] [DEBUG] [LOCAL ] LADR: Loaded 39156 existing records from primary storage. [2025-10-09T19:53:48.294457] [INFO ] [MAIN ] LADR: Loaded 39156 existing records. [2025-10-09T19:53:48.484607] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:53:48.485086] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-09T19:53:48.485148] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-09T19:53:48.485403] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-09T19:53:48.485460] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-09T19:53:48.799555] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-09T19:53:48.799732] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-09T19:53:48.850212] [INFO ] [REMOTE ] L: Full fetch complete (59358 records). [2025-10-09T19:53:48.872994] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-09T19:53:48.872809] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:49.302148] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-09T19:53:49.329620] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-09T19:53:49.329759] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-09T19:53:49.331092] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-09T19:53:49.331162] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-09T19:53:49.332435] [DEBUG] [LOCAL ] L: Trimmed 59358 records to 41365 (keeping 200 days of data) [2025-10-09T19:53:49.591352] [DEBUG] [LOCAL ] L: Primary data saved (41365 records). [2025-10-09T19:53:49.591502] [INFO ] [MAIN ] L: Full history saved. [2025-10-09T19:53:49.591589] [INFO ] [MAIN ] Update Progress: 1235/2373 symbols completed. L took 30.0s. Estimated remaining: 2h 40m 7s. Rate: 7.1 symbols/min [2025-10-09T19:53:49.602833] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-09T19:53:49.778449] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:49.783766] [DEBUG] [LOCAL ] LANV: Loaded 2763 existing records from primary storage. [2025-10-09T19:53:49.783930] [INFO ] [MAIN ] LANV: Loaded 2763 existing records. [2025-10-09T19:53:49.962580] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:53:49.962864] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-09T19:53:49.962913] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-09T19:53:49.963097] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-09T19:53:49.963155] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-09T19:53:50.326210] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:50.396700] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-09T19:53:50.758971] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-09T19:53:51.013904] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T19:53:51.020173] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-09T19:53:51.196718] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-09T19:53:51.526831] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-09T19:53:51.996713] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-09T19:53:52.456826] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-09T19:53:52.796733] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-09T19:53:53.281525] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-09T19:53:53.596729] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-09T19:53:54.396753] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-09T19:53:54.716277] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-09T19:53:54.718675] [INFO ] [REMOTE ] LAD: Full fetch complete (35304 records). [2025-10-09T19:53:54.718839] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-09T19:53:54.895579] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-09T19:53:55.093689] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-09T19:53:55.093800] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-09T19:53:55.094495] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-09T19:53:55.094541] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-09T19:53:55.095314] [DEBUG] [LOCAL ] LAD: Trimmed 35304 records to 23719 (keeping 200 days of data) [2025-10-09T19:53:55.197784] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-09T19:53:55.245248] [DEBUG] [LOCAL ] LAD: Primary data saved (23719 records). [2025-10-09T19:53:55.245395] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-09T19:53:55.245498] [INFO ] [MAIN ] Update Progress: 1236/2373 symbols completed. LAD took 30.7s. Estimated remaining: 2h 39m 56s. Rate: 7.1 symbols/min [2025-10-09T19:53:55.411970] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:53:55.412216] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-09T19:53:55.412273] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-09T19:53:55.412419] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-09T19:53:55.412486] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-09T19:53:55.412541] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-09T19:53:55.412575] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-09T19:53:55.633801] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-09T19:53:55.766618] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:53:55.996718] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-09T19:53:56.796698] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-09T19:53:56.987436] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-09T19:53:56.987805] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-09T19:53:56.987908] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:53:56.987974] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-09T19:53:56.988033] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:53:56.988083] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-09T19:53:56.988156] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-09T19:53:56.988206] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-09T19:53:56.988291] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-09T19:53:56.988342] [INFO ] [MAIN ] Update Progress: 1237/2373 symbols completed. LAR took 1.7s. Estimated remaining: 2h 39m 42s. Rate: 7.1 symbols/min [2025-10-09T19:53:57.369068] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-09T19:53:57.596715] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-09T19:53:58.396726] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-09T19:53:59.056305] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-09T19:53:59.196760] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-09T19:53:59.996719] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-09T19:54:00.390802] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-09T19:54:00.414450] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-09T19:54:00.615448] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-09T19:54:00.796746] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-09T19:54:01.596772] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-09T19:54:01.945539] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-09T19:54:01.966904] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T19:54:02.396747] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-09T19:54:02.870942] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-09T19:54:03.196721] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-09T19:54:03.996746] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-09T19:54:04.696171] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-09T19:54:04.724752] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-09T19:54:04.796675] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-09T19:54:05.596774] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-09T19:54:05.981282] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-09T19:54:06.040617] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-09T19:54:06.041497] [INFO ] [REMOTE ] LANV: Full fetch complete (4356 records). [2025-10-09T19:54:06.041565] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-09T19:54:06.393626] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-09T19:54:06.393743] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-09T19:54:06.393944] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-09T19:54:06.393984] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-09T19:54:06.394345] [DEBUG] [LOCAL ] LANV: Trimmed 4356 records to 2790 (keeping 200 days of data) [2025-10-09T19:54:06.400611] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-09T19:54:06.410586] [DEBUG] [LOCAL ] LANV: Primary data saved (2790 records). [2025-10-09T19:54:06.410717] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-09T19:54:06.410868] [INFO ] [MAIN ] Update Progress: 1238/2373 symbols completed. LANV took 16.8s. Estimated remaining: 2h 39m 34s. Rate: 7.1 symbols/min [2025-10-09T19:54:07.196764] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-09T19:54:07.909532] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-09T19:54:07.996778] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-09T19:54:09.105384] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-09T19:54:09.120549] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-09T19:54:09.596948] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-09T19:54:09.607815] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-09T19:54:10.784269] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:54:10.793814] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-09T19:54:12.003405] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.88 seconds). [2025-10-09T19:54:12.009999] [INFO ] [REMOTE ] LAC: Full fetch complete (76003 records). [2025-10-09T19:54:12.010227] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-09T19:54:12.184135] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-09T19:54:12.230156] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-09T19:54:12.490961] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-09T19:54:12.491058] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-09T19:54:12.492122] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-09T19:54:12.492194] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-09T19:54:12.493848] [DEBUG] [LOCAL ] LAC: Trimmed 76003 records to 52833 (keeping 200 days of data) [2025-10-09T19:54:12.802698] [DEBUG] [LOCAL ] LAC: Primary data saved (52833 records). [2025-10-09T19:54:12.802864] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-09T19:54:12.802970] [INFO ] [MAIN ] Update Progress: 1239/2373 symbols completed. LAC took 52.5s. Estimated remaining: 2h 39m 24s. Rate: 7.1 symbols/min [2025-10-09T19:54:13.884359] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-09T19:54:13.891428] [INFO ] [REMOTE ] LADR: Full fetch complete (55571 records). [2025-10-09T19:54:13.891581] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-09T19:54:14.311745] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-09T19:54:14.311867] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-09T19:54:14.313115] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-09T19:54:14.313199] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-09T19:54:14.314886] [DEBUG] [LOCAL ] LADR: Trimmed 55571 records to 39462 (keeping 200 days of data) [2025-10-09T19:54:14.570105] [DEBUG] [LOCAL ] LADR: Primary data saved (39462 records). [2025-10-09T19:54:14.570257] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-09T19:54:14.570343] [INFO ] [MAIN ] Update Progress: 1240/2373 symbols completed. LADR took 26.5s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-09T19:54:15.241192] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:15.278854] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:15.318476] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:15.333988] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:15.370347] [DEBUG] [LOCAL ] LAW: Loaded 14259 existing records from primary storage. [2025-10-09T19:54:15.370912] [INFO ] [MAIN ] LAW: Loaded 14259 existing records. [2025-10-09T19:54:15.559961] [DEBUG] [LOCAL ] LBRT: Loaded 52937 existing records from primary storage. [2025-10-09T19:54:15.548188] [DEBUG] [LOCAL ] LB: Loaded 37667 existing records from primary storage. [2025-10-09T19:54:15.542879] [DEBUG] [LOCAL ] LAZ: Loaded 44782 existing records from primary storage. [2025-10-09T19:54:15.571272] [INFO ] [MAIN ] LAZ: Loaded 44782 existing records. [2025-10-09T19:54:15.571580] [INFO ] [MAIN ] LB: Loaded 37667 existing records. [2025-10-09T19:54:15.571393] [INFO ] [MAIN ] LBRT: Loaded 52937 existing records. [2025-10-09T19:54:16.006337] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:16.071451] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-09T19:54:16.138592] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:16.147749] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-09T19:54:16.205351] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:16.242879] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-09T19:54:16.242709] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-09T19:54:16.243027] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-09T19:54:16.242503] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:16.243420] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-09T19:54:16.243691] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-09T19:54:16.243826] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-09T19:54:16.244081] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-09T19:54:16.244127] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-09T19:54:16.249473] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-09T19:54:16.249724] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-09T19:54:16.255683] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-09T19:54:16.275055] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-09T19:54:16.255611] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-09T19:54:16.275205] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-09T19:54:17.919404] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:18.045183] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-09T19:54:18.034519] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:18.094548] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-09T19:54:18.086144] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:18.117882] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:18.114505] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-09T19:54:18.119699] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-09T19:54:19.274413] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-09T19:54:19.278328] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-09T19:54:19.549080] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-09T19:54:19.559725] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-09T19:54:19.637930] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:54:19.646245] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-09T19:54:19.799496] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T19:54:19.808710] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-09T19:54:20.159603] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T19:54:20.163051] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-09T19:54:21.049311] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:54:21.058574] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-09T19:54:21.141017] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T19:54:21.145896] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-09T19:54:21.177472] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-09T19:54:21.188479] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-09T19:54:21.281293] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-09T19:54:21.596732] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-09T19:54:21.949430] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-09T19:54:22.166467] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:54:22.396718] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-09T19:54:22.699762] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-09T19:54:23.188988] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-09T19:54:23.196667] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-09T19:54:23.340744] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T19:54:23.996694] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-09T19:54:24.214884] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-09T19:54:24.796744] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-09T19:54:25.582713] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-09T19:54:25.596851] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-09T19:54:25.624349] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-09T19:54:26.396738] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-09T19:54:27.196748] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-09T19:54:27.227368] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:54:27.996698] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-09T19:54:28.046077] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T19:54:28.122963] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-09T19:54:28.796773] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-09T19:54:29.569495] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T19:54:29.596666] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-09T19:54:30.396700] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-09T19:54:30.509020] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-09T19:54:30.900833] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-09T19:54:30.947001] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-09T19:54:31.196766] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-09T19:54:31.996691] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-09T19:54:32.119676] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-09T19:54:32.796715] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-09T19:54:33.596698] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-09T19:54:33.786432] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-09T19:54:34.219277] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-09T19:54:34.396706] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-09T19:54:34.519666] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-09T19:54:34.522097] [INFO ] [REMOTE ] LAW: Full fetch complete (20687 records). [2025-10-09T19:54:34.522210] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-09T19:54:34.899268] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-09T19:54:34.899352] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-09T19:54:34.900004] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-09T19:54:34.900074] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-09T19:54:34.900750] [DEBUG] [LOCAL ] LAW: Trimmed 20687 records to 14351 (keeping 200 days of data) [2025-10-09T19:54:34.984673] [DEBUG] [LOCAL ] LAW: Primary data saved (14351 records). [2025-10-09T19:54:34.984848] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-09T19:54:34.984971] [INFO ] [MAIN ] Update Progress: 1241/2373 symbols completed. LAW took 20.4s. Estimated remaining: 2h 39m 12s. Rate: 7.1 symbols/min [2025-10-09T19:54:35.162278] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:35.207323] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-09T19:54:35.210402] [DEBUG] [LOCAL ] LC: Loaded 47939 existing records from primary storage. [2025-10-09T19:54:35.210767] [INFO ] [MAIN ] LC: Loaded 47939 existing records. [2025-10-09T19:54:35.393686] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:35.393932] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-09T19:54:35.393981] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-09T19:54:35.394188] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-09T19:54:35.394246] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-09T19:54:35.763371] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:35.996708] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-09T19:54:36.057388] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:54:36.803993] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-09T19:54:36.809135] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-09T19:54:37.596683] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-09T19:54:38.024021] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-09T19:54:38.396724] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-09T19:54:38.647742] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-09T19:54:38.984544] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-09T19:54:39.196755] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-09T19:54:39.996751] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-09T19:54:40.097920] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-09T19:54:40.801892] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-09T19:54:40.814625] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-09T19:54:41.560291] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-09T19:54:41.596810] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-09T19:54:42.378599] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-09T19:54:42.396689] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-09T19:54:43.196795] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-09T19:54:43.358672] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T19:54:43.996753] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-09T19:54:44.222301] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-09T19:54:44.318346] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-09T19:54:44.796726] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-09T19:54:45.596709] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-09T19:54:45.667393] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-09T19:54:46.294959] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-09T19:54:46.396694] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-09T19:54:47.207234] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-09T19:54:47.213866] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:54:47.658743] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T19:54:47.662206] [INFO ] [REMOTE ] LB: Full fetch complete (55871 records). [2025-10-09T19:54:47.662311] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-09T19:54:48.002429] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-09T19:54:48.065851] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-09T19:54:48.065940] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-09T19:54:48.066943] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-09T19:54:48.067013] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-09T19:54:48.068470] [DEBUG] [LOCAL ] LB: Trimmed 55871 records to 37931 (keeping 200 days of data) [2025-10-09T19:54:48.306576] [DEBUG] [LOCAL ] LB: Primary data saved (37931 records). [2025-10-09T19:54:48.306756] [INFO ] [MAIN ] LB: Full history saved. [2025-10-09T19:54:48.306849] [INFO ] [MAIN ] Update Progress: 1242/2373 symbols completed. LB took 33.7s. Estimated remaining: 2h 39m 8s. Rate: 7.1 symbols/min [2025-10-09T19:54:48.481536] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:48.512480] [DEBUG] [LOCAL ] LCII: Loaded 27674 existing records from primary storage. [2025-10-09T19:54:48.522502] [INFO ] [MAIN ] LCII: Loaded 27674 existing records. [2025-10-09T19:54:48.641447] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-09T19:54:48.730500] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:48.730762] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-09T19:54:48.730845] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-09T19:54:48.731074] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-09T19:54:48.731131] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-09T19:54:48.804225] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-09T19:54:49.096722] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:49.527358] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-09T19:54:49.532340] [INFO ] [REMOTE ] LBRT: Full fetch complete (76626 records). [2025-10-09T19:54:49.532490] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-09T19:54:49.601902] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-09T19:54:50.010228] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-09T19:54:50.010353] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-09T19:54:50.011540] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-09T19:54:50.011635] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-09T19:54:50.013428] [DEBUG] [LOCAL ] LBRT: Trimmed 76626 records to 53323 (keeping 200 days of data) [2025-10-09T19:54:50.399596] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-09T19:54:50.406995] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-09T19:54:50.433673] [DEBUG] [LOCAL ] LBRT: Primary data saved (53323 records). [2025-10-09T19:54:50.433805] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-09T19:54:50.434617] [INFO ] [MAIN ] Update Progress: 1243/2373 symbols completed. LBRT took 35.8s. Estimated remaining: 2h 38m 54s. Rate: 7.1 symbols/min [2025-10-09T19:54:50.616728] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:50.666104] [DEBUG] [LOCAL ] LDI: Loaded 44485 existing records from primary storage. [2025-10-09T19:54:50.666425] [INFO ] [MAIN ] LDI: Loaded 44485 existing records. [2025-10-09T19:54:50.797147] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-09T19:54:50.875755] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:50.876415] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-09T19:54:50.876538] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-09T19:54:50.877228] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-09T19:54:50.877303] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-09T19:54:51.201967] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-09T19:54:51.240550] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:51.980813] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-09T19:54:51.996667] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-09T19:54:52.411787] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-09T19:54:52.796736] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-09T19:54:53.285948] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-09T19:54:53.596756] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-09T19:54:53.981287] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-09T19:54:53.985008] [INFO ] [REMOTE ] LAZ: Full fetch complete (65719 records). [2025-10-09T19:54:53.985111] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-09T19:54:54.363152] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-09T19:54:54.363243] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-09T19:54:54.364174] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-09T19:54:54.364240] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-09T19:54:54.365626] [DEBUG] [LOCAL ] LAZ: Trimmed 65719 records to 45066 (keeping 200 days of data) [2025-10-09T19:54:54.425727] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-09T19:54:54.648877] [DEBUG] [LOCAL ] LAZ: Primary data saved (45066 records). [2025-10-09T19:54:54.649016] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-09T19:54:54.649101] [INFO ] [MAIN ] Update Progress: 1244/2373 symbols completed. LAZ took 40.1s. Estimated remaining: 2h 38m 41s. Rate: 7.1 symbols/min [2025-10-09T19:54:54.845604] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-09T19:54:54.849535] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:54:54.899639] [DEBUG] [LOCAL ] LDOS: Loaded 45346 existing records from primary storage. [2025-10-09T19:54:54.900013] [INFO ] [MAIN ] LDOS: Loaded 45346 existing records. [2025-10-09T19:54:55.087859] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:54:55.088089] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-09T19:54:55.088144] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-09T19:54:55.088352] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-09T19:54:55.088412] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-09T19:54:55.201974] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-09T19:54:55.467099] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:54:55.750324] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-09T19:54:55.996739] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-09T19:54:56.373538] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-09T19:54:56.796747] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-09T19:54:57.106339] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-09T19:54:57.596760] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-09T19:54:58.400825] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-09T19:54:58.406375] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-09T19:54:58.578825] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-09T19:54:59.196746] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-09T19:54:59.996749] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-09T19:55:00.116530] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-09T19:55:00.504511] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-09T19:55:00.796741] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-09T19:55:01.596849] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-09T19:55:01.733207] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T19:55:01.896144] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-09T19:55:02.396786] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-09T19:55:02.593434] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-09T19:55:03.196727] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-09T19:55:03.996732] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-09T19:55:04.158784] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-09T19:55:04.796707] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-09T19:55:04.875560] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-09T19:55:05.302532] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-09T19:55:05.596742] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-09T19:55:06.369133] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-09T19:55:06.396672] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-09T19:55:06.798398] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-09T19:55:07.196705] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-09T19:55:07.996747] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-09T19:55:08.079399] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T19:55:08.667402] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-09T19:55:08.796786] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-09T19:55:09.086634] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-09T19:55:09.596811] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-09T19:55:10.056104] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-09T19:55:10.396699] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-09T19:55:10.766030] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-09T19:55:11.196786] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-09T19:55:11.996721] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-09T19:55:12.066772] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-09T19:55:12.071261] [INFO ] [REMOTE ] LC: Full fetch complete (70493 records). [2025-10-09T19:55:12.071386] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-09T19:55:12.502834] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-09T19:55:12.508081] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-09T19:55:12.519561] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-09T19:55:12.523021] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-09T19:55:12.522866] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-09T19:55:12.531630] [DEBUG] [LOCAL ] LC: Trimmed 70493 records to 48313 (keeping 200 days of data) [2025-10-09T19:55:12.798562] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-09T19:55:12.829281] [DEBUG] [LOCAL ] LC: Primary data saved (48313 records). [2025-10-09T19:55:12.829386] [INFO ] [MAIN ] LC: Full history saved. [2025-10-09T19:55:12.830076] [INFO ] [MAIN ] Update Progress: 1245/2373 symbols completed. LC took 37.8s. Estimated remaining: 2h 38m 42s. Rate: 7.1 symbols/min [2025-10-09T19:55:13.010200] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:13.026312] [DEBUG] [LOCAL ] LDP: Loaded 12929 existing records from primary storage. [2025-10-09T19:55:13.026550] [INFO ] [MAIN ] LDP: Loaded 12929 existing records. [2025-10-09T19:55:13.202053] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:13.202251] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-09T19:55:13.202297] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-09T19:55:13.202459] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-09T19:55:13.202496] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-09T19:55:13.561485] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:13.596673] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-09T19:55:13.780382] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-09T19:55:13.843206] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-09T19:55:14.133972] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-09T19:55:14.396737] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-09T19:55:15.196716] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-09T19:55:15.996692] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-09T19:55:16.106682] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-09T19:55:16.436475] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-09T19:55:16.796711] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-09T19:55:17.029827] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-09T19:55:17.596715] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-09T19:55:18.354572] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:55:18.396690] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-09T19:55:18.821673] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-09T19:55:19.196728] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-09T19:55:19.623259] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-09T19:55:19.850241] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-09T19:55:19.996757] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-09T19:55:20.796745] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-09T19:55:21.140492] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-09T19:55:21.142940] [INFO ] [REMOTE ] LCII: Full fetch complete (39085 records). [2025-10-09T19:55:21.143020] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-09T19:55:21.515452] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-09T19:55:21.515534] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-09T19:55:21.516237] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-09T19:55:21.516301] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-09T19:55:21.517211] [DEBUG] [LOCAL ] LCII: Trimmed 39085 records to 27795 (keeping 200 days of data) [2025-10-09T19:55:21.611804] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-09T19:55:21.700804] [DEBUG] [LOCAL ] LCII: Primary data saved (27795 records). [2025-10-09T19:55:21.700962] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-09T19:55:21.701053] [INFO ] [MAIN ] Update Progress: 1246/2373 symbols completed. LCII took 33.4s. Estimated remaining: 2h 38m 34s. Rate: 7.1 symbols/min [2025-10-09T19:55:21.870389] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:21.916216] [DEBUG] [LOCAL ] LEA: Loaded 41557 existing records from primary storage. [2025-10-09T19:55:21.916565] [INFO ] [MAIN ] LEA: Loaded 41557 existing records. [2025-10-09T19:55:22.090835] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:22.091042] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-09T19:55:22.091089] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-09T19:55:22.091366] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-09T19:55:22.091423] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-09T19:55:22.411282] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-09T19:55:22.460739] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:22.462942] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-09T19:55:22.981136] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-09T19:55:23.196724] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-09T19:55:23.610758] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-09T19:55:23.996765] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-09T19:55:24.796761] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-09T19:55:25.482032] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-09T19:55:25.535453] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-09T19:55:25.540707] [INFO ] [REMOTE ] LDI: Full fetch complete (61147 records). [2025-10-09T19:55:25.540864] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-09T19:55:25.609751] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-09T19:55:25.936410] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-09T19:55:25.936515] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-09T19:55:25.937503] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-09T19:55:25.937573] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-09T19:55:25.939088] [DEBUG] [LOCAL ] LDI: Trimmed 61147 records to 44871 (keeping 200 days of data) [2025-10-09T19:55:26.209907] [DEBUG] [LOCAL ] LDI: Primary data saved (44871 records). [2025-10-09T19:55:26.210046] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-09T19:55:26.210134] [INFO ] [MAIN ] Update Progress: 1247/2373 symbols completed. LDI took 35.8s. Estimated remaining: 2h 38m 22s. Rate: 7.1 symbols/min [2025-10-09T19:55:26.375186] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-09T19:55:26.393000] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:26.396963] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-09T19:55:26.397662] [INFO ] [REMOTE ] LDOS: Full fetch complete (67321 records). [2025-10-09T19:55:26.398709] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-09T19:55:26.502076] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-09T19:55:26.745551] [DEBUG] [LOCAL ] LEG: Loaded 50168 existing records from primary storage. [2025-10-09T19:55:26.756876] [INFO ] [MAIN ] LEG: Loaded 50168 existing records. [2025-10-09T19:55:26.970735] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-09T19:55:26.981145] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-09T19:55:27.001013] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-09T19:55:27.006252] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-09T19:55:27.046039] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:27.046417] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-09T19:55:27.046477] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-09T19:55:27.046595] [DEBUG] [LOCAL ] LDOS: Trimmed 67321 records to 45603 (keeping 200 days of data) [2025-10-09T19:55:27.046706] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-09T19:55:27.047062] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-09T19:55:27.201950] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-09T19:55:27.532756] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:27.716262] [DEBUG] [LOCAL ] LDOS: Primary data saved (45603 records). [2025-10-09T19:55:27.716462] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-09T19:55:27.717479] [INFO ] [MAIN ] Update Progress: 1248/2373 symbols completed. LDOS took 33.1s. Estimated remaining: 2h 38m 7s. Rate: 7.1 symbols/min [2025-10-09T19:55:27.887278] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:27.946794] [DEBUG] [LOCAL ] LEN: Loaded 53170 existing records from primary storage. [2025-10-09T19:55:27.947173] [INFO ] [MAIN ] LEN: Loaded 53170 existing records. [2025-10-09T19:55:28.002101] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-09T19:55:28.134466] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-09T19:55:28.164876] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:28.166106] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-09T19:55:28.176203] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-09T19:55:28.176847] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-09T19:55:28.177343] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-09T19:55:28.177204] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-09T19:55:28.545696] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:28.796737] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-09T19:55:29.469883] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T19:55:29.596780] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-09T19:55:29.747176] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T19:55:30.396702] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-09T19:55:31.073903] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-09T19:55:31.196681] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-09T19:55:31.996686] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-09T19:55:32.074400] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-09T19:55:32.407467] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-09T19:55:32.796811] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-09T19:55:33.162383] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-09T19:55:33.596734] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-09T19:55:34.396803] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-09T19:55:34.734091] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-09T19:55:35.000955] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:55:35.196737] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-09T19:55:35.996690] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-09T19:55:36.165804] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T19:55:36.689571] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-09T19:55:36.796676] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-09T19:55:37.433118] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-09T19:55:37.596687] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-09T19:55:38.396753] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-09T19:55:38.449760] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-09T19:55:39.119981] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-09T19:55:39.196678] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-09T19:55:39.260098] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-09T19:55:39.891684] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-09T19:55:39.996770] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-09T19:55:40.778494] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-09T19:55:40.796691] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-09T19:55:41.557510] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-09T19:55:41.559951] [INFO ] [REMOTE ] LDP: Full fetch complete (19053 records). [2025-10-09T19:55:41.560048] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-09T19:55:41.604782] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-09T19:55:41.960030] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-09T19:55:41.960137] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-09T19:55:41.960560] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-09T19:55:41.960601] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-09T19:55:41.961156] [DEBUG] [LOCAL ] LDP: Trimmed 19053 records to 13016 (keeping 200 days of data) [2025-10-09T19:55:42.042596] [DEBUG] [LOCAL ] LDP: Primary data saved (13016 records). [2025-10-09T19:55:42.042773] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-09T19:55:42.042865] [INFO ] [MAIN ] Update Progress: 1249/2373 symbols completed. LDP took 29.2s. Estimated remaining: 2h 38m 4s. Rate: 7.1 symbols/min [2025-10-09T19:55:42.213506] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:42.230314] [DEBUG] [LOCAL ] LEO: Loaded 16882 existing records from primary storage. [2025-10-09T19:55:42.230580] [INFO ] [MAIN ] LEO: Loaded 16882 existing records. [2025-10-09T19:55:42.404014] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-09T19:55:42.411601] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:42.411924] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-09T19:55:42.411974] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-09T19:55:42.412189] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-09T19:55:42.412248] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-09T19:55:42.769149] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:43.196732] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-09T19:55:43.260684] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-09T19:55:43.927799] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-09T19:55:43.928629] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-09T19:55:43.996682] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-09T19:55:44.796741] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-09T19:55:45.022778] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-09T19:55:45.596698] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-09T19:55:46.306621] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-09T19:55:46.396699] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-09T19:55:46.694228] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-09T19:55:47.196718] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-09T19:55:47.573301] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-09T19:55:47.996711] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-09T19:55:48.796726] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-09T19:55:48.974171] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-09T19:55:49.468098] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-09T19:55:49.543041] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-09T19:55:49.596690] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-09T19:55:50.396788] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-09T19:55:51.165127] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-09T19:55:51.169417] [INFO ] [REMOTE ] LEA: Full fetch complete (60660 records). [2025-10-09T19:55:51.169732] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-09T19:55:51.202177] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-09T19:55:51.568418] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-09T19:55:51.568510] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-09T19:55:51.569481] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-09T19:55:51.569549] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-09T19:55:51.570937] [DEBUG] [LOCAL ] LEA: Trimmed 60660 records to 41878 (keeping 200 days of data) [2025-10-09T19:55:51.839658] [DEBUG] [LOCAL ] LEA: Primary data saved (41878 records). [2025-10-09T19:55:51.839809] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-09T19:55:51.839916] [INFO ] [MAIN ] Update Progress: 1250/2373 symbols completed. LEA took 30.1s. Estimated remaining: 2h 37m 57s. Rate: 7.1 symbols/min [2025-10-09T19:55:52.008812] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:55:52.007673] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-09T19:55:52.065933] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-09T19:55:52.093287] [DEBUG] [LOCAL ] LEVI: Loaded 51674 existing records from primary storage. [2025-10-09T19:55:52.093742] [INFO ] [MAIN ] LEVI: Loaded 51674 existing records. [2025-10-09T19:55:52.152439] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-09T19:55:52.300555] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:55:52.300815] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-09T19:55:52.300864] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-09T19:55:52.301123] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-09T19:55:52.301181] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-09T19:55:52.652784] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:55:52.796702] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-09T19:55:53.596731] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-09T19:55:53.685727] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-09T19:55:54.108931] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-09T19:55:54.396731] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-09T19:55:55.096185] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-09T19:55:55.177310] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T19:55:55.196671] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-09T19:55:55.996686] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-09T19:55:56.232606] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-09T19:55:56.796725] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-09T19:55:57.596730] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-09T19:55:58.175533] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-09T19:55:58.396731] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-09T19:55:58.673144] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-09T19:55:59.196727] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-09T19:55:59.373797] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-09T19:55:59.769445] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-09T19:55:59.996721] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-09T19:56:00.796714] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-09T19:56:00.887443] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-09T19:56:01.597014] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-09T19:56:01.715670] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-09T19:56:02.396758] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-09T19:56:02.772842] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-09T19:56:02.953313] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-09T19:56:03.196738] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-09T19:56:03.713460] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-09T19:56:03.996750] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-09T19:56:04.796747] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-09T19:56:04.825845] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-09T19:56:04.830355] [INFO ] [REMOTE ] LEG: Full fetch complete (72988 records). [2025-10-09T19:56:04.830521] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-09T19:56:05.242541] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-09T19:56:05.242671] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-09T19:56:05.243671] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-09T19:56:05.243734] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-09T19:56:05.245114] [DEBUG] [LOCAL ] LEG: Trimmed 72988 records to 50535 (keeping 200 days of data) [2025-10-09T19:56:05.519814] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-09T19:56:05.596748] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-09T19:56:05.606686] [DEBUG] [LOCAL ] LEG: Primary data saved (50535 records). [2025-10-09T19:56:05.606819] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-09T19:56:05.606931] [INFO ] [MAIN ] Update Progress: 1251/2373 symbols completed. LEG took 39.4s. Estimated remaining: 2h 37m 53s. Rate: 7.1 symbols/min [2025-10-09T19:56:05.781574] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:05.800140] [DEBUG] [LOCAL ] LFT: Loaded 18400 existing records from primary storage. [2025-10-09T19:56:05.800402] [INFO ] [MAIN ] LFT: Loaded 18400 existing records. [2025-10-09T19:56:05.909238] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-09T19:56:05.991211] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:05.991477] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-09T19:56:05.991532] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-09T19:56:05.991792] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-09T19:56:05.991851] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-09T19:56:06.335217] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:06.396678] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-09T19:56:07.074117] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-09T19:56:07.196700] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-09T19:56:07.654594] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-09T19:56:07.996717] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-09T19:56:08.133147] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-09T19:56:08.796775] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-09T19:56:09.596761] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-09T19:56:09.615005] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-09T19:56:09.896087] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-09T19:56:10.396734] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-09T19:56:10.522747] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-09T19:56:11.196723] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-09T19:56:11.311109] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-09T19:56:11.996742] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-09T19:56:12.297253] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-09T19:56:12.796748] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-09T19:56:13.543590] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-09T19:56:13.596681] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-09T19:56:14.396793] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-09T19:56:14.804320] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-09T19:56:14.808883] [INFO ] [REMOTE ] LEN: Full fetch complete (77046 records). [2025-10-09T19:56:14.808994] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-09T19:56:15.217362] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-09T19:56:15.216979] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-09T19:56:15.217714] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-09T19:56:15.225754] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-09T19:56:15.241864] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-09T19:56:15.260013] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T19:56:15.262539] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-09T19:56:15.278469] [DEBUG] [LOCAL ] LEN: Trimmed 77046 records to 53560 (keeping 200 days of data) [2025-10-09T19:56:15.616812] [DEBUG] [LOCAL ] LEN: Primary data saved (53560 records). [2025-10-09T19:56:15.616963] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-09T19:56:15.618073] [INFO ] [MAIN ] Update Progress: 1252/2373 symbols completed. LEN took 47.9s. Estimated remaining: 2h 37m 46s. Rate: 7.1 symbols/min [2025-10-09T19:56:15.802276] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:15.816447] [DEBUG] [LOCAL ] LGI: Loaded 9878 existing records from primary storage. [2025-10-09T19:56:15.816710] [INFO ] [MAIN ] LGI: Loaded 9878 existing records. [2025-10-09T19:56:16.017417] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-09T19:56:16.022882] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:16.028190] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-09T19:56:16.028413] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-09T19:56:16.030242] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-09T19:56:16.030604] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-09T19:56:16.030733] [INFO ] [REMOTE ] LEO: Full fetch complete (26650 records). [2025-10-09T19:56:16.030788] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-09T19:56:16.043066] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-09T19:56:16.762974] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:16.808029] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-09T19:56:16.809824] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-09T19:56:16.809899] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-09T19:56:16.811329] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-09T19:56:16.811394] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-09T19:56:16.812360] [DEBUG] [LOCAL ] LEO: Trimmed 26650 records to 17020 (keeping 200 days of data) [2025-10-09T19:56:16.917899] [DEBUG] [LOCAL ] LEO: Primary data saved (17020 records). [2025-10-09T19:56:16.918055] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-09T19:56:16.918143] [INFO ] [MAIN ] Update Progress: 1253/2373 symbols completed. LEO took 34.9s. Estimated remaining: 2h 37m 31s. Rate: 7.1 symbols/min [2025-10-09T19:56:17.057550] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-09T19:56:17.117191] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:17.158684] [DEBUG] [LOCAL ] LH: Loaded 37766 existing records from primary storage. [2025-10-09T19:56:17.159046] [INFO ] [MAIN ] LH: Loaded 37766 existing records. [2025-10-09T19:56:17.350615] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:17.350847] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-09T19:56:17.350913] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-09T19:56:17.351178] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-09T19:56:17.351237] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-09T19:56:17.606284] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-09T19:56:17.726883] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:18.396765] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-09T19:56:18.664190] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-09T19:56:18.710495] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-09T19:56:19.148013] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-09T19:56:19.196740] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-09T19:56:19.996734] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-09T19:56:20.318572] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-09T19:56:20.634312] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-09T19:56:20.796796] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-09T19:56:21.596854] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-09T19:56:21.598277] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-09T19:56:22.396768] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-09T19:56:23.196757] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-09T19:56:23.361069] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T19:56:23.387258] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-09T19:56:23.996699] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-09T19:56:24.479076] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-09T19:56:24.626707] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-09T19:56:24.796704] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-09T19:56:25.596751] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-09T19:56:25.738948] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T19:56:25.740744] [INFO ] [REMOTE ] LFT: Full fetch complete (24061 records). [2025-10-09T19:56:25.740838] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-09T19:56:26.104405] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-09T19:56:26.104480] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-09T19:56:26.104981] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-09T19:56:26.105046] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-09T19:56:26.105715] [DEBUG] [LOCAL ] LFT: Trimmed 24061 records to 18493 (keeping 200 days of data) [2025-10-09T19:56:26.214894] [DEBUG] [LOCAL ] LFT: Primary data saved (18493 records). [2025-10-09T19:56:26.215029] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-09T19:56:26.215110] [INFO ] [MAIN ] Update Progress: 1254/2373 symbols completed. LFT took 20.6s. Estimated remaining: 2h 37m 23s. Rate: 7.1 symbols/min [2025-10-09T19:56:26.391468] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:26.396745] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-09T19:56:26.437404] [DEBUG] [LOCAL ] LHX: Loaded 48559 existing records from primary storage. [2025-10-09T19:56:26.437825] [INFO ] [MAIN ] LHX: Loaded 48559 existing records. [2025-10-09T19:56:26.613635] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:26.613868] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-09T19:56:26.613924] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-09T19:56:26.614140] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-09T19:56:26.614196] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-09T19:56:26.973175] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:26.993596] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-09T19:56:27.196677] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-09T19:56:27.670350] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-09T19:56:27.996757] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-09T19:56:28.727451] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-09T19:56:28.796724] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-09T19:56:29.596834] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-09T19:56:29.698169] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-09T19:56:29.703218] [INFO ] [REMOTE ] LEVI: Full fetch complete (74556 records). [2025-10-09T19:56:29.703381] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-09T19:56:30.121267] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-09T19:56:30.121435] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-09T19:56:30.122693] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-09T19:56:30.122778] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-09T19:56:30.124524] [DEBUG] [LOCAL ] LEVI: Trimmed 74556 records to 52062 (keeping 200 days of data) [2025-10-09T19:56:30.395000] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-09T19:56:30.397147] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-09T19:56:30.489522] [DEBUG] [LOCAL ] LEVI: Primary data saved (52062 records). [2025-10-09T19:56:30.489689] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-09T19:56:30.489806] [INFO ] [MAIN ] Update Progress: 1255/2373 symbols completed. LEVI took 38.6s. Estimated remaining: 2h 37m 11s. Rate: 7.1 symbols/min [2025-10-09T19:56:30.666014] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:30.694435] [DEBUG] [LOCAL ] LII: Loaded 28016 existing records from primary storage. [2025-10-09T19:56:30.694758] [INFO ] [MAIN ] LII: Loaded 28016 existing records. [2025-10-09T19:56:30.880821] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:30.881069] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-09T19:56:30.881118] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-09T19:56:30.881363] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-09T19:56:30.881422] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-09T19:56:31.184932] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-09T19:56:31.201935] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-09T19:56:31.272022] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:31.292823] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-09T19:56:31.731203] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-09T19:56:31.996739] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-09T19:56:32.796756] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-09T19:56:33.290061] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-09T19:56:33.596749] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-09T19:56:34.396768] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-09T19:56:34.537090] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-09T19:56:34.603136] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-09T19:56:35.175301] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-09T19:56:35.196672] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-09T19:56:35.925496] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-09T19:56:35.996727] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-09T19:56:36.105262] [DEBUG] [REMOTE ] LGI: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-09T19:56:36.105540] [WARN ] [REMOTE ] LGI: No data returned for month 2025-07 [2025-10-09T19:56:36.105631] [FATAL] [REMOTE ] LGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-09T19:56:36.105751] [FATAL] [MAIN ] LGI: Failed to fetch primary data. [2025-10-09T19:56:36.105817] [WARN ] [MAIN ] LGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-09T19:56:36.105886] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-09T19:56:36.105951] [DEBUG] [LOCAL ] LGI: No primary data file found to delete. [2025-10-09T19:56:36.106025] [INFO ] [LOCAL ] LGI: Starting deletion of derivative data. [2025-10-09T19:56:36.106326] [DEBUG] [LOCAL ] LGI: Deleted derivative data file. [2025-10-09T19:56:36.106415] [INFO ] [MAIN ] Update Progress: 1256/2373 symbols completed. LGI took 20.5s. Estimated remaining: 2h 37m 0s. Rate: 7.1 symbols/min [2025-10-09T19:56:36.273510] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:36.320246] [DEBUG] [LOCAL ] LION: Loaded 45437 existing records from primary storage. [2025-10-09T19:56:36.320584] [INFO ] [MAIN ] LION: Loaded 45437 existing records. [2025-10-09T19:56:36.508928] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:36.509156] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-09T19:56:36.509204] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-09T19:56:36.509442] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-09T19:56:36.509501] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-09T19:56:36.801888] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-09T19:56:36.865809] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:37.596723] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-09T19:56:38.268882] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-09T19:56:38.396675] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-09T19:56:39.129307] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-09T19:56:39.196730] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-09T19:56:39.403535] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-09T19:56:39.996752] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-09T19:56:40.736433] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T19:56:40.796683] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-09T19:56:41.069366] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-09T19:56:41.596722] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-09T19:56:42.009724] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-09T19:56:42.396694] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-09T19:56:42.597107] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-09T19:56:43.196718] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-09T19:56:43.535235] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-09T19:56:43.996725] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-09T19:56:44.602227] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-09T19:56:44.796712] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-09T19:56:45.555936] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-09T19:56:45.601807] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-09T19:56:45.610437] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-09T19:56:46.396792] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-09T19:56:46.790792] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-09T19:56:47.196716] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-09T19:56:47.270548] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-09T19:56:47.996734] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-09T19:56:48.796726] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-09T19:56:48.966185] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-09T19:56:49.411766] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-09T19:56:49.596714] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-09T19:56:50.363409] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-09T19:56:50.396674] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-09T19:56:51.196692] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-09T19:56:51.228952] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-09T19:56:51.975620] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-09T19:56:51.996697] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-09T19:56:52.796748] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-09T19:56:53.122352] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-09T19:56:53.318534] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-09T19:56:53.596773] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-09T19:56:54.095813] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-09T19:56:54.396763] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-09T19:56:54.801874] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-09T19:56:55.196769] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-09T19:56:55.698073] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-09T19:56:55.701432] [INFO ] [REMOTE ] LH: Full fetch complete (54982 records). [2025-10-09T19:56:55.701519] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-09T19:56:56.001833] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-09T19:56:56.092040] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-09T19:56:56.092255] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-09T19:56:56.093186] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-09T19:56:56.093250] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-09T19:56:56.094404] [DEBUG] [LOCAL ] LH: Trimmed 54982 records to 37996 (keeping 200 days of data) [2025-10-09T19:56:56.229858] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-09T19:56:56.366134] [DEBUG] [LOCAL ] LH: Primary data saved (37996 records). [2025-10-09T19:56:56.366278] [INFO ] [MAIN ] LH: Full history saved. [2025-10-09T19:56:56.366372] [INFO ] [MAIN ] Update Progress: 1257/2373 symbols completed. LH took 39.4s. Estimated remaining: 2h 37m 2s. Rate: 7.1 symbols/min [2025-10-09T19:56:56.533465] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:56:56.540272] [DEBUG] [LOCAL ] LITB: Loaded 4249 existing records from primary storage. [2025-10-09T19:56:56.540437] [INFO ] [MAIN ] LITB: Loaded 4249 existing records. [2025-10-09T19:56:56.715146] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:56:56.715360] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-09T19:56:56.715407] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-09T19:56:56.715597] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-09T19:56:56.715684] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-09T19:56:56.804783] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-09T19:56:57.073592] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:56:57.596738] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-09T19:56:57.885117] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-09T19:56:57.937799] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-09T19:56:58.396693] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-09T19:56:58.569482] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-09T19:56:59.196746] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-09T19:56:59.538093] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T19:56:59.996732] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-09T19:57:00.564394] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-09T19:57:00.796789] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-09T19:57:01.524221] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-09T19:57:01.596716] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-09T19:57:02.250172] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T19:57:02.396723] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-09T19:57:02.836502] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-09T19:57:03.196744] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-09T19:57:03.490718] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-09T19:57:03.740175] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-09T19:57:03.996698] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-09T19:57:04.796746] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-09T19:57:05.596744] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-09T19:57:05.758056] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-09T19:57:06.396818] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-09T19:57:06.557720] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T19:57:06.835961] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-09T19:57:06.838849] [INFO ] [REMOTE ] LII: Full fetch complete (41371 records). [2025-10-09T19:57:06.838935] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-09T19:57:07.201674] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-09T19:57:07.241987] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-09T19:57:07.242069] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-09T19:57:07.242905] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-09T19:57:07.242970] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-09T19:57:07.244091] [DEBUG] [LOCAL ] LII: Trimmed 41371 records to 28203 (keeping 200 days of data) [2025-10-09T19:57:07.431212] [DEBUG] [LOCAL ] LII: Primary data saved (28203 records). [2025-10-09T19:57:07.431353] [INFO ] [MAIN ] LII: Full history saved. [2025-10-09T19:57:07.431438] [INFO ] [MAIN ] Update Progress: 1258/2373 symbols completed. LII took 36.9s. Estimated remaining: 2h 36m 56s. Rate: 7.1 symbols/min [2025-10-09T19:57:07.600430] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:07.653305] [DEBUG] [LOCAL ] LLY: Loaded 53293 existing records from primary storage. [2025-10-09T19:57:07.653696] [INFO ] [MAIN ] LLY: Loaded 53293 existing records. [2025-10-09T19:57:07.831881] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:07.832088] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-09T19:57:07.832135] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-09T19:57:07.832344] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-09T19:57:07.832400] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-09T19:57:08.010669] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-09T19:57:08.154800] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-09T19:57:08.220004] [INFO ] [REMOTE ] LHX: Full fetch complete (70636 records). [2025-10-09T19:57:08.219888] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:08.220397] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-09T19:57:08.633592] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-09T19:57:08.634224] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-09T19:57:08.635473] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-09T19:57:08.638983] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-09T19:57:08.643466] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-09T19:57:08.647360] [DEBUG] [LOCAL ] LHX: Trimmed 70636 records to 48939 (keeping 200 days of data) [2025-10-09T19:57:08.800383] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-09T19:57:08.820167] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-09T19:57:09.013994] [DEBUG] [LOCAL ] LHX: Primary data saved (48939 records). [2025-10-09T19:57:09.014298] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-09T19:57:09.014400] [INFO ] [MAIN ] Update Progress: 1259/2373 symbols completed. LHX took 42.8s. Estimated remaining: 2h 36m 42s. Rate: 7.1 symbols/min [2025-10-09T19:57:09.180375] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:09.228718] [DEBUG] [LOCAL ] LMND: Loaded 51987 existing records from primary storage. [2025-10-09T19:57:09.229035] [INFO ] [MAIN ] LMND: Loaded 51987 existing records. [2025-10-09T19:57:09.403314] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:09.403547] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-09T19:57:09.403594] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-09T19:57:09.403830] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-09T19:57:09.403887] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-09T19:57:09.612299] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-09T19:57:09.797727] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:10.396749] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-09T19:57:11.142510] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-09T19:57:11.196679] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-09T19:57:11.288216] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-09T19:57:11.292613] [INFO ] [REMOTE ] LION: Full fetch complete (56226 records). [2025-10-09T19:57:11.292772] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-09T19:57:11.696393] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-09T19:57:11.696474] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-09T19:57:11.697307] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-09T19:57:11.697437] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-09T19:57:11.698772] [DEBUG] [LOCAL ] LION: Trimmed 56226 records to 45809 (keeping 200 days of data) [2025-10-09T19:57:11.965618] [DEBUG] [LOCAL ] LION: Primary data saved (45809 records). [2025-10-09T19:57:11.965781] [INFO ] [MAIN ] LION: Full history saved. [2025-10-09T19:57:11.965873] [INFO ] [MAIN ] Update Progress: 1260/2373 symbols completed. LION took 35.9s. Estimated remaining: 2h 36m 28s. Rate: 7.1 symbols/min [2025-10-09T19:57:12.002687] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-09T19:57:12.140958] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:12.173722] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-09T19:57:12.226138] [DEBUG] [LOCAL ] LMT: Loaded 49773 existing records from primary storage. [2025-10-09T19:57:12.226454] [INFO ] [MAIN ] LMT: Loaded 49773 existing records. [2025-10-09T19:57:12.416380] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:12.416628] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-09T19:57:12.416736] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-09T19:57:12.417006] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-09T19:57:12.417073] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-09T19:57:12.658004] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-09T19:57:12.796900] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-09T19:57:12.819111] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:13.046433] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-09T19:57:13.596780] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-09T19:57:13.914905] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T19:57:14.396784] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-09T19:57:14.605161] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-09T19:57:15.196774] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-09T19:57:15.677197] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-09T19:57:15.996779] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-09T19:57:16.307225] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T19:57:16.796782] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-09T19:57:17.596744] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-09T19:57:17.908281] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-09T19:57:18.396741] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-09T19:57:18.816791] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-09T19:57:19.196723] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-09T19:57:19.996729] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-09T19:57:20.063722] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-09T19:57:20.235745] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-09T19:57:20.489827] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-09T19:57:20.796697] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-09T19:57:21.250333] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-09T19:57:21.596761] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-09T19:57:22.051864] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-09T19:57:22.396706] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-09T19:57:23.005498] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-09T19:57:23.196703] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-09T19:57:23.730945] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-09T19:57:23.996749] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-09T19:57:24.796796] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-09T19:57:25.301092] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-09T19:57:25.301992] [INFO ] [REMOTE ] LITB: Full fetch complete (5650 records). [2025-10-09T19:57:25.302061] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-09T19:57:25.610681] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-09T19:57:25.674819] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-09T19:57:25.674954] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-09T19:57:25.675314] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-09T19:57:25.675394] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-09T19:57:25.676361] [DEBUG] [LOCAL ] LITB: Trimmed 5650 records to 4269 (keeping 200 days of data) [2025-10-09T19:57:25.704009] [DEBUG] [LOCAL ] LITB: Primary data saved (4269 records). [2025-10-09T19:57:25.704210] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-09T19:57:25.704411] [INFO ] [MAIN ] Update Progress: 1261/2373 symbols completed. LITB took 29.3s. Estimated remaining: 2h 36m 25s. Rate: 7.1 symbols/min [2025-10-09T19:57:25.885667] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-09T19:57:25.930761] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:25.988096] [DEBUG] [LOCAL ] LNC: Loaded 51610 existing records from primary storage. [2025-10-09T19:57:25.988437] [INFO ] [MAIN ] LNC: Loaded 51610 existing records. [2025-10-09T19:57:26.169695] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:26.170002] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-09T19:57:26.185248] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-09T19:57:26.195355] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-09T19:57:26.195499] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-09T19:57:26.261528] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-09T19:57:26.406608] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-09T19:57:26.567846] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:27.196744] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-09T19:57:27.641443] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-09T19:57:27.996790] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-09T19:57:28.266758] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-09T19:57:28.796833] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-09T19:57:29.312245] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-09T19:57:29.596765] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-09T19:57:29.691923] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-09T19:57:30.396743] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-09T19:57:30.597387] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-09T19:57:31.196770] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-09T19:57:31.996775] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-09T19:57:32.046893] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-09T19:57:32.268847] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-09T19:57:32.796791] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-09T19:57:32.947760] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-09T19:57:33.596731] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-09T19:57:33.625575] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-09T19:57:34.396761] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-09T19:57:35.196704] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-09T19:57:35.450638] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-09T19:57:35.606453] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-09T19:57:35.951859] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-09T19:57:35.996695] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-09T19:57:36.796714] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-09T19:57:37.162052] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-09T19:57:37.596700] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-09T19:57:38.248969] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-09T19:57:38.337066] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-09T19:57:38.396686] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-09T19:57:39.196730] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-09T19:57:39.996796] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-09T19:57:40.193315] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-09T19:57:40.537079] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-09T19:57:40.796672] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-09T19:57:40.913564] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-09T19:57:41.503854] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-09T19:57:41.508893] [INFO ] [REMOTE ] LLY: Full fetch complete (77253 records). [2025-10-09T19:57:41.533593] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-09T19:57:41.538755] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-09T19:57:41.599114] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-09T19:57:41.963230] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-09T19:57:41.963323] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-09T19:57:41.964510] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-09T19:57:41.964581] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-09T19:57:41.966508] [DEBUG] [LOCAL ] LLY: Trimmed 77253 records to 53664 (keeping 200 days of data) [2025-10-09T19:57:42.313255] [DEBUG] [LOCAL ] LLY: Primary data saved (53664 records). [2025-10-09T19:57:42.313406] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-09T19:57:42.313536] [INFO ] [MAIN ] Update Progress: 1262/2373 symbols completed. LLY took 34.9s. Estimated remaining: 2h 36m 23s. Rate: 7.1 symbols/min [2025-10-09T19:57:42.406430] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-09T19:57:42.487538] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:42.495117] [DEBUG] [LOCAL ] LND: Loaded 4976 existing records from primary storage. [2025-10-09T19:57:42.495334] [INFO ] [MAIN ] LND: Loaded 4976 existing records. [2025-10-09T19:57:42.668749] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:42.668957] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-09T19:57:42.669004] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-09T19:57:42.669248] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-09T19:57:42.669305] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-09T19:57:43.089852] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:43.196718] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-09T19:57:43.657933] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-09T19:57:43.909834] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-09T19:57:43.996699] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-09T19:57:44.180392] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:57:44.602501] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-09T19:57:44.796780] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-09T19:57:45.596755] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-09T19:57:46.396716] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-09T19:57:46.479572] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-09T19:57:47.196761] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-09T19:57:47.821480] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-09T19:57:47.996721] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-09T19:57:48.260527] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-09T19:57:48.264950] [INFO ] [REMOTE ] LMT: Full fetch complete (72352 records). [2025-10-09T19:57:48.265116] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-09T19:57:48.660966] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-09T19:57:48.661055] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-09T19:57:48.662145] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-09T19:57:48.662214] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-09T19:57:48.663630] [DEBUG] [LOCAL ] LMT: Trimmed 72352 records to 50089 (keeping 200 days of data) [2025-10-09T19:57:48.799426] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-09T19:57:49.008660] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-09T19:57:49.037754] [DEBUG] [LOCAL ] LMT: Primary data saved (50089 records). [2025-10-09T19:57:49.037921] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-09T19:57:49.038987] [INFO ] [MAIN ] Update Progress: 1263/2373 symbols completed. LMT took 37.1s. Estimated remaining: 2h 36m 13s. Rate: 7.1 symbols/min [2025-10-09T19:57:49.209816] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:49.261930] [DEBUG] [LOCAL ] LNG: Loaded 51319 existing records from primary storage. [2025-10-09T19:57:49.262245] [INFO ] [MAIN ] LNG: Loaded 51319 existing records. [2025-10-09T19:57:49.381106] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-09T19:57:49.449632] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:49.449866] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-09T19:57:49.449915] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-09T19:57:49.450173] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-09T19:57:49.450233] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-09T19:57:49.601842] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-09T19:57:49.826623] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:50.174760] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-09T19:57:50.179446] [INFO ] [REMOTE ] LMND: Full fetch complete (75329 records). [2025-10-09T19:57:50.179575] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-09T19:57:50.378097] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-09T19:57:50.399333] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-09T19:57:50.600103] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-09T19:57:50.600216] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-09T19:57:50.601239] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-09T19:57:50.601305] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-09T19:57:50.602801] [DEBUG] [LOCAL ] LMND: Trimmed 75329 records to 52371 (keeping 200 days of data) [2025-10-09T19:57:50.912533] [DEBUG] [LOCAL ] LMND: Primary data saved (52371 records). [2025-10-09T19:57:50.912699] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-09T19:57:50.912807] [INFO ] [MAIN ] Update Progress: 1264/2373 symbols completed. LMND took 41.9s. Estimated remaining: 2h 35m 59s. Rate: 7.1 symbols/min [2025-10-09T19:57:51.079116] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:51.092627] [DEBUG] [LOCAL ] LNN: Loaded 11300 existing records from primary storage. [2025-10-09T19:57:51.092871] [INFO ] [MAIN ] LNN: Loaded 11300 existing records. [2025-10-09T19:57:51.201830] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-09T19:57:51.269180] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:51.269406] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-09T19:57:51.269454] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-09T19:57:51.269703] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-09T19:57:51.269762] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-09T19:57:51.611736] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:51.996744] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-09T19:57:52.154537] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-09T19:57:52.638518] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-09T19:57:52.796716] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-09T19:57:52.949690] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-09T19:57:53.596719] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-09T19:57:54.396696] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-09T19:57:54.417952] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-09T19:57:54.533071] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-09T19:57:55.196770] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-09T19:57:55.864906] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-09T19:57:55.996813] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-09T19:57:56.201390] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-09T19:57:56.796772] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-09T19:57:57.596750] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-09T19:57:57.614718] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-09T19:57:57.619370] [INFO ] [REMOTE ] LNC: Full fetch complete (74345 records). [2025-10-09T19:57:57.619549] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-09T19:57:58.009842] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-09T19:57:58.009931] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-09T19:57:58.010952] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-09T19:57:58.011017] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-09T19:57:58.012505] [DEBUG] [LOCAL ] LNC: Trimmed 74345 records to 51968 (keeping 200 days of data) [2025-10-09T19:57:58.340779] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-09T19:57:58.359328] [DEBUG] [LOCAL ] LNC: Primary data saved (51968 records). [2025-10-09T19:57:58.359507] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-09T19:57:58.360295] [INFO ] [MAIN ] Update Progress: 1265/2373 symbols completed. LNC took 32.7s. Estimated remaining: 2h 35m 50s. Rate: 7.1 symbols/min [2025-10-09T19:57:58.406354] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-09T19:57:58.548729] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:57:58.592255] [DEBUG] [LOCAL ] LOAR: Loaded 42082 existing records from primary storage. [2025-10-09T19:57:58.592818] [INFO ] [MAIN ] LOAR: Loaded 42082 existing records. [2025-10-09T19:57:58.782153] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:57:58.782527] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-09T19:57:58.782586] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-09T19:57:58.797824] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-09T19:57:58.807753] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-09T19:57:58.882706] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-09T19:57:59.141532] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-09T19:57:59.198192] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-09T19:57:59.221464] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:57:59.769605] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-09T19:57:59.996744] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-09T19:58:00.796729] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-09T19:58:01.518162] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-09T19:58:01.596729] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-09T19:58:01.839722] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-09T19:58:02.396747] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-09T19:58:02.479269] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-09T19:58:03.197243] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-09T19:58:03.203967] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-09T19:58:03.996760] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-09T19:58:04.805727] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-09T19:58:04.829252] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-09T19:58:04.853361] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-09T19:58:05.596759] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-09T19:58:06.080469] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-09T19:58:06.396743] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-09T19:58:07.099945] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T19:58:07.196798] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-09T19:58:07.473577] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-09T19:58:07.996815] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-09T19:58:08.256633] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-09T19:58:08.639685] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-09T19:58:08.796770] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-09T19:58:09.596741] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-09T19:58:10.364901] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-09T19:58:10.396680] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-09T19:58:11.129555] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-09T19:58:11.196772] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-09T19:58:11.996741] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-09T19:58:12.164161] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-09T19:58:12.796780] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-09T19:58:12.814939] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-09T19:58:12.990859] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-09T19:58:13.596729] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-09T19:58:14.350974] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-09T19:58:14.396679] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-09T19:58:15.196694] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-09T19:58:15.243403] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-09T19:58:15.261248] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-09T19:58:15.573486] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-09T19:58:15.996725] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-09T19:58:16.796699] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-09T19:58:17.366763] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-09T19:58:17.464083] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-09T19:58:17.596714] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-09T19:58:18.396747] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-09T19:58:18.879999] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-09T19:58:19.196735] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-09T19:58:19.459179] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-09T19:58:19.460623] [INFO ] [REMOTE ] LNN: Full fetch complete (15570 records). [2025-10-09T19:58:19.460729] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-09T19:58:19.843309] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-09T19:58:19.854904] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-09T19:58:19.855287] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-09T19:58:19.855743] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-09T19:58:19.855805] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-09T19:58:19.856377] [DEBUG] [LOCAL ] LNN: Trimmed 15570 records to 11354 (keeping 200 days of data) [2025-10-09T19:58:19.932668] [DEBUG] [LOCAL ] LNN: Primary data saved (11354 records). [2025-10-09T19:58:19.932830] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-09T19:58:19.932936] [INFO ] [MAIN ] Update Progress: 1266/2373 symbols completed. LNN took 29.0s. Estimated remaining: 2h 35m 53s. Rate: 7.1 symbols/min [2025-10-09T19:58:20.001940] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-09T19:58:20.106615] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:20.133345] [DEBUG] [LOCAL ] LOB: Loaded 27185 existing records from primary storage. [2025-10-09T19:58:20.133680] [INFO ] [MAIN ] LOB: Loaded 27185 existing records. [2025-10-09T19:58:20.306734] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:20.306964] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-09T19:58:20.307012] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-09T19:58:20.307230] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-09T19:58:20.307287] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-09T19:58:20.649461] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:20.796822] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-09T19:58:21.430365] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-09T19:58:21.596703] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-09T19:58:21.900353] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-09T19:58:22.396722] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-09T19:58:22.869511] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-09T19:58:22.873152] [INFO ] [REMOTE ] LOAR: Full fetch complete (56099 records). [2025-10-09T19:58:22.873262] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-09T19:58:23.201795] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-09T19:58:23.314210] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-09T19:58:23.314287] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-09T19:58:23.315233] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-09T19:58:23.315298] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-09T19:58:23.316493] [DEBUG] [LOCAL ] LOAR: Trimmed 56099 records to 42335 (keeping 200 days of data) [2025-10-09T19:58:23.573102] [DEBUG] [LOCAL ] LOAR: Primary data saved (42335 records). [2025-10-09T19:58:23.573229] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-09T19:58:23.573312] [INFO ] [MAIN ] Update Progress: 1267/2373 symbols completed. LOAR took 25.2s. Estimated remaining: 2h 35m 40s. Rate: 7.1 symbols/min [2025-10-09T19:58:23.743019] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:23.748764] [DEBUG] [LOCAL ] LOCL: Loaded 3627 existing records from primary storage. [2025-10-09T19:58:23.749464] [INFO ] [MAIN ] LOCL: Loaded 3627 existing records. [2025-10-09T19:58:23.928124] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:23.932410] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-09T19:58:23.932176] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-09T19:58:23.933980] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-09T19:58:23.934183] [INFO ] [REMOTE ] LND: Full fetch complete (8082 records). [2025-10-09T19:58:23.934246] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-09T19:58:23.934325] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-09T19:58:23.934467] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-09T19:58:24.000343] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-09T19:58:24.624057] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-09T19:58:24.641059] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-09T19:58:24.660095] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-09T19:58:24.663810] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-09T19:58:24.666498] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-09T19:58:24.667240] [DEBUG] [LOCAL ] LND: Trimmed 8082 records to 4996 (keeping 200 days of data) [2025-10-09T19:58:24.779980] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:24.789815] [DEBUG] [LOCAL ] LND: Primary data saved (4996 records). [2025-10-09T19:58:24.789984] [INFO ] [MAIN ] LND: Full history saved. [2025-10-09T19:58:24.790089] [INFO ] [MAIN ] Update Progress: 1268/2373 symbols completed. LND took 42.5s. Estimated remaining: 2h 35m 26s. Rate: 7.1 symbols/min [2025-10-09T19:58:24.801780] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-09T19:58:24.969916] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:25.005085] [DEBUG] [LOCAL ] LOMA: Loaded 32180 existing records from primary storage. [2025-10-09T19:58:25.005405] [INFO ] [MAIN ] LOMA: Loaded 32180 existing records. [2025-10-09T19:58:25.186113] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:25.186387] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-09T19:58:25.186437] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-09T19:58:25.186745] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-09T19:58:25.186806] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-09T19:58:25.480635] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-09T19:58:25.566939] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:25.596670] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-09T19:58:26.330692] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-09T19:58:26.396686] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-09T19:58:26.722089] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-09T19:58:27.196754] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-09T19:58:27.893145] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-09T19:58:27.897526] [INFO ] [REMOTE ] LNG: Full fetch complete (74647 records). [2025-10-09T19:58:27.897760] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-09T19:58:27.998418] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-09T19:58:28.292387] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-09T19:58:28.292566] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-09T19:58:28.293613] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-09T19:58:28.293777] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-09T19:58:28.306854] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-09T19:58:28.312846] [DEBUG] [LOCAL ] LNG: Trimmed 74647 records to 51690 (keeping 200 days of data) [2025-10-09T19:58:28.642776] [DEBUG] [LOCAL ] LNG: Primary data saved (51690 records). [2025-10-09T19:58:28.642929] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-09T19:58:28.643021] [INFO ] [MAIN ] Update Progress: 1269/2373 symbols completed. LNG took 39.6s. Estimated remaining: 2h 35m 13s. Rate: 7.1 symbols/min [2025-10-09T19:58:28.804968] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-09T19:58:28.808343] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:28.868253] [DEBUG] [LOCAL ] LOW: Loaded 52977 existing records from primary storage. [2025-10-09T19:58:28.868549] [INFO ] [MAIN ] LOW: Loaded 52977 existing records. [2025-10-09T19:58:29.046238] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:29.046547] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-09T19:58:29.046696] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-09T19:58:29.047284] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-09T19:58:29.047393] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-09T19:58:29.189003] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-09T19:58:29.439067] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:29.596723] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-09T19:58:30.170132] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-09T19:58:30.396686] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-09T19:58:30.461379] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-09T19:58:31.196724] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-09T19:58:31.899863] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-09T19:58:31.996719] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-09T19:58:32.483590] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-09T19:58:32.796735] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-09T19:58:33.596739] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-09T19:58:33.804939] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-09T19:58:34.088790] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-09T19:58:34.218221] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-09T19:58:34.396726] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-09T19:58:34.832520] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-09T19:58:35.196729] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-09T19:58:35.996698] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-09T19:58:36.328334] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-09T19:58:36.796751] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-09T19:58:37.060826] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-09T19:58:37.596696] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-09T19:58:37.681619] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-09T19:58:38.027986] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-09T19:58:38.396732] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-09T19:58:39.196706] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-09T19:58:39.255101] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-09T19:58:39.996753] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-09T19:58:40.223412] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-09T19:58:40.291337] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-09T19:58:40.796798] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-09T19:58:41.120874] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-09T19:58:41.596746] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-09T19:58:42.396770] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-09T19:58:43.196754] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-09T19:58:43.446518] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-09T19:58:43.555843] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-09T19:58:43.583299] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-09T19:58:43.996709] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-09T19:58:44.796790] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-09T19:58:44.921034] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-09T19:58:45.596691] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-09T19:58:45.912733] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-09T19:58:46.396776] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-09T19:58:47.196741] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-09T19:58:47.418732] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-09T19:58:47.420196] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-09T19:58:47.996773] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-09T19:58:48.121734] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-09T19:58:48.454621] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-09T19:58:48.796730] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-09T19:58:49.230721] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-09T19:58:49.596758] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-09T19:58:50.396772] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-09T19:58:51.043338] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-09T19:58:51.196714] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-09T19:58:51.532509] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-09T19:58:51.996719] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-09T19:58:52.453398] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-09T19:58:52.456832] [INFO ] [REMOTE ] LOMA: Full fetch complete (47742 records). [2025-10-09T19:58:52.456970] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-09T19:58:52.801873] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-09T19:58:52.855735] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-09T19:58:52.855823] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-09T19:58:52.856623] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-09T19:58:52.856776] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-09T19:58:52.858409] [DEBUG] [LOCAL ] LOMA: Trimmed 47742 records to 32538 (keeping 200 days of data) [2025-10-09T19:58:53.051548] [DEBUG] [LOCAL ] LOMA: Primary data saved (32538 records). [2025-10-09T19:58:53.051717] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-09T19:58:53.051815] [INFO ] [MAIN ] Update Progress: 1270/2373 symbols completed. LOMA took 28.3s. Estimated remaining: 2h 35m 19s. Rate: 7.1 symbols/min [2025-10-09T19:58:53.221615] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-01 to 2025-10-09. [2025-10-09T19:58:53.238222] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-09T19:58:53.280509] [DEBUG] [LOCAL ] LPG: Loaded 39690 existing records from primary storage. [2025-10-09T19:58:53.280856] [INFO ] [MAIN ] LPG: Loaded 39690 existing records. [2025-10-09T19:58:53.455697] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-24, but need from 2024-12-20 for 200 day retention. Performing full refresh. [2025-10-09T19:58:53.455920] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-09T19:58:53.455969] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-09T19:58:53.456420] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-09T19:58:53.456479] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-09T19:58:53.597054] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-09T19:58:53.810087] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-20 to 2025-10-09 (requires 11 months of data pull). [2025-10-09T19:58:54.396737] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-09T19:58:54.538905] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-09T19:58:54.541618] [INFO ] [REMOTE ] LOB: Full fetch complete (38031 records). [2025-10-09T19:58:54.541733] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-09T19:58:54.711140] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-09T19:58:54.955351] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-09T19:58:54.955432] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-09T19:58:54.956149] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-09T19:58:54.956212] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-09T19:58:54.957078] [DEBUG] [LOCAL ] LOB: Trimmed 38031 records to 27349 (keeping 200 days of data) [2025-10-09T19:58:54.963661] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-09T19:58:54.964486] [INFO ] [REMOTE ] LOCL: Full fetch complete (4488 records). [2025-10-09T19:58:54.964555] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-09T19:58:55.200774] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-09T19:58:55.561741] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-09T19:58:55.563679] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-09T19:58:55.566723] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-09T19:58:55.566835] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-09T19:58:55.573844] [DEBUG] [LOCAL ] LOCL: Trimmed 4488 records to 3651 (keeping 200 days of data) [2025-10-09T19:58:55.673034] [DEBUG] [LOCAL ] LOB: Primary data